-- Logs begin at Tue 2022-09-06 22:04:31 UTC, end at Tue 2022-09-06 23:20:21 UTC. -- Sep 06 22:37:05.666437 dv-cinder-852208-20-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 06 22:37:05.676847 dv-cinder-852208-20-smb devstack@keystone.service[88066]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 06 22:37:05.678900 dv-cinder-852208-20-smb devstack@keystone.service[88066]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 22:37:05 2022] *** Sep 06 22:37:05.678900 dv-cinder-852208-20-smb devstack@keystone.service[88066]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 22:37:05.678900 dv-cinder-852208-20-smb devstack@keystone.service[88066]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 22:37:05.678900 dv-cinder-852208-20-smb devstack@keystone.service[88066]: nodename: dv-cinder-852208-20-smb Sep 06 22:37:05.678900 dv-cinder-852208-20-smb devstack@keystone.service[88066]: machine: x86_64 Sep 06 22:37:05.678900 dv-cinder-852208-20-smb devstack@keystone.service[88066]: clock source: unix Sep 06 22:37:05.678900 dv-cinder-852208-20-smb devstack@keystone.service[88066]: pcre jit disabled Sep 06 22:37:05.678900 dv-cinder-852208-20-smb devstack@keystone.service[88066]: detected number of CPU cores: 4 Sep 06 22:37:05.678900 dv-cinder-852208-20-smb devstack@keystone.service[88066]: current working directory: / Sep 06 22:37:05.678900 dv-cinder-852208-20-smb devstack@keystone.service[88066]: detected binary path: /usr/bin/uwsgi-core Sep 06 22:37:05.679551 dv-cinder-852208-20-smb devstack@keystone.service[88066]: your processes number limit is 47680 Sep 06 22:37:05.679551 dv-cinder-852208-20-smb devstack@keystone.service[88066]: your memory page size is 4096 bytes Sep 06 22:37:05.679551 dv-cinder-852208-20-smb devstack@keystone.service[88066]: detected max file descriptor number: 2048 Sep 06 22:37:05.679551 dv-cinder-852208-20-smb devstack@keystone.service[88066]: lock engine: pthread robust mutexes Sep 06 22:37:05.679551 dv-cinder-852208-20-smb devstack@keystone.service[88066]: thunder lock: enabled Sep 06 22:37:05.679551 dv-cinder-852208-20-smb devstack@keystone.service[88066]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 06 22:37:05.679551 dv-cinder-852208-20-smb devstack@keystone.service[88066]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 22:37:05.718791 dv-cinder-852208-20-smb devstack@keystone.service[88066]: Python main interpreter initialized at 0x5597a61c79c0 Sep 06 22:37:05.718791 dv-cinder-852208-20-smb devstack@keystone.service[88066]: python threads support enabled Sep 06 22:37:05.718791 dv-cinder-852208-20-smb devstack@keystone.service[88066]: your server socket listen backlog is limited to 100 connections Sep 06 22:37:05.718791 dv-cinder-852208-20-smb devstack@keystone.service[88066]: your mercy for graceful operations on workers is 90 seconds Sep 06 22:37:05.719209 dv-cinder-852208-20-smb devstack@keystone.service[88066]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 22:37:05.719307 dv-cinder-852208-20-smb devstack@keystone.service[88066]: *** Operational MODE: preforking *** Sep 06 22:37:05.719519 dv-cinder-852208-20-smb devstack@keystone.service[88066]: *** uWSGI is running in multiple interpreter mode *** Sep 06 22:37:05.719519 dv-cinder-852208-20-smb devstack@keystone.service[88066]: spawned uWSGI master process (pid: 88066) Sep 06 22:37:05.719710 dv-cinder-852208-20-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 06 22:37:05.724447 dv-cinder-852208-20-smb devstack@keystone.service[88066]: spawned uWSGI worker 1 (pid: 88077, cores: 1) Sep 06 22:37:05.724447 dv-cinder-852208-20-smb devstack@keystone.service[88066]: spawned uWSGI worker 2 (pid: 88078, cores: 1) Sep 06 22:37:05.724447 dv-cinder-852208-20-smb devstack@keystone.service[88066]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 22:37:10.046142 dv-cinder-852208-20-smb devstack@keystone.service[88078]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 22:37:10.046142 dv-cinder-852208-20-smb devstack@keystone.service[88078]: from cryptography.utils import int_from_bytes Sep 06 22:37:10.046943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 22:37:10.046943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: from cryptography.utils import int_from_bytes Sep 06 22:37:10.047804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 22:37:10.047804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: from cryptography.utils import int_from_bytes Sep 06 22:37:10.048261 dv-cinder-852208-20-smb devstack@keystone.service[88077]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 22:37:10.048261 dv-cinder-852208-20-smb devstack@keystone.service[88077]: from cryptography.utils import int_from_bytes Sep 06 22:37:10.098015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 22:37:10.098206 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 22:37:10.098402 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] command line args: [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 22:37:10.098673 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 22:37:10.098850 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ================================================================================ {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 22:37:10.099105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] admin_token = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.099348 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] config_dir = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.099532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.099609 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 22:37:10.099711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] config_source = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.099801 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 22:37:10.099933 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] debug = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.100541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] command line args: [] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 22:37:10.100662 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.100909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 22:37:10.100979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ================================================================================ {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 22:37:10.101050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.101186 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.101271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] admin_token = **** {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.101439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.101526 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] config_dir = [] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.101633 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.101719 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.101817 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] config_source = [] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.101895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.101995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] debug = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.102068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_config_append = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.102192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.102302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.102404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_dir = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.102478 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.102548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_file = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.102608 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.102784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.102886 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.103024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.103106 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.103269 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.103357 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] list_limit = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.103472 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] log_config_append = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.103591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.103681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.103764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.103845 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] log_dir = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.103934 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.104052 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] log_file = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.104142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.104220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.104291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.104544 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.104658 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.104777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.104878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.105010 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.105110 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.105184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.105264 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.105363 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.105469 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.105612 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.105701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.105860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.105951 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.106094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.106327 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.106417 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.106560 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.106641 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] publish_errors = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.106793 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.106879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.107023 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.107113 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.107182 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.107431 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.107613 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.107692 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.107877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] standard_threads = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.107967 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.108105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.108351 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.115712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.115867 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.115945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] publish_errors = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.116016 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] use_journal = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.116093 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.116170 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] use_json = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.116170 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] use_stderr = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.116316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.116393 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] use_syslog = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.116492 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.116573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.116651 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.116734 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.116807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.116877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.116947 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] standard_threads = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.117016 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.117098 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.117170 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.117240 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.117240 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.117366 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.117435 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] use_journal = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.117515 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.117588 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] use_json = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.117588 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] use_stderr = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.117720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.117797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] use_syslog = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.117874 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.118021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:37:10.118096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.118172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.118243 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.118313 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.118382 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.118459 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.118532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.118607 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.118679 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.118754 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.118825 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.118972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.119050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.119122 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.119192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.119262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.119332 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.119410 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.119487 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.119565 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.119637 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.119707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.119776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.119854 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.119927 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.119997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.120067 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.120137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.120207 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.120285 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.120357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.120453 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.120529 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.120610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.120684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.120765 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.120839 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.120839 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.120971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.121042 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.121117 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.121196 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.121268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.121338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.121407 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.121477 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.121551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.121700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.121784 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.121855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.121855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.121994 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.122070 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.122152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.122152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.122287 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.122358 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.122434 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.122434 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.122570 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.122646 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.122722 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.122799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.122877 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.122955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.123027 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.123207 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.123337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.123421 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.123493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.123571 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.123644 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.123715 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.123824 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.123922 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.124018 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.124128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.124237 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.124336 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.124483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.124625 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.124735 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.124876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.125023 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.125128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.125226 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.125345 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.125345 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.125566 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.125645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.125761 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.125837 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.125952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.126028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.126109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.126184 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.126310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.126394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.126467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.126584 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.126660 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.126740 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.126814 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.126932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.127008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.127080 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.127208 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.127325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.127413 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.127493 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.127571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.127644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.127762 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.127846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.127920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.128037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.128113 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.128229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.128305 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.128388 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.128490 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.128571 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.128644 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.128762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.128838 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.128922 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.129004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.129078 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.129201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.129287 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.129361 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.129486 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.129612 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.129691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.129763 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.129879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.129956 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.130017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.130085 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.130163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.130241 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.130314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.130384 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.130531 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.130608 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.130679 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.130750 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.130821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.130898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.130979 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.131053 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.131130 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.131202 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.131278 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.131358 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.131444 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.131524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.131605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.131679 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.131750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.131822 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.131893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.131893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.132038 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.132118 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.132190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.132260 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.132331 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.132401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.132975 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.133086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.133240 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.133331 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.133412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.133486 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.133573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.133649 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.133720 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.133792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.133864 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.133935 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.134020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.134101 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.134174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.134245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.134316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.134395 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.134475 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.134552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.134629 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.134702 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.134773 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.134844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.134922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.134995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.external = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.135066 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.135205 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.135284 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.135356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.135437 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.135512 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.135589 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.135662 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.password = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.135739 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.135819 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] auth.token = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.135939 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.136029 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.136113 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.136237 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.136314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.136386 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.136544 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.136620 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.136706 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.136782 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.136782 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.136913 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.136984 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.137067 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.137142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.137214 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] auth.external = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.137285 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.137357 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.137435 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.137517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.137598 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.137671 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.137743 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.137815 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] auth.password = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.137886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.137966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] auth.token = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.138082 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.138165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.138331 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.138413 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.138581 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.138671 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.138813 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.138904 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.139063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.139143 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.139341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.139429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.139577 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.139658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.139816 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] credential.caching = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.139895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.140061 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.140148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.140309 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.140396 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.140562 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.140645 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.140796 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.140886 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.141038 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.141118 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.141279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.141357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.141503 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.141657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.141740 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.141814 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.141966 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.142175 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.142263 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.142395 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.142481 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.142598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.142680 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.142850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.142929 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.143109 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.143199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.143340 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.143425 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.143584 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.143665 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.143818 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] federation.caching = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.143906 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.144048 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.144127 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.144279 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.144359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.144546 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.144629 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.144774 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.144854 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.145006 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.145086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.145244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.145325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.145488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.145567 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.145716 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.145796 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.145947 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.146039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.146174 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.146254 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.146414 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.146509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.146657 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.147255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] identity.caching = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.147422 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.147505 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.147672 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.147761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.147911 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.147992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.148148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.148235 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.148399 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.150233 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.150233 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.150432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.150532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.150612 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.150685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.150766 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.150840 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.150912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.150984 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.151056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.151127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.151206 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.151280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.151352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.151423 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.151494 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.151560 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.151639 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.151713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.151785 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.151856 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.151933 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.152007 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.152086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.152161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.152232 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.152303 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.152374 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.152513 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.152604 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.152681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.152753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.152824 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.152895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.152966 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.153070 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.153152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.153225 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.153287 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.153391 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.153475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.153475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.153619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.153691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.153762 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.153834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.153905 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.154072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.154154 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.154322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.154410 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.154559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.154639 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.154805 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.154886 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.155040 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.155119 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.155271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.155349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.155503 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.155584 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.155731 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.155810 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.155966 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.156045 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.156223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.156304 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.156472 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.156556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.156720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.156800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.156966 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.157048 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.157209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.157289 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.157442 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.157521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.157670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.157751 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.157902 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.157982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.158133 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.158220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.158364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.158444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.158591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.158670 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.158840 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.158928 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.159083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.159162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.159328 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.159565 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.159646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.user = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.159806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.159896 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.160033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.160114 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.160275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.160356 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.160530 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.160615 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.160763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.160844 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.160995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.161075 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.161226 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.161308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.161462 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.161540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.161699 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.161779 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.161930 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.162011 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.162163 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.162242 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.162448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.163020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.163187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.163277 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.163438 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.163520 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.163652 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.163732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.163886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.163968 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.164130 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.164211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.164368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.164468 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.164629 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.164712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.164864 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.164990 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.165115 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.165191 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.165350 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.165442 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.165596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.165676 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.165826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.165905 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.166072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.166182 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.166317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.166425 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.166548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.166688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.166777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.166921 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.167001 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.167168 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.167248 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.167407 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.167495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] role.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.167644 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.167724 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] role.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.167884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.167964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.168126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.168213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.168367 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.168465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.168634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.168715 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.168874 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.168967 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.169117 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.169198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] resource.caching = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.169362 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.169443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.169606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.169695 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.169840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.169921 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.170067 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.170146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.170348 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.170447 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.170551 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.170624 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.170795 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.170876 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.171038 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.171121 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.171283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.171427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.171508 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] role.caching = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.171661 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.171750 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] role.driver = sql {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.171949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.172041 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.172150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.172231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.172394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.172547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.172663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.172745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.172895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.173025 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.173145 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.173235 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.173393 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.173474 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.173627 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.173707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.173857 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.173945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.174085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.174165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.174311 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.174392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.174557 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.174646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.174808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.174891 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.175052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.175132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.175286 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.175505 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.175587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.175733 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.175811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.175965 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.176045 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.176198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.176326 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.176460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.176567 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.176696 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.176818 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.178903 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.178985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.179053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.179124 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.179197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.179278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.179353 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.179425 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.179497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.179569 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.179640 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.179740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.179816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.179889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.179962 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.180034 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.180106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.180106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.180246 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.180246 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.180371 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.180495 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.180573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.180666 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.180751 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.180833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.180908 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.180979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] token.caching = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.181051 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.connection = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.181122 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.181194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.181277 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.181351 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.181423 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.181495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.181566 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.181638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.181717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.181791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.181791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.181927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.182033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.182098 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.182167 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.182260 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.182352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.182426 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.182499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.182571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.182719 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.182802 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.182876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.183013 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.183094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.183259 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.183348 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.183515 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.183595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.183742 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.183822 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.183979 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.184070 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.184217 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.184294 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.184366 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 22:37:10.184516 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] database.connection = **** {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.184762 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.185011 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.185249 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.185489 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.185725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.185960 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.186197 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.186439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.186684 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.186921 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.187164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.187436 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.187693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.187927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.188254 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.188519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.188764 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.189002 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:37:10.189172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 22:37:10.213966 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.214191 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.214417 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.215716 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.215953 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.216183 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.222676 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.224566 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.251007 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.251228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.258898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.259130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.311322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.311852 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.364199 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.364461 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.364603 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.364841 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.535782 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.535976 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.536050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.536186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.536293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.536415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.536514 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.536659 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.536742 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.536880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.536964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.537093 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.562947 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.563118 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.563275 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.563401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.563532 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.563658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.563788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.563930 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.564051 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.564178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.564303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.564468 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.564590 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.564734 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.576084 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.576228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.589758 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.589947 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.590090 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.590177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.590255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.590389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.590481 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.590567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.590643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.590793 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.590876 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.591013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.591094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.591230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 22:37:10.615147 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.615323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.615413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 22:37:10.615559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 22:37:10.615746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.615927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.616009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 22:37:10.616128 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 22:37:10.616209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.616402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.616514 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.616689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.616778 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.616948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.617026 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.617206 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.626637 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.626785 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.626919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.627065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.627196 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.627340 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.627482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.627636 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.634996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.635237 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.637921 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.638142 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.638228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.638430 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.638513 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.638713 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.638798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.639001 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.639083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.639322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.639425 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.639586 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.639675 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.639856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.639937 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.640129 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.640218 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.640400 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.640500 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.640697 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.640777 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.640968 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.663842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.664325 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.665328 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.665619 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.665813 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.666098 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.670265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.670552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.670837 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.670931 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.671149 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.671429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.677226 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.677518 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.677811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.678127 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.683265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.683570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.683789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.683872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.684085 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.684180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.684371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.684471 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.684686 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.684768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.685125 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.685222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.685286 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.685347 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.685530 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.685800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.701241 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.701519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.701811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.702093 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.705397 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.705895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.708664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.709748 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.709985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.710282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.713990 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.714811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.721345 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.721442 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.721520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.721520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.721520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.721725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.721799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.721872 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.721953 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.722029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.722101 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.722174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.722325 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.722619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.737751 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.738041 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.739537 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.739636 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.739717 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.739793 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.739793 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.739793 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.745520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.746246 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.747072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.747778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.748637 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.748924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.749332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.749616 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.751678 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.751970 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.752265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.752349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.752580 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.752666 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.752937 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.753018 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.753239 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.753650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.764745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.765007 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.765291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.765407 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.768209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.768295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.768372 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.768477 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.768555 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.768647 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.768726 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.768799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.768799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.768799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.783260 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.783775 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.786185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.786734 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.789153 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.789678 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.790645 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.791156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.792298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.792604 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.792688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.792923 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.793005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.793321 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.799368 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.799646 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.800859 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.801132 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.804256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.804562 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.804677 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.804962 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.805091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.805240 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.805321 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.805523 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.813360 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.813457 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.813615 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.813697 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.813896 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.814021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.821430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.821644 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 22:37:10.821729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.822002 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.822096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.825590 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.825677 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.825741 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.825808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.825808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.825943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.826020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.826096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.826157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.826236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.826310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.826390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.826465 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.826537 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.826609 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.826680 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.826759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.826833 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.826906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.826977 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.827049 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.827128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.827193 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 22:37:10.859270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5597a61c79c0 pid: 88077 (default app) Sep 06 22:37:10.860133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5597a61c79c0 pid: 88078 (default app) Sep 06 22:37:10.862549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f58af-3dde-4d38-a5c8-0770ce89a4de None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:10.862839 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f58af-3dde-4d38-a5c8-0770ce89a4de None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:10.863117 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f58af-3dde-4d38-a5c8-0770ce89a4de None None] PATH_INFO: `/v3` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:10.867908 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Tue Sep 6 22:37:10 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:18.489537 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e344f7-6766-4cb8-9fdb-ce7c4ce4ecd6 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:18.490539 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e344f7-6766-4cb8-9fdb-ce7c4ce4ecd6 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:18.490539 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e344f7-6766-4cb8-9fdb-ce7c4ce4ecd6 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:18.494802 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:37:18.499923 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d232023-1997-4add-96e7-50400713e95c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:18.500316 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d232023-1997-4add-96e7-50400713e95c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:18.500491 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d232023-1997-4add-96e7-50400713e95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:18.571212 dv-cinder-852208-20-smb devstack@keystone.service[88077]: INFO dbcounter [None req-4d232023-1997-4add-96e7-50400713e95c None None] Registered counter for database keystone Sep 06 22:37:18.590159 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG oslo_db.sqlalchemy.engines [None req-4d232023-1997-4add-96e7-50400713e95c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 22:37:18.596241 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writer thread running {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 22:37:18.772878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG passlib.handlers.bcrypt [None req-4d232023-1997-4add-96e7-50400713e95c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88077) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 06 22:37:18.773262 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG passlib.handlers.bcrypt [None req-4d232023-1997-4add-96e7-50400713e95c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88077) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 06 22:37:18.831757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4d232023-1997-4add-96e7-50400713e95c None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:18.833401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4d232023-1997-4add-96e7-50400713e95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:18.960320 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 06 22:37:19.414740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e344f7-6766-4cb8-9fdb-ce7c4ce4ecd6 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:19.484477 dv-cinder-852208-20-smb devstack@keystone.service[88078]: INFO dbcounter [None req-39e344f7-6766-4cb8-9fdb-ce7c4ce4ecd6 None None] Registered counter for database keystone Sep 06 22:37:19.506012 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG oslo_db.sqlalchemy.engines [None req-39e344f7-6766-4cb8-9fdb-ce7c4ce4ecd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88078) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 22:37:19.512176 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writer thread running {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 22:37:19.630171 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e344f7-6766-4cb8-9fdb-ce7c4ce4ecd6 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:19.634980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acb45d-5f09-4e2c-904f-30a333d1e845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:19.635614 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acb45d-5f09-4e2c-904f-30a333d1e845 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:19.635894 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acb45d-5f09-4e2c-904f-30a333d1e845 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:19.636163 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acb45d-5f09-4e2c-904f-30a333d1e845 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:19.644255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acb45d-5f09-4e2c-904f-30a333d1e845 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:19.695369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f1acb45d-5f09-4e2c-904f-30a333d1e845 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 06 22:37:19.695666 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acb45d-5f09-4e2c-904f-30a333d1e845 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:19.705108 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1324 bytes} [Tue Sep 6 22:37:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 22:37:19.711875 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d232023-1997-4add-96e7-50400713e95c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:19.726110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d232023-1997-4add-96e7-50400713e95c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:19.730514 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a1116-09f1-4fdb-8c4f-4edc85427fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:19.731636 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a1116-09f1-4fdb-8c4f-4edc85427fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:19.731921 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a1116-09f1-4fdb-8c4f-4edc85427fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:19.732221 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a1116-09f1-4fdb-8c4f-4edc85427fa1 admin admin] PATH_INFO: `/v3/projects/ff1d6ddadcad498caaf30606299b1515` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:19.733819 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a1116-09f1-4fdb-8c4f-4edc85427fa1 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff1d6ddadcad498caaf30606299b1515)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:19.786620 dv-cinder-852208-20-smb devstack@keystone.service[88077]: WARNING keystone.common.rbac_enforcer.enforcer [None req-281a1116-09f1-4fdb-8c4f-4edc85427fa1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 06 22:37:19.786969 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a1116-09f1-4fdb-8c4f-4edc85427fa1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:19.791521 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 3/5] 10.222.0.30 () {56 vars in 1207 bytes} [Tue Sep 6 22:37:19 2022] GET /identity/v3/projects/ff1d6ddadcad498caaf30606299b1515 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:21.897547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f87e29-6cf4-4e3d-ab17-83f8466d8bc4 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:21.898056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f87e29-6cf4-4e3d-ab17-83f8466d8bc4 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:21.898137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f87e29-6cf4-4e3d-ab17-83f8466d8bc4 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:21.902190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 3/6] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:37:21.907523 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79737703-f88a-4f82-9cef-5067ebfb55dc None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:21.907881 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79737703-f88a-4f82-9cef-5067ebfb55dc None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:21.908073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79737703-f88a-4f82-9cef-5067ebfb55dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:21.929286 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-79737703-f88a-4f82-9cef-5067ebfb55dc None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:21.939709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-79737703-f88a-4f82-9cef-5067ebfb55dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:21.939709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 06 22:37:22.204642 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f87e29-6cf4-4e3d-ab17-83f8466d8bc4 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:22.217161 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f87e29-6cf4-4e3d-ab17-83f8466d8bc4 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:22.221320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2defbf-d523-4eb1-9aaf-1965b83d0aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:22.221917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2defbf-d523-4eb1-9aaf-1965b83d0aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:22.222197 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2defbf-d523-4eb1-9aaf-1965b83d0aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:22.222472 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2defbf-d523-4eb1-9aaf-1965b83d0aa0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:22.230649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2defbf-d523-4eb1-9aaf-1965b83d0aa0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:22.232436 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2defbf-d523-4eb1-9aaf-1965b83d0aa0 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:22.241209 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1324 bytes} [Tue Sep 6 22:37:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 22:37:22.246504 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79737703-f88a-4f82-9cef-5067ebfb55dc None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:22.255732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79737703-f88a-4f82-9cef-5067ebfb55dc None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:22.260119 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4791f4-88b6-4933-ba88-6d056f5cf8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:22.260796 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4791f4-88b6-4933-ba88-6d056f5cf8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:22.261082 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4791f4-88b6-4933-ba88-6d056f5cf8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:22.261361 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4791f4-88b6-4933-ba88-6d056f5cf8c1 admin admin] PATH_INFO: `/v3/users/8c7dd247a668409cb8ef9f1bcc9cb927` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:22.262677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4791f4-88b6-4933-ba88-6d056f5cf8c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=8c7dd247a668409cb8ef9f1bcc9cb927)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:22.264571 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4791f4-88b6-4933-ba88-6d056f5cf8c1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:22.266099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 5/9] 10.222.0.30 () {56 vars in 1198 bytes} [Tue Sep 6 22:37:22 2022] GET /identity/v3/users/8c7dd247a668409cb8ef9f1bcc9cb927 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:24.453128 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ec03d-e6e6-4698-9b14-9327723fbacf None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:24.453609 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ec03d-e6e6-4698-9b14-9327723fbacf None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:24.453609 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ec03d-e6e6-4698-9b14-9327723fbacf None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:24.454926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:24.460287 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdf2d1-09d8-4c33-a42c-ca9f5b2ddc0d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:24.460716 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdf2d1-09d8-4c33-a42c-ca9f5b2ddc0d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:24.460906 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdf2d1-09d8-4c33-a42c-ca9f5b2ddc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:24.478638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-96fdf2d1-09d8-4c33-a42c-ca9f5b2ddc0d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:24.479815 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-96fdf2d1-09d8-4c33-a42c-ca9f5b2ddc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:24.511814 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db018eb-03ab-4968-9995-3939c13d1032 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:24.512098 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db018eb-03ab-4968-9995-3939c13d1032 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:24.512383 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db018eb-03ab-4968-9995-3939c13d1032 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:24.513727 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 6/11] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:37:24.518871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cd96d-73bb-4ae2-b5ac-b67ca810822b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:24.519320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cd96d-73bb-4ae2-b5ac-b67ca810822b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:24.519599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cd96d-73bb-4ae2-b5ac-b67ca810822b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:24.559706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:24.560772 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG passlib.handlers.bcrypt [None req-528cd96d-73bb-4ae2-b5ac-b67ca810822b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88078) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 06 22:37:24.561162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG passlib.handlers.bcrypt [None req-528cd96d-73bb-4ae2-b5ac-b67ca810822b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88078) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 06 22:37:24.610256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-528cd96d-73bb-4ae2-b5ac-b67ca810822b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:24.611860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-528cd96d-73bb-4ae2-b5ac-b67ca810822b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:24.711126 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 22:37:24.825148 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdf2d1-09d8-4c33-a42c-ca9f5b2ddc0d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:24.849233 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:24.929766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdf2d1-09d8-4c33-a42c-ca9f5b2ddc0d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:24.961867 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569dbb1-443c-4f1b-a61c-49e15decca5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:24.962431 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569dbb1-443c-4f1b-a61c-49e15decca5d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:24.962711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569dbb1-443c-4f1b-a61c-49e15decca5d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:24.962984 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569dbb1-443c-4f1b-a61c-49e15decca5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:24.974573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569dbb1-443c-4f1b-a61c-49e15decca5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:37:24.975728 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cd96d-73bb-4ae2-b5ac-b67ca810822b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:24.983002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-6569dbb1-443c-4f1b-a61c-49e15decca5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:37:24.983002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:24.983002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:24.983002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:24.983002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:24.983002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:24.983002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:24.983002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:24.983002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:24.983002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:24.983002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:24.983002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:24.983002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:37:24.983002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:37:24.983002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:37:24.983002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:37:24.984012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:37:24.984012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:37:24.984012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:37:24.984012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:37:24.984012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:24.984012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:24.984012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:24.984012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:24.984012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:24.984012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:24.984012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:24.984012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:24.984012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:24.984012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:24.984012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:24.984012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:24.984994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:24.984994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:24.984994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:24.984994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:24.984994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:37:24.984994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:37:24.984994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:37:24.984994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:37:24.984994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:37:24.984994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:37:24.984994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:37:24.984994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:37:24.984994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 7/14] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:37:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:37:24.990257 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569dbb1-443c-4f1b-a61c-49e15decca5d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:25.073224 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:25.078174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cd96d-73bb-4ae2-b5ac-b67ca810822b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:25.080496 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:25.092150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569dbb1-443c-4f1b-a61c-49e15decca5d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:25.116647 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c6b50-79f4-40dd-93f9-bd597f43c86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:25.117509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c6b50-79f4-40dd-93f9-bd597f43c86f None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:25.117787 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c6b50-79f4-40dd-93f9-bd597f43c86f None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:25.118057 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c6b50-79f4-40dd-93f9-bd597f43c86f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:25.126750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16562b-b75a-4fc7-8f4e-ecfe2036f30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:25.127545 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16562b-b75a-4fc7-8f4e-ecfe2036f30c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:25.127808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16562b-b75a-4fc7-8f4e-ecfe2036f30c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:25.128079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16562b-b75a-4fc7-8f4e-ecfe2036f30c None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:25.128781 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16562b-b75a-4fc7-8f4e-ecfe2036f30c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:25.129078 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16562b-b75a-4fc7-8f4e-ecfe2036f30c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:25.130532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16562b-b75a-4fc7-8f4e-ecfe2036f30c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:25.141995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 8/15] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:37:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:37:25.148207 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16562b-b75a-4fc7-8f4e-ecfe2036f30c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:25.184673 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c6b50-79f4-40dd-93f9-bd597f43c86f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:25.186202 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c6b50-79f4-40dd-93f9-bd597f43c86f None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:25.245569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16562b-b75a-4fc7-8f4e-ecfe2036f30c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:25.278909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdb9f7-db8e-43fe-b44a-e46c24cfbc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:25.279520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdb9f7-db8e-43fe-b44a-e46c24cfbc16 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:25.279805 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdb9f7-db8e-43fe-b44a-e46c24cfbc16 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:25.280072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdb9f7-db8e-43fe-b44a-e46c24cfbc16 None admin] PATH_INFO: `/v3/users/8c7dd247a668409cb8ef9f1bcc9cb927` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:25.281243 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdb9f7-db8e-43fe-b44a-e46c24cfbc16 None admin] RBAC: Authorizing `identity:get_user(user_id=8c7dd247a668409cb8ef9f1bcc9cb927)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:25.282674 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdb9f7-db8e-43fe-b44a-e46c24cfbc16 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:25.283078 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 8/16] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:37:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 22:37:25.284209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 9/17] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:37:25 2022] GET /identity/v3/users/8c7dd247a668409cb8ef9f1bcc9cb927 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:37:25.289221 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c6b50-79f4-40dd-93f9-bd597f43c86f None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:25.290418 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdb9f7-db8e-43fe-b44a-e46c24cfbc16 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:25.291986 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:25.305388 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:25.385964 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c6b50-79f4-40dd-93f9-bd597f43c86f None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:25.387299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdb9f7-db8e-43fe-b44a-e46c24cfbc16 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:25.419779 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ec843-ed5d-4683-983a-99e6b48c4a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:25.419995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd04d2-17fe-44c5-b9f6-f2b1fce4c585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:25.420646 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd04d2-17fe-44c5-b9f6-f2b1fce4c585 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:25.420743 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ec843-ed5d-4683-983a-99e6b48c4a8b None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:25.420921 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ec843-ed5d-4683-983a-99e6b48c4a8b None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:25.421009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd04d2-17fe-44c5-b9f6-f2b1fce4c585 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:25.421189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd04d2-17fe-44c5-b9f6-f2b1fce4c585 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:25.421290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ec843-ed5d-4683-983a-99e6b48c4a8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:25.422343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd04d2-17fe-44c5-b9f6-f2b1fce4c585 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:25.423795 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd04d2-17fe-44c5-b9f6-f2b1fce4c585 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:25.425374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 10/18] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:37:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:37:25.431038 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd04d2-17fe-44c5-b9f6-f2b1fce4c585 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:25.439503 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ec843-ed5d-4683-983a-99e6b48c4a8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:25.441003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ec843-ed5d-4683-983a-99e6b48c4a8b None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:25.460417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-0f3ec843-ed5d-4683-983a-99e6b48c4a8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:37:25.460417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:25.460417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:25.460417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:25.460417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:25.460417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:25.460417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:25.460417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:25.460417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:25.460417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:25.460417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:25.460417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:25.460417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:37:25.460417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:37:25.460417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:37:25.460417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:37:25.461721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:25.461721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:25.461721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:25.461721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:25.461721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:25.461721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:25.461721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:25.461721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:25.461721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:25.461721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:25.461721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:25.461721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:25.461721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:25.461721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:25.461721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:25.461721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:25.461721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:37:25.462527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:37:25.462527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:37:25.462527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:37:25.462527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 9/19] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:37:25.467288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ec843-ed5d-4683-983a-99e6b48c4a8b None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:25.513030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:25.523465 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:25.531778 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd04d2-17fe-44c5-b9f6-f2b1fce4c585 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:25.565606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bc5ae-ac40-460b-b635-faa2f7d3e149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:25.566217 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bc5ae-ac40-460b-b635-faa2f7d3e149 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:25.566498 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bc5ae-ac40-460b-b635-faa2f7d3e149 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:25.566586 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ec843-ed5d-4683-983a-99e6b48c4a8b None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:25.566772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bc5ae-ac40-460b-b635-faa2f7d3e149 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:25.568010 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bc5ae-ac40-460b-b635-faa2f7d3e149 None admin] RBAC: Adding query filter params (role.id=aa2332d1bdb74e48a88ed7c2a7ed2990, scope.domain.id=default, user.id=8c7dd247a668409cb8ef9f1bcc9cb927) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:25.568316 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bc5ae-ac40-460b-b635-faa2f7d3e149 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:25.569819 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bc5ae-ac40-460b-b635-faa2f7d3e149 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:25.576518 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 11/20] 10.222.0.30 () {56 vars in 1322 bytes} [Tue Sep 6 22:37:25 2022] GET /identity/v3/role_assignments?user.id=8c7dd247a668409cb8ef9f1bcc9cb927&scope.domain.id=default&role.id=aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:37:25.602332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ac480-55f4-420e-99d9-e468643f8505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:25.602973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ac480-55f4-420e-99d9-e468643f8505 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:25.603250 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ac480-55f4-420e-99d9-e468643f8505 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:25.603526 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ac480-55f4-420e-99d9-e468643f8505 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:25.604193 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ac480-55f4-420e-99d9-e468643f8505 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:25.604530 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ac480-55f4-420e-99d9-e468643f8505 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:25.605960 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ac480-55f4-420e-99d9-e468643f8505 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:25.624689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 10/21] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:37:28.159085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517bf41-be60-437c-beb5-f87132b42d8c None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:28.160098 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517bf41-be60-437c-beb5-f87132b42d8c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:28.160623 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517bf41-be60-437c-beb5-f87132b42d8c None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:28.162467 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 12/22] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:28.168120 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71328d6d-0b5e-4dba-97a3-72b041d30da5 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:28.169037 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71328d6d-0b5e-4dba-97a3-72b041d30da5 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:28.169513 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71328d6d-0b5e-4dba-97a3-72b041d30da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:28.175379 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a658977-e12e-466c-9299-fd37da861b81 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:28.175916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a658977-e12e-466c-9299-fd37da861b81 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:28.176391 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a658977-e12e-466c-9299-fd37da861b81 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:28.178469 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 13/23] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:37:28.184417 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb18d31-678b-4456-81db-89ca2a8d571d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:28.184977 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb18d31-678b-4456-81db-89ca2a8d571d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:28.185450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb18d31-678b-4456-81db-89ca2a8d571d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:28.197522 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-71328d6d-0b5e-4dba-97a3-72b041d30da5 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:28.198743 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-71328d6d-0b5e-4dba-97a3-72b041d30da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:28.219020 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ecb18d31-678b-4456-81db-89ca2a8d571d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:28.220563 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ecb18d31-678b-4456-81db-89ca2a8d571d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:28.327842 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 11/24] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 22:37:28.374802 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 14/25] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 22:37:28.448461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ae3c5-25b7-4496-becd-e545db43a63f None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:28.449117 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ae3c5-25b7-4496-becd-e545db43a63f None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:28.449620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ae3c5-25b7-4496-becd-e545db43a63f None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:28.451167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 12/26] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:28.456501 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd3f1a-d7bc-4d5f-9113-cceb1785e43e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:28.456792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd3f1a-d7bc-4d5f-9113-cceb1785e43e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:28.457127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd3f1a-d7bc-4d5f-9113-cceb1785e43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:28.486134 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-54cd3f1a-d7bc-4d5f-9113-cceb1785e43e None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:28.487351 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-54cd3f1a-d7bc-4d5f-9113-cceb1785e43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:28.576894 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 15/27] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:28.620376 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a4fe3-8593-4d6f-9236-320ba59eece8 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:28.621072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a4fe3-8593-4d6f-9236-320ba59eece8 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:28.621554 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a4fe3-8593-4d6f-9236-320ba59eece8 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:28.623086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 13/28] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:37:28.628532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731785f4-1d96-4111-ac0a-8784d0169b32 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:28.628795 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731785f4-1d96-4111-ac0a-8784d0169b32 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:28.629045 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731785f4-1d96-4111-ac0a-8784d0169b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:28.640150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:28.653355 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-731785f4-1d96-4111-ac0a-8784d0169b32 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:28.654560 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-731785f4-1d96-4111-ac0a-8784d0169b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:28.758381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 16/29] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:28.798466 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a4fe3-8593-4d6f-9236-320ba59eece8 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:28.857315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:28.937658 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a4fe3-8593-4d6f-9236-320ba59eece8 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:28.950563 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731785f4-1d96-4111-ac0a-8784d0169b32 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:29.002514 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167e326-a2d7-4445-816d-62f0e30214c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:29.003547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167e326-a2d7-4445-816d-62f0e30214c8 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:29.004033 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167e326-a2d7-4445-816d-62f0e30214c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:29.004552 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167e326-a2d7-4445-816d-62f0e30214c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:29.031184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167e326-a2d7-4445-816d-62f0e30214c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:37:29.038596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-9167e326-a2d7-4445-816d-62f0e30214c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:37:29.038596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:29.038596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:29.038596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:29.038596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:29.038596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:29.038596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:29.038596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:29.038596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:29.038596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:29.038596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:29.038596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:29.038596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:37:29.038596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:37:29.038596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:37:29.038596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:37:29.039467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:37:29.039467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:37:29.039467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:37:29.039467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:37:29.039467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:29.039467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:29.039467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:29.039467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:29.039467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:29.039467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:29.039467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:29.039467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:29.039467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:29.039467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:29.039467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:29.039467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:29.040362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:29.040362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:29.040362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:29.040362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:29.040362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:37:29.040362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:37:29.040362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:37:29.040362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:37:29.040362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:37:29.040362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:37:29.040362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:37:29.040362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:37:29.050143 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 14/30] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:37:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:37:29.051125 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167e326-a2d7-4445-816d-62f0e30214c8 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:29.094941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731785f4-1d96-4111-ac0a-8784d0169b32 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:29.154025 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd0d25-5926-4589-b609-908d9d841ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:29.154934 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd0d25-5926-4589-b609-908d9d841ba9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:29.155369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd0d25-5926-4589-b609-908d9d841ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:29.155791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd0d25-5926-4589-b609-908d9d841ba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:29.162658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:29.186007 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd0d25-5926-4589-b609-908d9d841ba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:29.188288 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd0d25-5926-4589-b609-908d9d841ba9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:29.191397 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167e326-a2d7-4445-816d-62f0e30214c8 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:29.209511 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:29.220838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-33bd0d25-5926-4589-b609-908d9d841ba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:37:29.220838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:29.220838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:29.220838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:29.220838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:29.220838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:29.220838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:29.220838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:29.220838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:29.220838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:29.220838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:29.220838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:29.220838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:37:29.220838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:37:29.220838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:37:29.220838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:37:29.228828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:29.228828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:29.228828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:29.228828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:29.228828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:29.228828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:29.228828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:29.228828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:29.228828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:29.228828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:29.228828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:29.228828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:29.228828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:29.228828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:29.228828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:29.228828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:29.228828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:37:29.229634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:37:29.229634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:37:29.229634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:37:29.229634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 17/31] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:37:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:37:29.229634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd0d25-5926-4589-b609-908d9d841ba9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:29.252671 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a2f87-fc64-45ee-86bf-efcc3eb70ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:29.253289 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a2f87-fc64-45ee-86bf-efcc3eb70ebe None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:29.253889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a2f87-fc64-45ee-86bf-efcc3eb70ebe None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:29.254304 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a2f87-fc64-45ee-86bf-efcc3eb70ebe None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:29.256085 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a2f87-fc64-45ee-86bf-efcc3eb70ebe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:29.258163 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a2f87-fc64-45ee-86bf-efcc3eb70ebe None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:29.342938 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd0d25-5926-4589-b609-908d9d841ba9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:29.378812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda2f64-6460-4515-8f8e-0e9ce3114046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:29.379436 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda2f64-6460-4515-8f8e-0e9ce3114046 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:29.380255 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda2f64-6460-4515-8f8e-0e9ce3114046 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:29.380574 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda2f64-6460-4515-8f8e-0e9ce3114046 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:29.381253 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda2f64-6460-4515-8f8e-0e9ce3114046 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:29.381559 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda2f64-6460-4515-8f8e-0e9ce3114046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:29.383080 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda2f64-6460-4515-8f8e-0e9ce3114046 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:29.391946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 18/32] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:37:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:29.393041 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda2f64-6460-4515-8f8e-0e9ce3114046 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:29.471244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 15/33] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Sep 6 22:37:29 2022] POST /identity/v3/roles => generated 219 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:37:29.471853 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:29.472656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a2f87-fc64-45ee-86bf-efcc3eb70ebe None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:29.534476 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda2f64-6460-4515-8f8e-0e9ce3114046 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:29.623984 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a2f87-fc64-45ee-86bf-efcc3eb70ebe None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:29.625124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1943c-17a8-4a5e-886e-2a370e878c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:29.625767 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1943c-17a8-4a5e-886e-2a370e878c57 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:29.626053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1943c-17a8-4a5e-886e-2a370e878c57 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:29.626327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1943c-17a8-4a5e-886e-2a370e878c57 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:29.627027 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1943c-17a8-4a5e-886e-2a370e878c57 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:29.630451 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1943c-17a8-4a5e-886e-2a370e878c57 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:29.673946 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febfaa8-71a2-4173-a7a6-52462e39c52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:29.674906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febfaa8-71a2-4173-a7a6-52462e39c52b None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:29.675627 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febfaa8-71a2-4173-a7a6-52462e39c52b None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:29.676073 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febfaa8-71a2-4173-a7a6-52462e39c52b None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:29.677508 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febfaa8-71a2-4173-a7a6-52462e39c52b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:29.677991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febfaa8-71a2-4173-a7a6-52462e39c52b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:29.679726 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febfaa8-71a2-4173-a7a6-52462e39c52b None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:29.694176 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 16/34] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:29.695355 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febfaa8-71a2-4173-a7a6-52462e39c52b None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:29.734872 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:29.828142 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febfaa8-71a2-4173-a7a6-52462e39c52b None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:29.871466 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141defe-124b-42a8-bd2c-deb674094299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:29.872354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141defe-124b-42a8-bd2c-deb674094299 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:29.872828 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141defe-124b-42a8-bd2c-deb674094299 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:29.873290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141defe-124b-42a8-bd2c-deb674094299 None admin] PATH_INFO: `/v3/users/8c7dd247a668409cb8ef9f1bcc9cb927` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:29.875094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141defe-124b-42a8-bd2c-deb674094299 None admin] RBAC: Authorizing `identity:get_user(user_id=8c7dd247a668409cb8ef9f1bcc9cb927)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:29.876416 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 19/35] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Sep 6 22:37:29 2022] POST /identity/v3/roles => generated 225 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:37:29.876762 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141defe-124b-42a8-bd2c-deb674094299 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:29.877932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1943c-17a8-4a5e-886e-2a370e878c57 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:29.878376 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 17/36] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:37:29 2022] GET /identity/v3/users/8c7dd247a668409cb8ef9f1bcc9cb927 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:29.880629 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4a7b8-ec8e-47bf-8024-96806f322a6c None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:29.881195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4a7b8-ec8e-47bf-8024-96806f322a6c None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:29.881686 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4a7b8-ec8e-47bf-8024-96806f322a6c None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:29.884077 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 18/37] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:29.885650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4a7b8-ec8e-47bf-8024-96806f322a6c None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:30.022436 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:30.031355 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4a7b8-ec8e-47bf-8024-96806f322a6c None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:30.037303 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1943c-17a8-4a5e-886e-2a370e878c57 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:30.050335 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:30.074606 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2aaeb1-e3ef-4edc-ba1d-ce69d98c9f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:30.075258 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2aaeb1-e3ef-4edc-ba1d-ce69d98c9f19 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:30.076767 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2aaeb1-e3ef-4edc-ba1d-ce69d98c9f19 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:30.076767 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2aaeb1-e3ef-4edc-ba1d-ce69d98c9f19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:30.077366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2aaeb1-e3ef-4edc-ba1d-ce69d98c9f19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:30.078947 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2aaeb1-e3ef-4edc-ba1d-ce69d98c9f19 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:30.080696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 19/38] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:37:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:30.081155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75069078-bae8-4600-8f28-1247242b0886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:30.081794 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75069078-bae8-4600-8f28-1247242b0886 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:30.082078 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75069078-bae8-4600-8f28-1247242b0886 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:30.082352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75069078-bae8-4600-8f28-1247242b0886 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:30.082609 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391efe93-ddc5-4ce2-b48a-b14ec7076ffe None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:30.083046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75069078-bae8-4600-8f28-1247242b0886 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:30.083929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391efe93-ddc5-4ce2-b48a-b14ec7076ffe None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:30.084343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391efe93-ddc5-4ce2-b48a-b14ec7076ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:30.085298 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75069078-bae8-4600-8f28-1247242b0886 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:30.106971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-391efe93-ddc5-4ce2-b48a-b14ec7076ffe None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:30.108803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-391efe93-ddc5-4ce2-b48a-b14ec7076ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:30.179005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 20/39] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:30.180254 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8e8a5-41bd-49eb-9dca-62b57bbf335c None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:30.180575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8e8a5-41bd-49eb-9dca-62b57bbf335c None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:30.180850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8e8a5-41bd-49eb-9dca-62b57bbf335c None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:30.182096 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 21/40] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:30.182780 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8e8a5-41bd-49eb-9dca-62b57bbf335c None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:30.213646 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Sep 6 22:37:29 2022] POST /identity/v3/projects => generated 301 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:37:30.214986 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4ac63-2082-4277-ad29-3a3dd9c08bd3 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:30.215288 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4ac63-2082-4277-ad29-3a3dd9c08bd3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:30.215576 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4ac63-2082-4277-ad29-3a3dd9c08bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:30.246635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d5c4ac63-2082-4277-ad29-3a3dd9c08bd3 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:30.249337 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d5c4ac63-2082-4277-ad29-3a3dd9c08bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:30.306117 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:30.318488 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8e8a5-41bd-49eb-9dca-62b57bbf335c None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:30.351369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 21/42] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:30.366892 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20911e-e9e5-48aa-8980-ada625580fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:30.367642 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20911e-e9e5-48aa-8980-ada625580fde None admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:30.367925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20911e-e9e5-48aa-8980-ada625580fde None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:30.368301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20911e-e9e5-48aa-8980-ada625580fde None admin] PATH_INFO: `/v3/domains/default/users/8c7dd247a668409cb8ef9f1bcc9cb927/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:30.370607 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20911e-e9e5-48aa-8980-ada625580fde None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8c7dd247a668409cb8ef9f1bcc9cb927, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:30.372208 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20911e-e9e5-48aa-8980-ada625580fde None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:30.463499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4ac63-2082-4277-ad29-3a3dd9c08bd3 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:30.464196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 22/43] 10.222.0.30 () {58 vars in 1361 bytes} [Tue Sep 6 22:37:30 2022] PUT /identity/v3/domains/default/users/8c7dd247a668409cb8ef9f1bcc9cb927/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:37:30.564698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:30.576123 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4ac63-2082-4277-ad29-3a3dd9c08bd3 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:30.658429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20911e-e9e5-48aa-8980-ada625580fde None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:30.730150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bd857-d02f-4187-89e8-838026993dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:30.730772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bd857-d02f-4187-89e8-838026993dd1 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:30.731050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bd857-d02f-4187-89e8-838026993dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:30.731320 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bd857-d02f-4187-89e8-838026993dd1 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:30.732000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bd857-d02f-4187-89e8-838026993dd1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:30.733422 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bd857-d02f-4187-89e8-838026993dd1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:30.771930 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20911e-e9e5-48aa-8980-ada625580fde None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:30.783801 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 22/44] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Sep 6 22:37:30 2022] POST /identity/v3/roles => generated 223 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:37:30.810756 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a5c15-edfa-4515-b4f3-35bc6076582f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:30.811484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a5c15-edfa-4515-b4f3-35bc6076582f None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:30.811780 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a5c15-edfa-4515-b4f3-35bc6076582f None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:30.812048 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a5c15-edfa-4515-b4f3-35bc6076582f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:30.813598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a5c15-edfa-4515-b4f3-35bc6076582f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:30.823113 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a5c15-edfa-4515-b4f3-35bc6076582f None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:30.823113 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 23/45] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:37:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:30.823358 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bd857-d02f-4187-89e8-838026993dd1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:30.936866 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bd857-d02f-4187-89e8-838026993dd1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:30.975783 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50243dbf-ec79-4583-8410-d649e39a2d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:30.979723 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50243dbf-ec79-4583-8410-d649e39a2d37 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:30.979723 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50243dbf-ec79-4583-8410-d649e39a2d37 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:30.979723 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50243dbf-ec79-4583-8410-d649e39a2d37 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:30.979723 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50243dbf-ec79-4583-8410-d649e39a2d37 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:30.979723 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50243dbf-ec79-4583-8410-d649e39a2d37 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:31.075553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 23/46] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Sep 6 22:37:30 2022] POST /identity/v3/projects => generated 312 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:37:32.661248 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df19ffd-4864-4022-ac2b-53b21051f1c7 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:32.661764 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df19ffd-4864-4022-ac2b-53b21051f1c7 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:32.661872 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df19ffd-4864-4022-ac2b-53b21051f1c7 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:32.663184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 24/47] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:37:32.668558 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c8365-c18f-4981-9f5c-f126e488f27f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:32.668970 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c8365-c18f-4981-9f5c-f126e488f27f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:32.669110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c8365-c18f-4981-9f5c-f126e488f27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:32.675388 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:32.687329 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-510c8365-c18f-4981-9f5c-f126e488f27f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:32.688546 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-510c8365-c18f-4981-9f5c-f126e488f27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:32.755911 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 24/48] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:33.025864 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df19ffd-4864-4022-ac2b-53b21051f1c7 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:33.047819 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:33.132866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df19ffd-4864-4022-ac2b-53b21051f1c7 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:33.167351 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38782295-741e-4883-a934-bb8aec2d269a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:33.167985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38782295-741e-4883-a934-bb8aec2d269a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:33.168275 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38782295-741e-4883-a934-bb8aec2d269a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:33.168589 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38782295-741e-4883-a934-bb8aec2d269a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:33.178539 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38782295-741e-4883-a934-bb8aec2d269a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:37:33.183418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-38782295-741e-4883-a934-bb8aec2d269a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:37:33.183418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:33.183418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:33.183418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:33.183418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:33.183418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:33.183418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:33.183418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:33.183418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:33.183418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:33.183418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:33.183418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:33.183418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:37:33.183418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:37:33.183418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:37:33.183418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:37:33.184342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:37:33.184342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:37:33.184342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:37:33.184342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:37:33.184342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:33.184342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:33.184342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:33.184342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:33.184342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:33.184342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:33.184342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:33.184342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:33.184342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:33.184342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:33.184342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:33.184342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:33.185317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:33.185317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:33.185317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:33.185317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:33.185317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:37:33.185317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:37:33.185317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:37:33.185317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:37:33.185317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:37:33.185317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:37:33.185317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:37:33.185317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:37:33.185317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 25/49] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:37:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:37:33.190342 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c8365-c18f-4981-9f5c-f126e488f27f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:33.225924 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780afb49-ec13-4627-b8e4-48580d747e8d None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:33.226217 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780afb49-ec13-4627-b8e4-48580d747e8d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:33.226532 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780afb49-ec13-4627-b8e4-48580d747e8d None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:33.227886 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 26/50] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:37:33.232842 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5612f-8f12-430a-95d7-43f13180fbb7 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:33.233129 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5612f-8f12-430a-95d7-43f13180fbb7 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:33.233403 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5612f-8f12-430a-95d7-43f13180fbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:33.251146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-2cc5612f-8f12-430a-95d7-43f13180fbb7 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:33.252350 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-2cc5612f-8f12-430a-95d7-43f13180fbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:33.289720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c8365-c18f-4981-9f5c-f126e488f27f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:33.318120 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 27/51] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 22:37:33.321403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:33.326450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd224137-51c4-4415-a0fb-d1879eff8ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:33.327150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd224137-51c4-4415-a0fb-d1879eff8ef2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:33.327433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd224137-51c4-4415-a0fb-d1879eff8ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:33.327728 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd224137-51c4-4415-a0fb-d1879eff8ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:33.328491 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd224137-51c4-4415-a0fb-d1879eff8ef2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:33.328796 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd224137-51c4-4415-a0fb-d1879eff8ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:33.330183 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd224137-51c4-4415-a0fb-d1879eff8ef2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:33.338433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 25/52] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:37:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:33.344082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5612f-8f12-430a-95d7-43f13180fbb7 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:33.355785 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:33.440072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5612f-8f12-430a-95d7-43f13180fbb7 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:33.473567 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b716669-6e1d-414f-b1d2-e2179ca48b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:33.474193 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b716669-6e1d-414f-b1d2-e2179ca48b62 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:33.474476 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b716669-6e1d-414f-b1d2-e2179ca48b62 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:33.474752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b716669-6e1d-414f-b1d2-e2179ca48b62 None admin] PATH_INFO: `/v3/users/8c7dd247a668409cb8ef9f1bcc9cb927` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:33.475887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b716669-6e1d-414f-b1d2-e2179ca48b62 None admin] RBAC: Authorizing `identity:get_user(user_id=8c7dd247a668409cb8ef9f1bcc9cb927)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:33.477362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b716669-6e1d-414f-b1d2-e2179ca48b62 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:33.478924 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 28/53] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:37:33 2022] GET /identity/v3/users/8c7dd247a668409cb8ef9f1bcc9cb927 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:33.484278 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd224137-51c4-4415-a0fb-d1879eff8ef2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:33.582859 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd224137-51c4-4415-a0fb-d1879eff8ef2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:33.590124 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b716669-6e1d-414f-b1d2-e2179ca48b62 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:33.616299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2cee1-cd40-4d7c-b5ba-4c8b4fbca042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:33.616962 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2cee1-cd40-4d7c-b5ba-4c8b4fbca042 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:33.617240 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2cee1-cd40-4d7c-b5ba-4c8b4fbca042 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:33.617510 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2cee1-cd40-4d7c-b5ba-4c8b4fbca042 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:33.618631 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2cee1-cd40-4d7c-b5ba-4c8b4fbca042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:33.620082 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2cee1-cd40-4d7c-b5ba-4c8b4fbca042 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:33.621676 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 26/54] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:37:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:33.627401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2cee1-cd40-4d7c-b5ba-4c8b4fbca042 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:33.692439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:33.732882 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2cee1-cd40-4d7c-b5ba-4c8b4fbca042 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:33.766658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acffa69-c24b-4b42-9530-86363461be54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:33.767273 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acffa69-c24b-4b42-9530-86363461be54 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:33.767556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acffa69-c24b-4b42-9530-86363461be54 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:33.767834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acffa69-c24b-4b42-9530-86363461be54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:33.768598 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acffa69-c24b-4b42-9530-86363461be54 None admin] RBAC: Adding query filter params (role.id=aa2332d1bdb74e48a88ed7c2a7ed2990, scope.domain.id=default, user.id=8c7dd247a668409cb8ef9f1bcc9cb927) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:33.768909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acffa69-c24b-4b42-9530-86363461be54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:33.770437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acffa69-c24b-4b42-9530-86363461be54 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:33.770853 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:33.776316 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1322 bytes} [Tue Sep 6 22:37:33 2022] GET /identity/v3/role_assignments?user.id=8c7dd247a668409cb8ef9f1bcc9cb927&scope.domain.id=default&role.id=aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:37:33.792620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b716669-6e1d-414f-b1d2-e2179ca48b62 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:33.828825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d6a3e-cbe7-49b1-8a9b-a1cf434fb147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:33.829496 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d6a3e-cbe7-49b1-8a9b-a1cf434fb147 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:33.829779 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d6a3e-cbe7-49b1-8a9b-a1cf434fb147 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:33.830054 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d6a3e-cbe7-49b1-8a9b-a1cf434fb147 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:33.831251 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d6a3e-cbe7-49b1-8a9b-a1cf434fb147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:33.832793 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d6a3e-cbe7-49b1-8a9b-a1cf434fb147 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:33.834823 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 29/56] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:37:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:37:33.840657 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acffa69-c24b-4b42-9530-86363461be54 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:33.945679 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acffa69-c24b-4b42-9530-86363461be54 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:33.971187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:33.980794 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77684ecb-3823-4ac1-86b8-17c90653f2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:33.981419 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77684ecb-3823-4ac1-86b8-17c90653f2fe None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:33.981702 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77684ecb-3823-4ac1-86b8-17c90653f2fe None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:33.981979 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77684ecb-3823-4ac1-86b8-17c90653f2fe None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:33.982632 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77684ecb-3823-4ac1-86b8-17c90653f2fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:33.984112 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77684ecb-3823-4ac1-86b8-17c90653f2fe None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:34.080169 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 28/57] 10.222.0.30 () {60 vars in 1140 bytes} [Tue Sep 6 22:37:33 2022] POST /identity/v3/projects => generated 298 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:37:36.210198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5caaa-a1ab-4e6c-875f-f3802f8255b8 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:36.210711 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5caaa-a1ab-4e6c-875f-f3802f8255b8 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:36.210800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5caaa-a1ab-4e6c-875f-f3802f8255b8 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:36.212100 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 30/58] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:36.217222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba4ebc-1d98-4ead-876a-2a76211796ce None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:36.217606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba4ebc-1d98-4ead-876a-2a76211796ce None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:36.217784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba4ebc-1d98-4ead-876a-2a76211796ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:36.235769 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d9ba4ebc-1d98-4ead-876a-2a76211796ce None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:36.237007 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d9ba4ebc-1d98-4ead-876a-2a76211796ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:36.302076 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 29/59] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:36.567140 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5caaa-a1ab-4e6c-875f-f3802f8255b8 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:36.666428 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5caaa-a1ab-4e6c-875f-f3802f8255b8 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:36.699344 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0ca08-8066-4b34-aed1-c28be788f166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:36.699967 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0ca08-8066-4b34-aed1-c28be788f166 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:36.700250 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0ca08-8066-4b34-aed1-c28be788f166 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:36.700553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0ca08-8066-4b34-aed1-c28be788f166 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:36.701661 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0ca08-8066-4b34-aed1-c28be788f166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:36.703096 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0ca08-8066-4b34-aed1-c28be788f166 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:36.704695 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 31/60] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:37:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:36.710729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba4ebc-1d98-4ead-876a-2a76211796ce None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:36.807634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba4ebc-1d98-4ead-876a-2a76211796ce None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:36.816488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:36.845223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673910fe-90b3-4317-bc31-fbab036dec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:36.845223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673910fe-90b3-4317-bc31-fbab036dec84 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:36.845223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673910fe-90b3-4317-bc31-fbab036dec84 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:36.845223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673910fe-90b3-4317-bc31-fbab036dec84 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:36.845591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673910fe-90b3-4317-bc31-fbab036dec84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:36.845591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673910fe-90b3-4317-bc31-fbab036dec84 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:36.932842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 30/61] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Sep 6 22:37:36 2022] POST /identity/v3/users => generated 275 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:37:40.218881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31bd08-173f-4ab9-bb98-3251147734a5 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:40.219440 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31bd08-173f-4ab9-bb98-3251147734a5 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:40.219741 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31bd08-173f-4ab9-bb98-3251147734a5 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:40.221024 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 32/62] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:40.227032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41c449-a202-4fad-bef0-5ad369bf6d8d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:40.227835 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41c449-a202-4fad-bef0-5ad369bf6d8d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:40.228625 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41c449-a202-4fad-bef0-5ad369bf6d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:40.249441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3c41c449-a202-4fad-bef0-5ad369bf6d8d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:40.251109 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3c41c449-a202-4fad-bef0-5ad369bf6d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:40.346896 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 31/63] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:40.376314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39825310-8ea9-474f-ab41-d16ac800e031 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:40.376638 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39825310-8ea9-474f-ab41-d16ac800e031 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:40.376882 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39825310-8ea9-474f-ab41-d16ac800e031 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:40.378222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 33/64] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:40.383713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e9615-336b-41a5-925e-af4d556f2029 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:40.384240 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e9615-336b-41a5-925e-af4d556f2029 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:40.384750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e9615-336b-41a5-925e-af4d556f2029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:40.415077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a35e9615-336b-41a5-925e-af4d556f2029 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:40.416648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a35e9615-336b-41a5-925e-af4d556f2029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:40.446183 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c50439-70e1-4cde-acac-766182d63619 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:40.446492 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c50439-70e1-4cde-acac-766182d63619 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:40.446745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c50439-70e1-4cde-acac-766182d63619 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:40.448314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 34/65] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:40.453338 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e27a1-f683-4f7a-b2e4-839b14574567 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:40.453623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e27a1-f683-4f7a-b2e4-839b14574567 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:40.453902 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e27a1-f683-4f7a-b2e4-839b14574567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:40.472788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-566e27a1-f683-4f7a-b2e4-839b14574567 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:40.474025 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-566e27a1-f683-4f7a-b2e4-839b14574567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:40.492808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:40.538978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 32/66] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:40.593662 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 35/67] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:40.641476 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e9615-336b-41a5-925e-af4d556f2029 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:40.679921 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:40.800122 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e9615-336b-41a5-925e-af4d556f2029 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:40.849652 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd6f0c-5f91-4a02-8de5-ca48190a92fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:40.850323 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd6f0c-5f91-4a02-8de5-ca48190a92fd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:40.850607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd6f0c-5f91-4a02-8de5-ca48190a92fd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:40.850879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd6f0c-5f91-4a02-8de5-ca48190a92fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:40.865938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33181c5-48aa-453c-b22b-ff360c566e5e None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:40.866264 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33181c5-48aa-453c-b22b-ff360c566e5e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:40.866493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33181c5-48aa-453c-b22b-ff360c566e5e None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:40.867881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 36/68] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:37:40.873741 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43deb4-6813-45c3-bcee-bbbb35201753 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:40.874047 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43deb4-6813-45c3-bcee-bbbb35201753 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:40.874287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43deb4-6813-45c3-bcee-bbbb35201753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:40.885798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd6f0c-5f91-4a02-8de5-ca48190a92fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:37:40.890663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-00fd6f0c-5f91-4a02-8de5-ca48190a92fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:37:40.890663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:40.890663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:40.890663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:40.890663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:40.890663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:40.890663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:40.890663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:40.890663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:40.890663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:40.890663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:40.890663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:40.890663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:37:40.890663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:37:40.890663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:37:40.890663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:37:40.891569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:37:40.891569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:37:40.891569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:37:40.891569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:37:40.891569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:40.891569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:40.891569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:40.891569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:40.891569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:40.891569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:40.891569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:40.891569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:40.891569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:40.891569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:40.891569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:40.891569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:40.892352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:40.892352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:40.892352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:40.892352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:40.892352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:37:40.892352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:37:40.892352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:37:40.892352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:37:40.892352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:37:40.892352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:37:40.892352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:37:40.892352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:37:40.892352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 33/69] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:37:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:37:40.897750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd6f0c-5f91-4a02-8de5-ca48190a92fd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:40.906819 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-0d43deb4-6813-45c3-bcee-bbbb35201753 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:40.908009 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0d43deb4-6813-45c3-bcee-bbbb35201753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:40.987976 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 37/70] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 22:37:40.993055 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43deb4-6813-45c3-bcee-bbbb35201753 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:41.004923 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:41.022844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd6f0c-5f91-4a02-8de5-ca48190a92fd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:41.060828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88132296-39eb-4e45-a3b6-cdb458886b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:41.061562 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88132296-39eb-4e45-a3b6-cdb458886b2a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:41.061847 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88132296-39eb-4e45-a3b6-cdb458886b2a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:41.062230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88132296-39eb-4e45-a3b6-cdb458886b2a None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:41.062904 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88132296-39eb-4e45-a3b6-cdb458886b2a None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:41.063211 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88132296-39eb-4e45-a3b6-cdb458886b2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:41.065114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88132296-39eb-4e45-a3b6-cdb458886b2a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:41.067622 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:41.075370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 34/71] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:37:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:37:41.076218 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88132296-39eb-4e45-a3b6-cdb458886b2a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:41.098783 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43deb4-6813-45c3-bcee-bbbb35201753 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:41.137782 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ccd3d-304c-49db-af9c-c4a01280f033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:41.138673 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ccd3d-304c-49db-af9c-c4a01280f033 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:41.139143 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ccd3d-304c-49db-af9c-c4a01280f033 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:41.139423 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ccd3d-304c-49db-af9c-c4a01280f033 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:41.150656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ccd3d-304c-49db-af9c-c4a01280f033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:37:41.155445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-5f3ccd3d-304c-49db-af9c-c4a01280f033 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:37:41.155445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:41.155445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:41.155445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:41.155445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:41.155445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:41.155445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:41.155445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:41.155445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:41.155445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:41.155445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:41.155445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:41.155445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:37:41.155445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:37:41.155445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:37:41.155445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:37:41.156306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:37:41.156306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:37:41.156306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:37:41.156306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:37:41.156306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:41.156306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:41.156306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:41.156306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:41.156306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:41.156306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:41.156306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:41.156306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:41.156306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:41.156306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:41.156306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:41.156306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:41.157138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:41.157138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:41.157138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:41.157138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:41.157138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:37:41.157138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:37:41.157138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:37:41.157138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:37:41.157138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:37:41.157138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:37:41.157138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:37:41.157138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:37:41.157138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 38/72] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:37:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:37:41.158939 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ece93-a995-43ce-aa94-72f1e92f62f5 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:41.159126 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ece93-a995-43ce-aa94-72f1e92f62f5 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:41.159360 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ece93-a995-43ce-aa94-72f1e92f62f5 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:41.161229 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 39/73] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:41.164504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ece93-a995-43ce-aa94-72f1e92f62f5 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:41.191840 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88132296-39eb-4e45-a3b6-cdb458886b2a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:41.228068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e4ef7-a676-4b0a-a802-b5f9efe55ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:41.228728 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e4ef7-a676-4b0a-a802-b5f9efe55ed8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:41.229003 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e4ef7-a676-4b0a-a802-b5f9efe55ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:41.229302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e4ef7-a676-4b0a-a802-b5f9efe55ed8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:41.240876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e4ef7-a676-4b0a-a802-b5f9efe55ed8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:37:41.246415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-3a2e4ef7-a676-4b0a-a802-b5f9efe55ed8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:37:41.246415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:41.246415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:41.246415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:41.246415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:41.246415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:41.246415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:41.246415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:41.246415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:41.246415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:41.246415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:41.246415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:41.246415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:37:41.246415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:37:41.246415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:37:41.246415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:37:41.247283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:37:41.247283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:37:41.247283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:37:41.247283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:37:41.247283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:41.247283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:41.247283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:41.247283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:41.247283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:41.247283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:41.247283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:41.247283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:41.247283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:41.247283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:41.247283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:41.247283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:41.248073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:41.248073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:41.248073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:41.248073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:41.248073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:37:41.248073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:37:41.248073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:37:41.248073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:37:41.248073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:37:41.248073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:37:41.248073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:37:41.248073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:37:41.248073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 35/74] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:37:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:37:41.248073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e4ef7-a676-4b0a-a802-b5f9efe55ed8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:41.257616 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:41.270734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ece93-a995-43ce-aa94-72f1e92f62f5 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:41.305014 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058f538-0946-4b2a-ba41-2ec777df8b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:41.305643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058f538-0946-4b2a-ba41-2ec777df8b71 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:41.305921 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058f538-0946-4b2a-ba41-2ec777df8b71 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:41.306193 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058f538-0946-4b2a-ba41-2ec777df8b71 None admin] PATH_INFO: `/v3/users/5bdeea17b84e4c4e841735f505cd12e5` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:41.308173 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:41.320917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058f538-0946-4b2a-ba41-2ec777df8b71 None admin] RBAC: Authorizing `identity:get_user(user_id=5bdeea17b84e4c4e841735f505cd12e5)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:41.322410 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058f538-0946-4b2a-ba41-2ec777df8b71 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:41.324186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 40/75] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:37:41 2022] GET /identity/v3/users/5bdeea17b84e4c4e841735f505cd12e5 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:41.325310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad4a53-288e-4035-a9a6-33b701888ea4 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:41.325594 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad4a53-288e-4035-a9a6-33b701888ea4 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:41.325864 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad4a53-288e-4035-a9a6-33b701888ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:41.346175 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-3bad4a53-288e-4035-a9a6-33b701888ea4 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:41.347888 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3bad4a53-288e-4035-a9a6-33b701888ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:41.352352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e4ef7-a676-4b0a-a802-b5f9efe55ed8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:41.385399 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d20a5-724e-4376-992a-9dd5bc385917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:41.386021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d20a5-724e-4376-992a-9dd5bc385917 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:41.386305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d20a5-724e-4376-992a-9dd5bc385917 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:41.386583 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d20a5-724e-4376-992a-9dd5bc385917 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:41.387251 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d20a5-724e-4376-992a-9dd5bc385917 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:41.387555 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d20a5-724e-4376-992a-9dd5bc385917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:41.388992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d20a5-724e-4376-992a-9dd5bc385917 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:41.396871 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 36/76] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:37:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:41.399443 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d20a5-724e-4376-992a-9dd5bc385917 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:41.415313 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 41/77] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:41.416080 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad4a53-288e-4035-a9a6-33b701888ea4 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:41.469307 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:41.503693 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d20a5-724e-4376-992a-9dd5bc385917 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:41.522498 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad4a53-288e-4035-a9a6-33b701888ea4 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:41.541885 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25700b38-7261-4a6b-a581-a6df0f94b220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:41.542498 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25700b38-7261-4a6b-a581-a6df0f94b220 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:41.542777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25700b38-7261-4a6b-a581-a6df0f94b220 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:41.543054 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25700b38-7261-4a6b-a581-a6df0f94b220 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:41.543712 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25700b38-7261-4a6b-a581-a6df0f94b220 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:41.544012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25700b38-7261-4a6b-a581-a6df0f94b220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:41.545486 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25700b38-7261-4a6b-a581-a6df0f94b220 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:41.546023 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:41.558940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 37/78] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:37:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:41.558940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25700b38-7261-4a6b-a581-a6df0f94b220 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:41.562596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10353a80-3549-4711-b9d5-099f7f140537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:41.563255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10353a80-3549-4711-b9d5-099f7f140537 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:41.563534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10353a80-3549-4711-b9d5-099f7f140537 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:41.563804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10353a80-3549-4711-b9d5-099f7f140537 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:41.574855 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10353a80-3549-4711-b9d5-099f7f140537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:37:41.579709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-10353a80-3549-4711-b9d5-099f7f140537 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:37:41.579709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:41.579709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:41.579709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:41.579709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:41.579709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:41.579709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:41.579709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:41.579709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:41.579709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:41.579709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:41.579709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:41.579709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:37:41.579709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:37:41.579709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:37:41.579709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:37:41.580620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:37:41.580620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:37:41.580620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:37:41.580620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:37:41.580620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:41.580620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:41.580620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:41.580620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:41.580620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:41.580620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:41.580620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:41.580620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:41.580620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:41.580620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:41.580620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:41.580620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:41.581406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:41.581406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:41.581406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:41.581406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:41.581406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:37:41.581406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:37:41.581406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:37:41.581406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:37:41.581406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:37:41.581406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:37:41.581406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:37:41.581406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:37:41.581406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 42/79] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:37:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:37:41.583744 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10353a80-3549-4711-b9d5-099f7f140537 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:41.666329 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25700b38-7261-4a6b-a581-a6df0f94b220 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:41.686676 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10353a80-3549-4711-b9d5-099f7f140537 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:41.694768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:41.700542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429f0c8-d960-4763-9231-3b4bb20003fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:41.701166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429f0c8-d960-4763-9231-3b4bb20003fd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:41.701450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429f0c8-d960-4763-9231-3b4bb20003fd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:41.701727 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429f0c8-d960-4763-9231-3b4bb20003fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:41.720445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e80010-079e-40df-8e2c-6a13524cd47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:41.721086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e80010-079e-40df-8e2c-6a13524cd47f None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:41.721364 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e80010-079e-40df-8e2c-6a13524cd47f None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:41.721637 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e80010-079e-40df-8e2c-6a13524cd47f None admin] PATH_INFO: `/v3/users/5bdeea17b84e4c4e841735f505cd12e5` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:41.723413 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e80010-079e-40df-8e2c-6a13524cd47f None admin] RBAC: Authorizing `identity:get_user(user_id=5bdeea17b84e4c4e841735f505cd12e5)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:41.724891 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e80010-079e-40df-8e2c-6a13524cd47f None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:41.726456 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 43/80] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:37:41 2022] GET /identity/v3/users/5bdeea17b84e4c4e841735f505cd12e5 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:41.727203 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e80010-079e-40df-8e2c-6a13524cd47f None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:41.768912 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429f0c8-d960-4763-9231-3b4bb20003fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:41.770920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429f0c8-d960-4763-9231-3b4bb20003fd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:41.777125 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:41.827445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e80010-079e-40df-8e2c-6a13524cd47f None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:41.862162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbdc28-e5ea-465d-8876-587ee59c98b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:41.862794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbdc28-e5ea-465d-8876-587ee59c98b4 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:41.863088 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbdc28-e5ea-465d-8876-587ee59c98b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:41.863370 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbdc28-e5ea-465d-8876-587ee59c98b4 None admin] PATH_INFO: `/v3/users/8c7dd247a668409cb8ef9f1bcc9cb927` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:41.864543 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbdc28-e5ea-465d-8876-587ee59c98b4 None admin] RBAC: Authorizing `identity:get_user(user_id=8c7dd247a668409cb8ef9f1bcc9cb927)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:41.865980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbdc28-e5ea-465d-8876-587ee59c98b4 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:41.867927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 44/82] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:37:41 2022] GET /identity/v3/users/8c7dd247a668409cb8ef9f1bcc9cb927 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:41.868031 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 38/82] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:37:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:37:41.868494 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbdc28-e5ea-465d-8876-587ee59c98b4 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:41.869521 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429f0c8-d960-4763-9231-3b4bb20003fd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:41.901067 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:41.971152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429f0c8-d960-4763-9231-3b4bb20003fd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:41.972679 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbdc28-e5ea-465d-8876-587ee59c98b4 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:41.989123 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:42.004300 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d3b91-29a1-437a-ba77-3133dabedd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:42.004961 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d3b91-29a1-437a-ba77-3133dabedd21 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:42.005243 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d3b91-29a1-437a-ba77-3133dabedd21 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:42.005517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d3b91-29a1-437a-ba77-3133dabedd21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:42.006184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8e250-523a-4f08-aae4-5f272ca3b78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:42.006627 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d3b91-29a1-437a-ba77-3133dabedd21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:42.006797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8e250-523a-4f08-aae4-5f272ca3b78c None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:42.007087 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8e250-523a-4f08-aae4-5f272ca3b78c None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:42.007368 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8e250-523a-4f08-aae4-5f272ca3b78c None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:42.008038 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8e250-523a-4f08-aae4-5f272ca3b78c None admin] RBAC: Adding query filter params (name=member) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:42.008144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d3b91-29a1-437a-ba77-3133dabedd21 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:42.008349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8e250-523a-4f08-aae4-5f272ca3b78c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:42.009850 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 39/83] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:37:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:42.009963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8e250-523a-4f08-aae4-5f272ca3b78c None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:42.010433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d3b91-29a1-437a-ba77-3133dabedd21 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:42.023092 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 45/84] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:37:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:42.024290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8e250-523a-4f08-aae4-5f272ca3b78c None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:42.110114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:42.114121 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d3b91-29a1-437a-ba77-3133dabedd21 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:42.123165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8e250-523a-4f08-aae4-5f272ca3b78c None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:42.149439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48005ca-d1b3-462c-8263-2a86cca5ea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:42.150058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48005ca-d1b3-462c-8263-2a86cca5ea12 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:42.150337 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48005ca-d1b3-462c-8263-2a86cca5ea12 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:42.150616 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48005ca-d1b3-462c-8263-2a86cca5ea12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:42.157054 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02451382-eb38-47ae-9e92-9529e4acb77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:42.157667 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02451382-eb38-47ae-9e92-9529e4acb77d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:42.157947 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02451382-eb38-47ae-9e92-9529e4acb77d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:42.158217 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02451382-eb38-47ae-9e92-9529e4acb77d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:42.204013 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:42.218416 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48005ca-d1b3-462c-8263-2a86cca5ea12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:42.220343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48005ca-d1b3-462c-8263-2a86cca5ea12 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:42.223666 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02451382-eb38-47ae-9e92-9529e4acb77d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:42.225100 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02451382-eb38-47ae-9e92-9529e4acb77d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:42.314048 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:42.319183 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 40/85] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:37:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:37:42.319978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48005ca-d1b3-462c-8263-2a86cca5ea12 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:42.327611 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 46/86] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:37:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:37:42.328571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02451382-eb38-47ae-9e92-9529e4acb77d None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:42.410993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:42.424010 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48005ca-d1b3-462c-8263-2a86cca5ea12 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:42.430357 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02451382-eb38-47ae-9e92-9529e4acb77d None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:42.458275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df55413-632f-4d29-99e5-9e7849da9e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:42.458901 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df55413-632f-4d29-99e5-9e7849da9e80 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:42.459179 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df55413-632f-4d29-99e5-9e7849da9e80 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:42.459451 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df55413-632f-4d29-99e5-9e7849da9e80 None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:42.460605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df55413-632f-4d29-99e5-9e7849da9e80 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad919f473ed42dba141f5a8838458b9)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:42.462064 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df55413-632f-4d29-99e5-9e7849da9e80 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:42.463704 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 41/87] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:37:42 2022] GET /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:42.464478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df55413-632f-4d29-99e5-9e7849da9e80 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:42.465492 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108fc5d-c5ce-46d0-b0d6-2b28369ab279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:42.466111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108fc5d-c5ce-46d0-b0d6-2b28369ab279 None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:42.466395 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108fc5d-c5ce-46d0-b0d6-2b28369ab279 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:42.466813 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108fc5d-c5ce-46d0-b0d6-2b28369ab279 None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:42.468224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108fc5d-c5ce-46d0-b0d6-2b28369ab279 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:42.469728 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108fc5d-c5ce-46d0-b0d6-2b28369ab279 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:42.527228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:42.559500 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df55413-632f-4d29-99e5-9e7849da9e80 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:42.586878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 47/88] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Sep 6 22:37:42 2022] POST /identity/v3/users => generated 289 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:37:42.593034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052adf48-b360-4336-939b-9b3a1a694618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:42.594153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052adf48-b360-4336-939b-9b3a1a694618 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:42.594435 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052adf48-b360-4336-939b-9b3a1a694618 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:42.594713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052adf48-b360-4336-939b-9b3a1a694618 None admin] PATH_INFO: `/v3/users/5bdeea17b84e4c4e841735f505cd12e5` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:42.595939 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052adf48-b360-4336-939b-9b3a1a694618 None admin] RBAC: Authorizing `identity:get_user(user_id=5bdeea17b84e4c4e841735f505cd12e5)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:42.597474 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052adf48-b360-4336-939b-9b3a1a694618 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:42.598694 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108fc5d-c5ce-46d0-b0d6-2b28369ab279 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:42.599148 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 42/89] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:37:42 2022] GET /identity/v3/users/5bdeea17b84e4c4e841735f505cd12e5 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:42.599985 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052adf48-b360-4336-939b-9b3a1a694618 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:42.727013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052adf48-b360-4336-939b-9b3a1a694618 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:42.730095 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108fc5d-c5ce-46d0-b0d6-2b28369ab279 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:42.766906 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe5004-5424-4451-b9bc-205eac6127d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:42.767568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe5004-5424-4451-b9bc-205eac6127d6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:42.767832 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe5004-5424-4451-b9bc-205eac6127d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:42.768159 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe5004-5424-4451-b9bc-205eac6127d6 None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:42.769359 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe5004-5424-4451-b9bc-205eac6127d6 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad919f473ed42dba141f5a8838458b9)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:42.772343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe5004-5424-4451-b9bc-205eac6127d6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:42.774113 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660b4ad-f817-4b93-97a5-1c4384a6ca30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:42.774927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660b4ad-f817-4b93-97a5-1c4384a6ca30 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:42.775374 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660b4ad-f817-4b93-97a5-1c4384a6ca30 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:42.775994 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660b4ad-f817-4b93-97a5-1c4384a6ca30 None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:42.776639 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 43/90] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:37:42 2022] GET /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:42.777319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe5004-5424-4451-b9bc-205eac6127d6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:42.778204 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660b4ad-f817-4b93-97a5-1c4384a6ca30 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad919f473ed42dba141f5a8838458b9)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:42.780256 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:42.781288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660b4ad-f817-4b93-97a5-1c4384a6ca30 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:42.784257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 48/91] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:37:42 2022] GET /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:42.789296 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660b4ad-f817-4b93-97a5-1c4384a6ca30 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:42.794386 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:42.900059 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe5004-5424-4451-b9bc-205eac6127d6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:42.911221 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660b4ad-f817-4b93-97a5-1c4384a6ca30 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:42.938677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9d87d-83e8-4495-9c0a-b96116251493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:42.939295 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9d87d-83e8-4495-9c0a-b96116251493 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:42.939581 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9d87d-83e8-4495-9c0a-b96116251493 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:42.939850 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9d87d-83e8-4495-9c0a-b96116251493 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:42.940781 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9d87d-83e8-4495-9c0a-b96116251493 None admin] RBAC: Adding query filter params (role.id=093c83b316db4d0f9dc55ec6e3583ba8, scope.project.id=2ad919f473ed42dba141f5a8838458b9, user.id=5bdeea17b84e4c4e841735f505cd12e5) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:42.941143 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9d87d-83e8-4495-9c0a-b96116251493 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:42.942594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9d87d-83e8-4495-9c0a-b96116251493 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:42.950045 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 44/92] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:37:42 2022] GET /identity/v3/role_assignments?user.id=5bdeea17b84e4c4e841735f505cd12e5&scope.project.id=2ad919f473ed42dba141f5a8838458b9&role.id=093c83b316db4d0f9dc55ec6e3583ba8 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:42.950976 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47655ee6-7e13-406d-83f8-af83cff1e3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:42.951691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9d87d-83e8-4495-9c0a-b96116251493 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:42.951924 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655ee6-7e13-406d-83f8-af83cff1e3ad None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:42.952340 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655ee6-7e13-406d-83f8-af83cff1e3ad None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:42.952794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655ee6-7e13-406d-83f8-af83cff1e3ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:43.069254 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47655ee6-7e13-406d-83f8-af83cff1e3ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:43.071046 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47655ee6-7e13-406d-83f8-af83cff1e3ad None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:43.074312 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:43.157036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:43.187770 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 49/93] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:37:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:37:43.188871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47655ee6-7e13-406d-83f8-af83cff1e3ad None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:43.198266 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9d87d-83e8-4495-9c0a-b96116251493 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:43.235730 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef3f77-c1a2-46b2-9d3b-c95147c2eee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:43.236720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef3f77-c1a2-46b2-9d3b-c95147c2eee6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:43.236924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef3f77-c1a2-46b2-9d3b-c95147c2eee6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:43.237299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef3f77-c1a2-46b2-9d3b-c95147c2eee6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:43.238673 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef3f77-c1a2-46b2-9d3b-c95147c2eee6 None admin] RBAC: Adding query filter params (role.id=aa2332d1bdb74e48a88ed7c2a7ed2990, scope.project.id=2ad919f473ed42dba141f5a8838458b9, user.id=8c7dd247a668409cb8ef9f1bcc9cb927) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:43.239282 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef3f77-c1a2-46b2-9d3b-c95147c2eee6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:43.241293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef3f77-c1a2-46b2-9d3b-c95147c2eee6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:43.249462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 45/94] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:37:42 2022] GET /identity/v3/role_assignments?user.id=8c7dd247a668409cb8ef9f1bcc9cb927&scope.project.id=2ad919f473ed42dba141f5a8838458b9&role.id=aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:43.250474 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef3f77-c1a2-46b2-9d3b-c95147c2eee6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:43.304616 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47655ee6-7e13-406d-83f8-af83cff1e3ad None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:43.307733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:43.392731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef3f77-c1a2-46b2-9d3b-c95147c2eee6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:43.399467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283631a7-1857-49fa-95f5-9667f858315e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:43.400107 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283631a7-1857-49fa-95f5-9667f858315e None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:43.400390 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283631a7-1857-49fa-95f5-9667f858315e None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:43.400688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283631a7-1857-49fa-95f5-9667f858315e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:43.401429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283631a7-1857-49fa-95f5-9667f858315e None admin] RBAC: Adding query filter params (role.id=01a26dc2b1034e33af13752c154d24f4, scope.project.id=2ad919f473ed42dba141f5a8838458b9, user.id=5bdeea17b84e4c4e841735f505cd12e5) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:43.401739 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283631a7-1857-49fa-95f5-9667f858315e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:43.403269 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283631a7-1857-49fa-95f5-9667f858315e None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:43.430527 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6359b-b729-411a-bc83-4e1da0c1f753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:43.431190 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6359b-b729-411a-bc83-4e1da0c1f753 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:43.431482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6359b-b729-411a-bc83-4e1da0c1f753 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:43.431761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6359b-b729-411a-bc83-4e1da0c1f753 None admin] PATH_INFO: `/v3/projects/69881c0aa4374f1bb110e20848ec9e0b` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:43.432950 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6359b-b729-411a-bc83-4e1da0c1f753 None admin] RBAC: Authorizing `identity:get_project(project_id=69881c0aa4374f1bb110e20848ec9e0b)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:43.433947 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 50/95] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:37:43 2022] GET /identity/v3/role_assignments?user.id=5bdeea17b84e4c4e841735f505cd12e5&scope.project.id=2ad919f473ed42dba141f5a8838458b9&role.id=01a26dc2b1034e33af13752c154d24f4 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:43.434823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6359b-b729-411a-bc83-4e1da0c1f753 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:43.437017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 46/96] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:37:43 2022] GET /identity/v3/projects/69881c0aa4374f1bb110e20848ec9e0b => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:43.437522 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:43.446955 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283631a7-1857-49fa-95f5-9667f858315e None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:43.608590 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283631a7-1857-49fa-95f5-9667f858315e None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:43.660198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ff7b3-0fc5-4350-8a97-27bbb955d757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:43.660808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ff7b3-0fc5-4350-8a97-27bbb955d757 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:43.661088 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ff7b3-0fc5-4350-8a97-27bbb955d757 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:43.661363 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ff7b3-0fc5-4350-8a97-27bbb955d757 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:43.662107 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ff7b3-0fc5-4350-8a97-27bbb955d757 None admin] RBAC: Adding query filter params (role.id=093c83b316db4d0f9dc55ec6e3583ba8, scope.project.id=69881c0aa4374f1bb110e20848ec9e0b, user.id=5bdeea17b84e4c4e841735f505cd12e5) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:43.662413 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ff7b3-0fc5-4350-8a97-27bbb955d757 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:43.663904 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ff7b3-0fc5-4350-8a97-27bbb955d757 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:43.673093 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 51/97] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:37:43 2022] GET /identity/v3/role_assignments?user.id=5bdeea17b84e4c4e841735f505cd12e5&scope.project.id=69881c0aa4374f1bb110e20848ec9e0b&role.id=093c83b316db4d0f9dc55ec6e3583ba8 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:45.690198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae524a-162d-4608-b49d-66bb8e396b52 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:45.691243 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae524a-162d-4608-b49d-66bb8e396b52 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:45.691742 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae524a-162d-4608-b49d-66bb8e396b52 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:45.693345 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 47/98] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:45.698829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ff686-d6e4-4229-8c22-ad0cbaddd066 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:45.699656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ff686-d6e4-4229-8c22-ad0cbaddd066 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:45.700223 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ff686-d6e4-4229-8c22-ad0cbaddd066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:45.728564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-7a8ff686-d6e4-4229-8c22-ad0cbaddd066 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:45.730129 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7a8ff686-d6e4-4229-8c22-ad0cbaddd066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:45.758552 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:45.772058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07d01-48f0-46c0-992f-640d2564d247 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:45.780825 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07d01-48f0-46c0-992f-640d2564d247 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:45.780825 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07d01-48f0-46c0-992f-640d2564d247 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:45.780825 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 48/99] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:45.780825 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddb045-df4e-44eb-91a0-5545395da1a8 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:45.780825 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddb045-df4e-44eb-91a0-5545395da1a8 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:45.780825 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddb045-df4e-44eb-91a0-5545395da1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:45.805907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-adddb045-df4e-44eb-91a0-5545395da1a8 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:45.808129 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-adddb045-df4e-44eb-91a0-5545395da1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:45.813308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 52/100] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:45.901009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 49/101] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:46.234547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb68c0-4c24-4d98-a44d-76ac7d96c8c2 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:46.234831 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb68c0-4c24-4d98-a44d-76ac7d96c8c2 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:46.235260 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb68c0-4c24-4d98-a44d-76ac7d96c8c2 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:46.237049 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 53/102] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:46.242163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fde908-d7a8-4062-8987-582f9bfb77a6 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:46.242609 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fde908-d7a8-4062-8987-582f9bfb77a6 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:46.242987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fde908-d7a8-4062-8987-582f9bfb77a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:46.270015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b8fde908-d7a8-4062-8987-582f9bfb77a6 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:46.271263 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b8fde908-d7a8-4062-8987-582f9bfb77a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:46.300284 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb68c0-4c24-4d98-a44d-76ac7d96c8c2 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:46.380185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 50/103] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:46.380917 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fde908-d7a8-4062-8987-582f9bfb77a6 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:46.466755 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb68c0-4c24-4d98-a44d-76ac7d96c8c2 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:46.531834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:46.533135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423b625-3b21-4ca9-8359-f44901f47ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:46.533789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b625-3b21-4ca9-8359-f44901f47ea9 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:46.534071 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b625-3b21-4ca9-8359-f44901f47ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:46.534340 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b625-3b21-4ca9-8359-f44901f47ea9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:46.541105 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423b625-3b21-4ca9-8359-f44901f47ea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:46.542575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423b625-3b21-4ca9-8359-f44901f47ea9 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:46.544342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 54/104] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:37:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:46.550725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b648404-fe2c-4994-846a-81d7123b14bf None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:46.551192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b648404-fe2c-4994-846a-81d7123b14bf None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:46.551603 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b648404-fe2c-4994-846a-81d7123b14bf None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:46.558981 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 55/105] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:46.558981 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b648404-fe2c-4994-846a-81d7123b14bf None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:46.589495 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:46.613186 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fde908-d7a8-4062-8987-582f9bfb77a6 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:46.680271 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167d070-e10c-4f5e-a70a-e6057fbd556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:46.680871 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167d070-e10c-4f5e-a70a-e6057fbd556f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:46.681148 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167d070-e10c-4f5e-a70a-e6057fbd556f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:46.681419 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167d070-e10c-4f5e-a70a-e6057fbd556f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:46.707070 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167d070-e10c-4f5e-a70a-e6057fbd556f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:37:46.712276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-5167d070-e10c-4f5e-a70a-e6057fbd556f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:37:46.712276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:46.712276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:46.712276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:46.712276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:46.712276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:46.712276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:46.712276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:46.712276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:46.712276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:46.712276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:46.712276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:46.712276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:37:46.712276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:37:46.712276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:37:46.712276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:37:46.713306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:37:46.713306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:37:46.713306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:37:46.713306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:37:46.713306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:46.713306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:46.713306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:46.713306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:46.713306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:46.713306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:46.713306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:46.713306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:46.713306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:46.713306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:46.713306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:46.713306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:46.714088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:46.714088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:46.714088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:46.714088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:46.714088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:37:46.714088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:37:46.714088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:37:46.714088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:37:46.714088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:37:46.714088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:37:46.714088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:37:46.714088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:37:46.714088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 51/106] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:37:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:37:46.714737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a78af-2940-41b5-8219-241af74e2f92 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:46.715577 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a78af-2940-41b5-8219-241af74e2f92 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:46.715577 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a78af-2940-41b5-8219-241af74e2f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:46.730605 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b648404-fe2c-4994-846a-81d7123b14bf None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:46.755151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b17a78af-2940-41b5-8219-241af74e2f92 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:46.756938 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b17a78af-2940-41b5-8219-241af74e2f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:46.768689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3863c4-0a8c-4ea0-b788-5c91b80f8e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:46.770252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3863c4-0a8c-4ea0-b788-5c91b80f8e25 None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:46.770836 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3863c4-0a8c-4ea0-b788-5c91b80f8e25 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:46.771355 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3863c4-0a8c-4ea0-b788-5c91b80f8e25 None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:46.772171 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3863c4-0a8c-4ea0-b788-5c91b80f8e25 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:46.774320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3863c4-0a8c-4ea0-b788-5c91b80f8e25 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:46.832008 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 52/107] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:46.833190 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a78af-2940-41b5-8219-241af74e2f92 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:46.883342 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:46.899543 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 56/108] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Sep 6 22:37:46 2022] POST /identity/v3/projects => generated 302 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:37:46.900915 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3863c4-0a8c-4ea0-b788-5c91b80f8e25 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:46.948854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a78af-2940-41b5-8219-241af74e2f92 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:46.993879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ce23c-29d3-4d12-a19d-e46e435914a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:46.994881 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ce23c-29d3-4d12-a19d-e46e435914a0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:46.995374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ce23c-29d3-4d12-a19d-e46e435914a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:46.995809 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ce23c-29d3-4d12-a19d-e46e435914a0 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:46.996683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ce23c-29d3-4d12-a19d-e46e435914a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:46.997124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ce23c-29d3-4d12-a19d-e46e435914a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:46.998972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ce23c-29d3-4d12-a19d-e46e435914a0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:47.010285 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 53/109] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:37:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:47.011862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c91ca8-0b35-40a8-8e93-bf6503140751 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:47.012268 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c91ca8-0b35-40a8-8e93-bf6503140751 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:47.012684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c91ca8-0b35-40a8-8e93-bf6503140751 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:47.014299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 54/110] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:47.024339 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c91ca8-0b35-40a8-8e93-bf6503140751 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:47.044906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:47.071779 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3863c4-0a8c-4ea0-b788-5c91b80f8e25 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:47.116992 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555ec61-7d58-4e4a-92a8-1012eab1c586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:47.117655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555ec61-7d58-4e4a-92a8-1012eab1c586 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:47.117944 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555ec61-7d58-4e4a-92a8-1012eab1c586 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:47.118220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555ec61-7d58-4e4a-92a8-1012eab1c586 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:47.130730 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555ec61-7d58-4e4a-92a8-1012eab1c586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:37:47.136504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-6555ec61-7d58-4e4a-92a8-1012eab1c586 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 22:37:47.136504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:47.136504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:47.136504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:47.136504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:47.136504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:47.136504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:47.136504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:47.136504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:47.136504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:47.136504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:47.136504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:47.136504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:37:47.136504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:37:47.136504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:37:47.136504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:37:47.137547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:37:47.137547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:37:47.137547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:37:47.137547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:37:47.137547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:47.137547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:47.137547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:47.137547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:47.137547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:47.137547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:47.137547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:47.137547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:47.137547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:47.137547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:47.137547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:47.137547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:47.138517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:47.138517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:47.138517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:47.138517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:47.138517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:37:47.138517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:37:47.138517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:37:47.138517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:37:47.138517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:37:47.138517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:37:47.138517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 22:37:47.138517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:37:47.141129 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 57/111] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:37:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:37:47.142709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8629ef3-6eec-484b-946b-d8cffeb40398 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:47.142990 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8629ef3-6eec-484b-946b-d8cffeb40398 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:47.143833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8629ef3-6eec-484b-946b-d8cffeb40398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:47.163208 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-f8629ef3-6eec-484b-946b-d8cffeb40398 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:47.164447 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f8629ef3-6eec-484b-946b-d8cffeb40398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:47.182740 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c91ca8-0b35-40a8-8e93-bf6503140751 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:47.196328 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:47.224279 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901f5ae-fe45-45ec-a92c-5d4637fab060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:47.224871 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901f5ae-fe45-45ec-a92c-5d4637fab060 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:47.225153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901f5ae-fe45-45ec-a92c-5d4637fab060 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:47.225451 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901f5ae-fe45-45ec-a92c-5d4637fab060 None admin] PATH_INFO: `/v3/users/5bdeea17b84e4c4e841735f505cd12e5` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:47.227174 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901f5ae-fe45-45ec-a92c-5d4637fab060 None admin] RBAC: Authorizing `identity:get_user(user_id=5bdeea17b84e4c4e841735f505cd12e5)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:47.229952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901f5ae-fe45-45ec-a92c-5d4637fab060 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:47.232181 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 55/112] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:37:47 2022] GET /identity/v3/users/5bdeea17b84e4c4e841735f505cd12e5 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:47.233815 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dd66d-ffb3-437c-bb52-504fabe60ae3 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:47.234226 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dd66d-ffb3-437c-bb52-504fabe60ae3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:47.234469 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dd66d-ffb3-437c-bb52-504fabe60ae3 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:47.236496 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 56/113] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:47.237027 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dd66d-ffb3-437c-bb52-504fabe60ae3 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:47.240634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 58/114] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:47.241409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8629ef3-6eec-484b-946b-d8cffeb40398 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:47.315021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:47.345741 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8629ef3-6eec-484b-946b-d8cffeb40398 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:47.377795 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dd66d-ffb3-437c-bb52-504fabe60ae3 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:47.384389 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75411f6b-cc6b-43e0-9271-9b860056431e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:47.385604 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75411f6b-cc6b-43e0-9271-9b860056431e None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:47.385943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75411f6b-cc6b-43e0-9271-9b860056431e None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:47.386224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75411f6b-cc6b-43e0-9271-9b860056431e None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:47.386904 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75411f6b-cc6b-43e0-9271-9b860056431e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:47.388788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75411f6b-cc6b-43e0-9271-9b860056431e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:47.390325 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75411f6b-cc6b-43e0-9271-9b860056431e None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:47.402196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 59/115] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:37:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:47.403034 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75411f6b-cc6b-43e0-9271-9b860056431e None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:47.421950 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d9311-ad05-4235-9de3-f5408dd0f608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:47.422846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d9311-ad05-4235-9de3-f5408dd0f608 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:47.423576 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d9311-ad05-4235-9de3-f5408dd0f608 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:47.424399 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d9311-ad05-4235-9de3-f5408dd0f608 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:47.438758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d9311-ad05-4235-9de3-f5408dd0f608 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:37:47.445058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-c53d9311-ad05-4235-9de3-f5408dd0f608 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:37:47.445058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:47.445058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:47.445058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:47.445058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:47.445058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:47.445058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:47.445058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:47.445058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:47.445058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:47.445058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:47.445058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:47.445058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:37:47.445058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:37:47.445058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:37:47.445058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:37:47.445907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:37:47.445907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:37:47.445907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:37:47.445907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:37:47.445907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:47.445907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:47.445907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:47.445907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:47.445907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:47.445907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:47.445907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:47.445907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:47.445907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:47.445907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:47.445907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:47.445907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:47.446670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:47.446670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:47.446670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:47.446670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:47.446670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:37:47.446670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:37:47.446670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:37:47.446670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:37:47.446670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:37:47.446670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:37:47.446670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:37:47.446670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:37:47.448997 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 57/116] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:37:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:37:47.454946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef440dec-51d4-46b8-bc1d-a315ad3c96d4 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:47.455382 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef440dec-51d4-46b8-bc1d-a315ad3c96d4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:47.455796 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef440dec-51d4-46b8-bc1d-a315ad3c96d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:47.476241 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ef440dec-51d4-46b8-bc1d-a315ad3c96d4 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:47.477633 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ef440dec-51d4-46b8-bc1d-a315ad3c96d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:47.510357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:47.517004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75411f6b-cc6b-43e0-9271-9b860056431e None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:47.551907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 58/117] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:47.552231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596c3a4-b911-4068-9703-f91c15411ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:47.552780 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef440dec-51d4-46b8-bc1d-a315ad3c96d4 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:47.552902 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596c3a4-b911-4068-9703-f91c15411ccb None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:47.553112 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596c3a4-b911-4068-9703-f91c15411ccb None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:47.553384 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596c3a4-b911-4068-9703-f91c15411ccb None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:47.557162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596c3a4-b911-4068-9703-f91c15411ccb None admin] RBAC: Authorizing `identity:get_project(project_id=2ad919f473ed42dba141f5a8838458b9)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:47.558652 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596c3a4-b911-4068-9703-f91c15411ccb None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:47.560560 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 60/118] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:37:47 2022] GET /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:47.561702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596c3a4-b911-4068-9703-f91c15411ccb None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:47.571795 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:47.674713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef440dec-51d4-46b8-bc1d-a315ad3c96d4 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:47.677543 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596c3a4-b911-4068-9703-f91c15411ccb None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:47.715967 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b979bd-8aed-419a-afd1-77642deb3a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:47.716641 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b979bd-8aed-419a-afd1-77642deb3a4b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:47.716926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b979bd-8aed-419a-afd1-77642deb3a4b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:47.717193 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b979bd-8aed-419a-afd1-77642deb3a4b None admin] PATH_INFO: `/v3/users/c7fa823d5f144a378671b1498a2e021e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:47.718954 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2586e-c67a-4ee4-a144-fec91df12597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:47.719830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2586e-c67a-4ee4-a144-fec91df12597 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:47.720306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2586e-c67a-4ee4-a144-fec91df12597 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:47.720865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2586e-c67a-4ee4-a144-fec91df12597 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:47.721736 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2586e-c67a-4ee4-a144-fec91df12597 None admin] RBAC: Adding query filter params (name=member) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:47.722835 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2586e-c67a-4ee4-a144-fec91df12597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:47.724521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2586e-c67a-4ee4-a144-fec91df12597 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:47.732883 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b979bd-8aed-419a-afd1-77642deb3a4b None admin] RBAC: Authorizing `identity:get_user(user_id=c7fa823d5f144a378671b1498a2e021e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:47.733880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 61/119] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:37:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:47.735340 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2586e-c67a-4ee4-a144-fec91df12597 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:47.738918 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b979bd-8aed-419a-afd1-77642deb3a4b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:47.742337 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 59/120] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:37:47 2022] GET /identity/v3/users/c7fa823d5f144a378671b1498a2e021e => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:47.743370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b979bd-8aed-419a-afd1-77642deb3a4b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:47.783371 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:47.804735 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:47.845421 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2586e-c67a-4ee4-a144-fec91df12597 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:47.871231 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b979bd-8aed-419a-afd1-77642deb3a4b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:47.888244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50d3f6-9751-48b7-9a4b-bc97bae2b693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:47.888913 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50d3f6-9751-48b7-9a4b-bc97bae2b693 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:47.889199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50d3f6-9751-48b7-9a4b-bc97bae2b693 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:47.889477 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50d3f6-9751-48b7-9a4b-bc97bae2b693 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:47.900322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa50d3f6-9751-48b7-9a4b-bc97bae2b693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:37:47.905708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-fa50d3f6-9751-48b7-9a4b-bc97bae2b693 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:37:47.905708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:47.905708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:47.905708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:47.905708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:47.905708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:47.905708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:47.905708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:47.905708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:47.905708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:47.905708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:47.905708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:47.905708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:37:47.905708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:37:47.905708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:37:47.905708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:37:47.906709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:37:47.906709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:37:47.906709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:37:47.906709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:37:47.906709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:47.906709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:47.906709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:47.906709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:47.906709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:47.906709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:47.906709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:47.906709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:47.906709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:47.906709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:47.906709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:47.906709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:47.907556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:47.907556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:47.907556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:47.907556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:47.907556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:37:47.907556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:37:47.907556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:37:47.907556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:37:47.907556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:37:47.907556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:37:47.907556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:37:47.907556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:37:47.907556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 62/121] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:37:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:37:47.908194 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50d3f6-9751-48b7-9a4b-bc97bae2b693 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:47.915062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385157fa-7a94-463f-9b05-25ceb6303dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:47.915807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385157fa-7a94-463f-9b05-25ceb6303dbd None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:47.916130 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385157fa-7a94-463f-9b05-25ceb6303dbd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:47.916651 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385157fa-7a94-463f-9b05-25ceb6303dbd None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9/users/5bdeea17b84e4c4e841735f505cd12e5/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:47.919261 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385157fa-7a94-463f-9b05-25ceb6303dbd None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad919f473ed42dba141f5a8838458b9, user_id=5bdeea17b84e4c4e841735f505cd12e5, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:47.921272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385157fa-7a94-463f-9b05-25ceb6303dbd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:48.008907 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50d3f6-9751-48b7-9a4b-bc97bae2b693 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:48.026713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 60/122] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:37:47 2022] PUT /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9/users/5bdeea17b84e4c4e841735f505cd12e5/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:37:48.027558 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385157fa-7a94-463f-9b05-25ceb6303dbd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:48.042107 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:48.054013 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8cfc3-26ff-4523-9f23-0b84994a0ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:48.054868 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8cfc3-26ff-4523-9f23-0b84994a0ac4 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:48.055155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8cfc3-26ff-4523-9f23-0b84994a0ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:48.055430 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8cfc3-26ff-4523-9f23-0b84994a0ac4 None admin] PATH_INFO: `/v3/users/5bdeea17b84e4c4e841735f505cd12e5` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:48.056791 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8cfc3-26ff-4523-9f23-0b84994a0ac4 None admin] RBAC: Authorizing `identity:get_user(user_id=5bdeea17b84e4c4e841735f505cd12e5)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:48.058356 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8cfc3-26ff-4523-9f23-0b84994a0ac4 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:48.060302 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 63/123] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:37:47 2022] GET /identity/v3/users/5bdeea17b84e4c4e841735f505cd12e5 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:48.060302 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8cfc3-26ff-4523-9f23-0b84994a0ac4 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:48.148992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:48.166526 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385157fa-7a94-463f-9b05-25ceb6303dbd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:48.202807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8cfc3-26ff-4523-9f23-0b84994a0ac4 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:48.205871 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccd2d0-aa44-4fc5-ae79-133f5f3d3dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:48.207153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccd2d0-aa44-4fc5-ae79-133f5f3d3dbb None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:48.207436 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccd2d0-aa44-4fc5-ae79-133f5f3d3dbb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:48.207963 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccd2d0-aa44-4fc5-ae79-133f5f3d3dbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:48.256921 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2582dc1-f440-4b8d-abdf-c9783ac37164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:48.257577 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2582dc1-f440-4b8d-abdf-c9783ac37164 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:48.257849 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2582dc1-f440-4b8d-abdf-c9783ac37164 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:48.258122 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2582dc1-f440-4b8d-abdf-c9783ac37164 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:48.274678 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2582dc1-f440-4b8d-abdf-c9783ac37164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:37:48.280834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-e2582dc1-f440-4b8d-abdf-c9783ac37164 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:37:48.280834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:48.280834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:48.280834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:48.280834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:48.280834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:48.280834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:48.280834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:48.280834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:48.280834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:48.280834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:48.280834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:48.280834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:37:48.280834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:37:48.280834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:37:48.280834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:37:48.281717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:37:48.281717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:37:48.281717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:37:48.281717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:37:48.281717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:48.281717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:48.281717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:48.281717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:48.281717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:48.281717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:48.281717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:48.281717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:48.281717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:48.281717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:48.281717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:48.281717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:48.282901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:48.282901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:48.282901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:48.282901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:48.282901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:37:48.282901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:37:48.282901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:37:48.282901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:37:48.282901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:37:48.282901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:37:48.282901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:37:48.282901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:37:48.282901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 64/124] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:37:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:37:48.282901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2582dc1-f440-4b8d-abdf-c9783ac37164 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:48.299615 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ccd2d0-aa44-4fc5-ae79-133f5f3d3dbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:48.302414 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ccd2d0-aa44-4fc5-ae79-133f5f3d3dbb None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:48.387006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2582dc1-f440-4b8d-abdf-c9783ac37164 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:48.408865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:48.410661 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:48.426040 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b74b7f-bf00-4bad-89ca-5d92f9b062cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:48.426661 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b74b7f-bf00-4bad-89ca-5d92f9b062cb None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:48.426939 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b74b7f-bf00-4bad-89ca-5d92f9b062cb None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:48.427211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b74b7f-bf00-4bad-89ca-5d92f9b062cb None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:48.427878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b74b7f-bf00-4bad-89ca-5d92f9b062cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:48.428180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b74b7f-bf00-4bad-89ca-5d92f9b062cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:48.429594 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b74b7f-bf00-4bad-89ca-5d92f9b062cb None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:48.433070 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 61/125] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:37:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:37:48.434124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccd2d0-aa44-4fc5-ae79-133f5f3d3dbb None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:48.439229 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 65/126] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:37:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:48.441713 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b74b7f-bf00-4bad-89ca-5d92f9b062cb None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:48.545916 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b74b7f-bf00-4bad-89ca-5d92f9b062cb None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:48.555451 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccd2d0-aa44-4fc5-ae79-133f5f3d3dbb None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:48.561073 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:48.587240 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa68bef-1104-4b49-9fa6-80e17b782845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:48.587871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa68bef-1104-4b49-9fa6-80e17b782845 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:48.588155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa68bef-1104-4b49-9fa6-80e17b782845 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:48.588452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa68bef-1104-4b49-9fa6-80e17b782845 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:48.589370 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa68bef-1104-4b49-9fa6-80e17b782845 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:48.589676 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa68bef-1104-4b49-9fa6-80e17b782845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:48.591712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa68bef-1104-4b49-9fa6-80e17b782845 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:48.599138 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959cc69-be8d-4602-a38f-4ffa052488e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:48.600031 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959cc69-be8d-4602-a38f-4ffa052488e9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:48.600569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959cc69-be8d-4602-a38f-4ffa052488e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:48.601064 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959cc69-be8d-4602-a38f-4ffa052488e9 None admin] PATH_INFO: `/v3/projects/69881c0aa4374f1bb110e20848ec9e0b` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:48.601947 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 66/127] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:37:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:48.602574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa68bef-1104-4b49-9fa6-80e17b782845 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:48.603244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959cc69-be8d-4602-a38f-4ffa052488e9 None admin] RBAC: Authorizing `identity:get_project(project_id=69881c0aa4374f1bb110e20848ec9e0b)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:48.605092 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959cc69-be8d-4602-a38f-4ffa052488e9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:48.611864 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 62/128] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:37:48 2022] GET /identity/v3/projects/69881c0aa4374f1bb110e20848ec9e0b => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:48.613652 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959cc69-be8d-4602-a38f-4ffa052488e9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:48.685728 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:48.723948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa68bef-1104-4b49-9fa6-80e17b782845 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:48.744846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959cc69-be8d-4602-a38f-4ffa052488e9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:48.762043 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e844c-98f5-4576-803b-13bb6e5df85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:48.763443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e844c-98f5-4576-803b-13bb6e5df85c None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:48.763923 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e844c-98f5-4576-803b-13bb6e5df85c None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:48.764406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e844c-98f5-4576-803b-13bb6e5df85c None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:48.765874 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e844c-98f5-4576-803b-13bb6e5df85c None admin] RBAC: Authorizing `identity:get_project(project_id=2ad919f473ed42dba141f5a8838458b9)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:48.767787 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e844c-98f5-4576-803b-13bb6e5df85c None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:48.770137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 67/129] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:37:48 2022] GET /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:48.771106 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e844c-98f5-4576-803b-13bb6e5df85c None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:48.786332 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dceccda-3049-43e2-89a8-3accfbc7d36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:48.787073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceccda-3049-43e2-89a8-3accfbc7d36e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:48.787357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceccda-3049-43e2-89a8-3accfbc7d36e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:48.787633 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceccda-3049-43e2-89a8-3accfbc7d36e None admin] PATH_INFO: `/v3/users/5bdeea17b84e4c4e841735f505cd12e5` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:48.788835 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dceccda-3049-43e2-89a8-3accfbc7d36e None admin] RBAC: Authorizing `identity:get_user(user_id=5bdeea17b84e4c4e841735f505cd12e5)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:48.790865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dceccda-3049-43e2-89a8-3accfbc7d36e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:48.797173 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 63/130] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:37:48 2022] GET /identity/v3/users/5bdeea17b84e4c4e841735f505cd12e5 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:48.797173 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dceccda-3049-43e2-89a8-3accfbc7d36e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:48.829406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:48.892859 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e844c-98f5-4576-803b-13bb6e5df85c None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:48.929282 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dceccda-3049-43e2-89a8-3accfbc7d36e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:48.930506 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30287ade-3b68-4165-8d39-a4aae39f2d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:48.931395 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30287ade-3b68-4165-8d39-a4aae39f2d42 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:48.931949 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30287ade-3b68-4165-8d39-a4aae39f2d42 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:48.932378 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30287ade-3b68-4165-8d39-a4aae39f2d42 None admin] PATH_INFO: `/v3/users/8c7dd247a668409cb8ef9f1bcc9cb927` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:48.933697 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30287ade-3b68-4165-8d39-a4aae39f2d42 None admin] RBAC: Authorizing `identity:get_user(user_id=8c7dd247a668409cb8ef9f1bcc9cb927)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:48.935304 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30287ade-3b68-4165-8d39-a4aae39f2d42 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:48.937204 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 68/131] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:37:48 2022] GET /identity/v3/users/8c7dd247a668409cb8ef9f1bcc9cb927 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:48.938129 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30287ade-3b68-4165-8d39-a4aae39f2d42 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:48.960142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:48.973783 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fde6f-0459-41bd-b1d3-08aa0fbdde09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:48.974804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fde6f-0459-41bd-b1d3-08aa0fbdde09 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:48.981758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fde6f-0459-41bd-b1d3-08aa0fbdde09 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:48.981758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fde6f-0459-41bd-b1d3-08aa0fbdde09 None admin] PATH_INFO: `/v3/projects/69881c0aa4374f1bb110e20848ec9e0b/users/5bdeea17b84e4c4e841735f505cd12e5/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:48.981758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fde6f-0459-41bd-b1d3-08aa0fbdde09 None admin] RBAC: Authorizing `identity:create_grant(project_id=69881c0aa4374f1bb110e20848ec9e0b, user_id=5bdeea17b84e4c4e841735f505cd12e5, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:48.981758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fde6f-0459-41bd-b1d3-08aa0fbdde09 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:49.056445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30287ade-3b68-4165-8d39-a4aae39f2d42 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:49.071649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:49.100768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 64/132] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:37:48 2022] PUT /identity/v3/projects/69881c0aa4374f1bb110e20848ec9e0b/users/5bdeea17b84e4c4e841735f505cd12e5/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:37:49.100768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fde6f-0459-41bd-b1d3-08aa0fbdde09 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:49.127913 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347945c5-c210-4ac5-8c99-d5e86b9f9a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:49.128642 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347945c5-c210-4ac5-8c99-d5e86b9f9a4b None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:49.128928 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347945c5-c210-4ac5-8c99-d5e86b9f9a4b None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:49.129204 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347945c5-c210-4ac5-8c99-d5e86b9f9a4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:49.130057 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347945c5-c210-4ac5-8c99-d5e86b9f9a4b None admin] RBAC: Adding query filter params (role.id=ee530d022cde4038bd521a1bb5f5ba6f, scope.project.id=2ad919f473ed42dba141f5a8838458b9, user.id=c7fa823d5f144a378671b1498a2e021e) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:49.130375 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347945c5-c210-4ac5-8c99-d5e86b9f9a4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:49.133900 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347945c5-c210-4ac5-8c99-d5e86b9f9a4b None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:49.149484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 69/133] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:37:48 2022] GET /identity/v3/role_assignments?user.id=c7fa823d5f144a378671b1498a2e021e&scope.project.id=2ad919f473ed42dba141f5a8838458b9&role.id=ee530d022cde4038bd521a1bb5f5ba6f => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:49.150477 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347945c5-c210-4ac5-8c99-d5e86b9f9a4b None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:49.292220 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fde6f-0459-41bd-b1d3-08aa0fbdde09 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:49.350195 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788ea38-a1c3-4057-92ad-be4b93718e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:49.351212 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788ea38-a1c3-4057-92ad-be4b93718e1c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:49.351491 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788ea38-a1c3-4057-92ad-be4b93718e1c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:49.351965 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788ea38-a1c3-4057-92ad-be4b93718e1c None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:49.353220 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788ea38-a1c3-4057-92ad-be4b93718e1c None admin] RBAC: Authorizing `identity:get_project(project_id=2ad919f473ed42dba141f5a8838458b9)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:49.354722 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788ea38-a1c3-4057-92ad-be4b93718e1c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:49.356653 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 65/134] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:37:49 2022] GET /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:49.358286 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2145b2-b45a-45e3-95f0-72906117cbfe None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:49.358575 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2145b2-b45a-45e3-95f0-72906117cbfe None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:49.359001 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2145b2-b45a-45e3-95f0-72906117cbfe None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:49.360503 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 66/135] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:49.365862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2145b2-b45a-45e3-95f0-72906117cbfe None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:49.387581 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347945c5-c210-4ac5-8c99-d5e86b9f9a4b None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:49.424667 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:49.434446 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42591b3e-36ea-432d-957b-cabf5a21e988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:49.435247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42591b3e-36ea-432d-957b-cabf5a21e988 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:49.435531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42591b3e-36ea-432d-957b-cabf5a21e988 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:49.436119 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42591b3e-36ea-432d-957b-cabf5a21e988 None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:49.437766 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42591b3e-36ea-432d-957b-cabf5a21e988 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad919f473ed42dba141f5a8838458b9)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:49.439387 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42591b3e-36ea-432d-957b-cabf5a21e988 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:49.442020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 70/136] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:37:49 2022] GET /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:49.443252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e271f9-af27-4fea-9378-98e29c1792c0 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:49.443705 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e271f9-af27-4fea-9378-98e29c1792c0 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:49.455032 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e271f9-af27-4fea-9378-98e29c1792c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:49.467573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-d6e271f9-af27-4fea-9378-98e29c1792c0 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:49.469026 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d6e271f9-af27-4fea-9378-98e29c1792c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:49.488276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2145b2-b45a-45e3-95f0-72906117cbfe None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:49.524842 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:49.531909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e245e33-699b-494b-bb17-2a75a1512445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:49.532774 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e245e33-699b-494b-bb17-2a75a1512445 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:49.533121 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e245e33-699b-494b-bb17-2a75a1512445 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:49.533467 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e245e33-699b-494b-bb17-2a75a1512445 None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9/users/5bdeea17b84e4c4e841735f505cd12e5/roles/01a26dc2b1034e33af13752c154d24f4` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:49.536404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e245e33-699b-494b-bb17-2a75a1512445 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad919f473ed42dba141f5a8838458b9, user_id=5bdeea17b84e4c4e841735f505cd12e5, role_id=01a26dc2b1034e33af13752c154d24f4)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:49.537893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e245e33-699b-494b-bb17-2a75a1512445 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:49.564482 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 71/137] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:49.564482 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e271f9-af27-4fea-9378-98e29c1792c0 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:49.599932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 67/138] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:37:49 2022] PUT /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9/users/5bdeea17b84e4c4e841735f505cd12e5/roles/01a26dc2b1034e33af13752c154d24f4 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:37:49.677822 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e271f9-af27-4fea-9378-98e29c1792c0 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:49.725211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2223ee-4b71-4f7c-a824-c592c3228b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:49.726349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2223ee-4b71-4f7c-a824-c592c3228b35 None admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:49.726774 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2223ee-4b71-4f7c-a824-c592c3228b35 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:49.727176 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2223ee-4b71-4f7c-a824-c592c3228b35 None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9/users/8c7dd247a668409cb8ef9f1bcc9cb927/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:49.731177 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2223ee-4b71-4f7c-a824-c592c3228b35 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad919f473ed42dba141f5a8838458b9, user_id=8c7dd247a668409cb8ef9f1bcc9cb927, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:49.732915 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2223ee-4b71-4f7c-a824-c592c3228b35 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:49.804708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 72/139] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:37:49 2022] PUT /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9/users/8c7dd247a668409cb8ef9f1bcc9cb927/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:37:49.938018 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e245e33-699b-494b-bb17-2a75a1512445 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:50.066966 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e245e33-699b-494b-bb17-2a75a1512445 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:50.082284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:50.112963 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b5f92-2612-4b4d-8c3b-618169904dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:50.113617 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b5f92-2612-4b4d-8c3b-618169904dc2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:50.113898 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b5f92-2612-4b4d-8c3b-618169904dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:50.114174 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b5f92-2612-4b4d-8c3b-618169904dc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:50.115301 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b5f92-2612-4b4d-8c3b-618169904dc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:50.116775 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b5f92-2612-4b4d-8c3b-618169904dc2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:50.118656 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 68/140] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:37:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:50.124046 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2223ee-4b71-4f7c-a824-c592c3228b35 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:50.175647 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:50.269175 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2223ee-4b71-4f7c-a824-c592c3228b35 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:50.318927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c4d3b-036a-4e32-8c5f-1f0cadefb21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:50.319557 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c4d3b-036a-4e32-8c5f-1f0cadefb21b None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:50.319844 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c4d3b-036a-4e32-8c5f-1f0cadefb21b None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:50.320121 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c4d3b-036a-4e32-8c5f-1f0cadefb21b None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:50.320811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c4d3b-036a-4e32-8c5f-1f0cadefb21b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:50.322257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c4d3b-036a-4e32-8c5f-1f0cadefb21b None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:50.432837 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 73/141] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Sep 6 22:37:50 2022] POST /identity/v3/users => generated 283 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:37:51.059416 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46438d9c-809b-4b97-88cf-e21cac1ad402 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:51.059933 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46438d9c-809b-4b97-88cf-e21cac1ad402 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:51.060040 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46438d9c-809b-4b97-88cf-e21cac1ad402 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:51.061700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 69/142] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:51.068455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1a9c4-6d1e-4d81-bf5c-8f109db290f0 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:51.068455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1a9c4-6d1e-4d81-bf5c-8f109db290f0 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:51.068455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1a9c4-6d1e-4d81-bf5c-8f109db290f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:51.093930 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-30b1a9c4-6d1e-4d81-bf5c-8f109db290f0 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:51.095145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-30b1a9c4-6d1e-4d81-bf5c-8f109db290f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:51.186520 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 74/143] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 22:37:51.742445 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46438d9c-809b-4b97-88cf-e21cac1ad402 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:51.873277 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46438d9c-809b-4b97-88cf-e21cac1ad402 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:51.914488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dc106-9e16-41d7-b8fa-cb31576b2725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:51.915153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dc106-9e16-41d7-b8fa-cb31576b2725 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:51.915440 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dc106-9e16-41d7-b8fa-cb31576b2725 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:51.915713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dc106-9e16-41d7-b8fa-cb31576b2725 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:51.931369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44dc106-9e16-41d7-b8fa-cb31576b2725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:37:51.938755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-c44dc106-9e16-41d7-b8fa-cb31576b2725 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:37:51.938755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:51.938755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:51.938755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:51.938755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:51.938755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:51.938755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:51.938755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:51.938755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:51.938755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:51.938755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:51.938755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:51.938755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:37:51.938755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:37:51.938755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:37:51.938755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:37:51.939573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:37:51.939573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:37:51.939573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:37:51.939573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:37:51.939573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:51.939573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:51.939573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:51.939573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:51.939573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:51.939573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:51.939573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:51.939573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:51.939573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:51.939573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:51.939573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:51.939573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:51.940373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:51.940373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:51.940373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:51.940373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:51.940373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:37:51.940373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:37:51.940373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:37:51.940373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:37:51.940373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:37:51.940373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:37:51.940373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:37:51.940373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:37:51.940373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 70/144] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:37:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:37:51.943407 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1a9c4-6d1e-4d81-bf5c-8f109db290f0 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:51.962721 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1f759-d775-43a0-8d67-45338faf6f6f None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:51.963577 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1f759-d775-43a0-8d67-45338faf6f6f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:51.963860 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1f759-d775-43a0-8d67-45338faf6f6f None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:51.965244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 71/145] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:37:51.971099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c66fa-7809-4dd1-9bb6-c494bd88b3e3 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:51.971386 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c66fa-7809-4dd1-9bb6-c494bd88b3e3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:51.976351 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c66fa-7809-4dd1-9bb6-c494bd88b3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:51.987873 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:52.009345 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-0a9c66fa-7809-4dd1-9bb6-c494bd88b3e3 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:52.010575 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0a9c66fa-7809-4dd1-9bb6-c494bd88b3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:52.072449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:52.138723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1a9c4-6d1e-4d81-bf5c-8f109db290f0 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:52.145828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 72/146] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:52.184772 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce3b98-7f62-438c-bf17-c0d61edbae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:52.185410 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce3b98-7f62-438c-bf17-c0d61edbae08 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:52.185692 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce3b98-7f62-438c-bf17-c0d61edbae08 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:52.185964 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce3b98-7f62-438c-bf17-c0d61edbae08 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:52.186639 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce3b98-7f62-438c-bf17-c0d61edbae08 None admin] RBAC: Adding query filter params (name=member) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:52.186942 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce3b98-7f62-438c-bf17-c0d61edbae08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:52.188398 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce3b98-7f62-438c-bf17-c0d61edbae08 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:52.199115 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 75/147] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:37:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:52.203790 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c66fa-7809-4dd1-9bb6-c494bd88b3e3 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:52.328887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c66fa-7809-4dd1-9bb6-c494bd88b3e3 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:52.370739 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef823907-53dd-4d84-ba34-cd1826e128d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:52.371393 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef823907-53dd-4d84-ba34-cd1826e128d9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:52.371674 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef823907-53dd-4d84-ba34-cd1826e128d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:52.371955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef823907-53dd-4d84-ba34-cd1826e128d9 None admin] PATH_INFO: `/v3/users/5bdeea17b84e4c4e841735f505cd12e5` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:52.373131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef823907-53dd-4d84-ba34-cd1826e128d9 None admin] RBAC: Authorizing `identity:get_user(user_id=5bdeea17b84e4c4e841735f505cd12e5)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:52.374601 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef823907-53dd-4d84-ba34-cd1826e128d9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:52.376507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 73/148] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:37:52 2022] GET /identity/v3/users/5bdeea17b84e4c4e841735f505cd12e5 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:52.382183 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce3b98-7f62-438c-bf17-c0d61edbae08 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:52.483827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:52.503591 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce3b98-7f62-438c-bf17-c0d61edbae08 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:52.542021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed9c38-c474-46c3-bee3-125fd4516e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:52.542665 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed9c38-c474-46c3-bee3-125fd4516e11 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:52.542946 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed9c38-c474-46c3-bee3-125fd4516e11 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:52.543222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed9c38-c474-46c3-bee3-125fd4516e11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:52.602402 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef823907-53dd-4d84-ba34-cd1826e128d9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:52.626231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed9c38-c474-46c3-bee3-125fd4516e11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:52.628243 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed9c38-c474-46c3-bee3-125fd4516e11 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:52.679533 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:52.762067 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef823907-53dd-4d84-ba34-cd1826e128d9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:52.793573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:52.801101 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef4619-16e1-46c3-a72e-a728cb2eead4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:52.801752 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef4619-16e1-46c3-a72e-a728cb2eead4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:52.802098 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef4619-16e1-46c3-a72e-a728cb2eead4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:52.802374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef4619-16e1-46c3-a72e-a728cb2eead4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:52.813509 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef4619-16e1-46c3-a72e-a728cb2eead4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:37:52.819265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-1fef4619-16e1-46c3-a72e-a728cb2eead4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 22:37:52.819265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:52.819265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:52.819265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:52.819265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:52.819265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:52.819265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:52.819265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:52.819265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:52.819265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:52.819265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:52.819265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:52.819265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:37:52.819265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:37:52.819265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:37:52.819265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:37:52.820449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:37:52.820449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:37:52.820449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:37:52.820449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:37:52.820449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:52.820449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:52.820449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:52.820449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:52.820449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:52.820449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:52.820449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:52.820449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:52.820449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:52.820449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:52.820449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:52.820449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:52.821427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:52.821427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:52.821427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:52.821427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:52.821427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:37:52.821427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:37:52.821427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:37:52.821427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:37:52.821427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:37:52.821427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:37:52.821427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 22:37:52.821427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:37:52.823371 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 74/149] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:37:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:37:52.829601 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ea632-a667-4748-b9f4-f65f25d17d52 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:52.830068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ea632-a667-4748-b9f4-f65f25d17d52 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:52.830508 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ea632-a667-4748-b9f4-f65f25d17d52 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:52.835038 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 75/150] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:52.836311 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ea632-a667-4748-b9f4-f65f25d17d52 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:52.847451 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 76/151] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:37:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:37:52.848774 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba4e83-6a6f-45a5-9b7c-dcfc1eedb37a None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:52.849063 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba4e83-6a6f-45a5-9b7c-dcfc1eedb37a None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:52.849387 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba4e83-6a6f-45a5-9b7c-dcfc1eedb37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:52.883506 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-6cba4e83-6a6f-45a5-9b7c-dcfc1eedb37a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:52.884841 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-6cba4e83-6a6f-45a5-9b7c-dcfc1eedb37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:52.943188 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:52.950788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ea632-a667-4748-b9f4-f65f25d17d52 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:52.958800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 77/152] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:52.959780 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba4e83-6a6f-45a5-9b7c-dcfc1eedb37a None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:52.991832 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3857b8-f8d0-43e1-b2b9-4dc8641164a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:52.992942 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3857b8-f8d0-43e1-b2b9-4dc8641164a4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:52.993422 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3857b8-f8d0-43e1-b2b9-4dc8641164a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:52.993933 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3857b8-f8d0-43e1-b2b9-4dc8641164a4 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:52.994843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3857b8-f8d0-43e1-b2b9-4dc8641164a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:52.995341 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3857b8-f8d0-43e1-b2b9-4dc8641164a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:52.997229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3857b8-f8d0-43e1-b2b9-4dc8641164a4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:53.006847 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 76/153] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:37:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:37:53.012943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da5a1c-2700-40c5-9246-91b27d887062 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:53.013538 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da5a1c-2700-40c5-9246-91b27d887062 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:53.014009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da5a1c-2700-40c5-9246-91b27d887062 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:53.015652 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 77/154] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:53.016946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da5a1c-2700-40c5-9246-91b27d887062 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:53.090589 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba4e83-6a6f-45a5-9b7c-dcfc1eedb37a None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:53.109080 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:53.137706 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21ad2e-6af6-4c8c-bd19-028c9b9f2474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:53.138665 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21ad2e-6af6-4c8c-bd19-028c9b9f2474 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:53.139138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21ad2e-6af6-4c8c-bd19-028c9b9f2474 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:53.140215 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21ad2e-6af6-4c8c-bd19-028c9b9f2474 None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:53.142982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21ad2e-6af6-4c8c-bd19-028c9b9f2474 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad919f473ed42dba141f5a8838458b9)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:53.145265 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21ad2e-6af6-4c8c-bd19-028c9b9f2474 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:53.147174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 78/155] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:37:52 2022] GET /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:53.147760 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da5a1c-2700-40c5-9246-91b27d887062 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:53.149161 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db339b9-2532-4291-bbce-35da7b09f153 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:53.149789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db339b9-2532-4291-bbce-35da7b09f153 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:53.150383 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db339b9-2532-4291-bbce-35da7b09f153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:53.185715 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133d8c2-7855-4147-9166-7fcbaca3fff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:53.186388 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133d8c2-7855-4147-9166-7fcbaca3fff1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:53.186671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133d8c2-7855-4147-9166-7fcbaca3fff1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:53.186856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-3db339b9-2532-4291-bbce-35da7b09f153 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:53.186949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133d8c2-7855-4147-9166-7fcbaca3fff1 None admin] PATH_INFO: `/v3/users/c7fa823d5f144a378671b1498a2e021e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:53.188064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3db339b9-2532-4291-bbce-35da7b09f153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:53.188254 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133d8c2-7855-4147-9166-7fcbaca3fff1 None admin] RBAC: Authorizing `identity:get_user(user_id=c7fa823d5f144a378671b1498a2e021e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:53.189871 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133d8c2-7855-4147-9166-7fcbaca3fff1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:53.192393 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 78/156] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:37:53 2022] GET /identity/v3/users/c7fa823d5f144a378671b1498a2e021e => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:37:53.193241 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133d8c2-7855-4147-9166-7fcbaca3fff1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:53.245150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:53.315070 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 79/157] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:53.316564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db339b9-2532-4291-bbce-35da7b09f153 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:53.392211 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133d8c2-7855-4147-9166-7fcbaca3fff1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:53.441792 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db339b9-2532-4291-bbce-35da7b09f153 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:53.453040 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:53.478212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a81b5-dcfa-4a19-ae22-690866e933c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:53.478881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a81b5-dcfa-4a19-ae22-690866e933c6 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:53.479169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a81b5-dcfa-4a19-ae22-690866e933c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:53.479440 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a81b5-dcfa-4a19-ae22-690866e933c6 None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:53.481842 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a81b5-dcfa-4a19-ae22-690866e933c6 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad919f473ed42dba141f5a8838458b9)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:53.482125 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a81b5-dcfa-4a19-ae22-690866e933c6 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:53.484151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 80/158] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:37:53 2022] GET /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:53.484961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a81b5-dcfa-4a19-ae22-690866e933c6 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:53.486198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2f54f-8b96-4341-adef-97bdd196d42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:53.487120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2f54f-8b96-4341-adef-97bdd196d42c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:53.487588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2f54f-8b96-4341-adef-97bdd196d42c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:53.488047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2f54f-8b96-4341-adef-97bdd196d42c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:53.489008 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2f54f-8b96-4341-adef-97bdd196d42c None admin] RBAC: Adding query filter params (role.id=093c83b316db4d0f9dc55ec6e3583ba8, scope.project.id=2ad919f473ed42dba141f5a8838458b9, user.id=5bdeea17b84e4c4e841735f505cd12e5) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:53.489523 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2f54f-8b96-4341-adef-97bdd196d42c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:53.491190 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2f54f-8b96-4341-adef-97bdd196d42c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:53.506767 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 79/159] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:37:53 2022] GET /identity/v3/role_assignments?user.id=5bdeea17b84e4c4e841735f505cd12e5&scope.project.id=2ad919f473ed42dba141f5a8838458b9&role.id=093c83b316db4d0f9dc55ec6e3583ba8 => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:53.507930 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2f54f-8b96-4341-adef-97bdd196d42c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:53.597008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a81b5-dcfa-4a19-ae22-690866e933c6 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:53.633640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8eb8a-8f3b-482e-9ea4-4d0253639391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:53.634287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8eb8a-8f3b-482e-9ea4-4d0253639391 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:53.634570 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8eb8a-8f3b-482e-9ea4-4d0253639391 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:53.634844 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8eb8a-8f3b-482e-9ea4-4d0253639391 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:53.646130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8eb8a-8f3b-482e-9ea4-4d0253639391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:37:53.651740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-96c8eb8a-8f3b-482e-9ea4-4d0253639391 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:37:53.651740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:53.651740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:53.651740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:53.651740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:53.651740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:53.651740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:53.651740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:53.651740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:53.651740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:53.651740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:53.651740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:53.651740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:37:53.651740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:37:53.651740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:37:53.651740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:37:53.652733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:37:53.652733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:37:53.652733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:37:53.652733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:37:53.652733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:53.652733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:53.652733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:53.652733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:53.652733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:53.652733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:53.652733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:53.652733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:53.652733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:53.652733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:53.652733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:53.652733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:53.653576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:53.653576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:53.653576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:53.653576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:53.653576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:37:53.653576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:37:53.653576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:37:53.653576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:37:53.653576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:37:53.653576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:37:53.653576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:37:53.653576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:37:53.653576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 81/160] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:37:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:37:53.658933 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8eb8a-8f3b-482e-9ea4-4d0253639391 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:53.703165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:53.724980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:53.750398 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2f54f-8b96-4341-adef-97bdd196d42c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:53.770298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8eb8a-8f3b-482e-9ea4-4d0253639391 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:53.808894 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14137594-517f-4fa9-9126-8218f53ed1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:53.809529 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14137594-517f-4fa9-9126-8218f53ed1ff None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:53.809933 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14137594-517f-4fa9-9126-8218f53ed1ff None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:53.810217 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14137594-517f-4fa9-9126-8218f53ed1ff None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:53.810909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14137594-517f-4fa9-9126-8218f53ed1ff None admin] RBAC: Adding query filter params (name=member) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:53.811213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14137594-517f-4fa9-9126-8218f53ed1ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:53.812629 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14137594-517f-4fa9-9126-8218f53ed1ff None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:53.822837 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 82/161] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:37:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:37:53.824366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7ecc8-7a82-4a30-97d1-d55b63c19c84 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:53.824681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7ecc8-7a82-4a30-97d1-d55b63c19c84 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:53.824960 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7ecc8-7a82-4a30-97d1-d55b63c19c84 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:53.826270 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 83/162] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:53.831461 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c21bf-06c6-4048-aa03-1f5e593c8c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:53.832042 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d305c-a2c7-4611-99c8-f9b761c3d7e3 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:53.832380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d305c-a2c7-4611-99c8-f9b761c3d7e3 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:53.833024 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d305c-a2c7-4611-99c8-f9b761c3d7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:53.833124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c21bf-06c6-4048-aa03-1f5e593c8c84 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:53.833554 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c21bf-06c6-4048-aa03-1f5e593c8c84 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:53.833987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c21bf-06c6-4048-aa03-1f5e593c8c84 None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9/users/c7fa823d5f144a378671b1498a2e021e/roles/ee530d022cde4038bd521a1bb5f5ba6f` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:53.837677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c21bf-06c6-4048-aa03-1f5e593c8c84 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad919f473ed42dba141f5a8838458b9, user_id=c7fa823d5f144a378671b1498a2e021e, role_id=ee530d022cde4038bd521a1bb5f5ba6f)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:53.839344 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c21bf-06c6-4048-aa03-1f5e593c8c84 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:53.853462 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-2c8d305c-a2c7-4611-99c8-f9b761c3d7e3 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:53.854796 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-2c8d305c-a2c7-4611-99c8-f9b761c3d7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:53.931809 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 84/163] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:53.932900 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d305c-a2c7-4611-99c8-f9b761c3d7e3 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:53.943486 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 80/164] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:37:53 2022] PUT /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9/users/c7fa823d5f144a378671b1498a2e021e/roles/ee530d022cde4038bd521a1bb5f5ba6f => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:37:53.979932 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:54.047244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d305c-a2c7-4611-99c8-f9b761c3d7e3 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:54.061507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c21bf-06c6-4048-aa03-1f5e593c8c84 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:54.089811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33881508-119b-4edd-b160-e36cf22f3dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:54.090483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33881508-119b-4edd-b160-e36cf22f3dc1 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:54.090767 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33881508-119b-4edd-b160-e36cf22f3dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:54.091043 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33881508-119b-4edd-b160-e36cf22f3dc1 None admin] PATH_INFO: `/v3/users/5bdeea17b84e4c4e841735f505cd12e5` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:54.100471 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33881508-119b-4edd-b160-e36cf22f3dc1 None admin] RBAC: Authorizing `identity:get_user(user_id=5bdeea17b84e4c4e841735f505cd12e5)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:54.100471 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33881508-119b-4edd-b160-e36cf22f3dc1 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:54.100471 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 85/165] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:37:53 2022] GET /identity/v3/users/5bdeea17b84e4c4e841735f505cd12e5 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:54.102438 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33881508-119b-4edd-b160-e36cf22f3dc1 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:54.256816 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:54.259373 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33881508-119b-4edd-b160-e36cf22f3dc1 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:54.325202 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7e13f-4245-4c13-9dad-7f7ccc58df7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:54.326131 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7e13f-4245-4c13-9dad-7f7ccc58df7a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:54.326600 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7e13f-4245-4c13-9dad-7f7ccc58df7a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:54.327016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7e13f-4245-4c13-9dad-7f7ccc58df7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:54.352263 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c21bf-06c6-4048-aa03-1f5e593c8c84 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:54.422094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0582fcc-25da-43f1-ac99-38a75917714d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:54.423084 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0582fcc-25da-43f1-ac99-38a75917714d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:54.423940 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7e13f-4245-4c13-9dad-7f7ccc58df7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:54.424366 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0582fcc-25da-43f1-ac99-38a75917714d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:54.425327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0582fcc-25da-43f1-ac99-38a75917714d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:54.428639 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7e13f-4245-4c13-9dad-7f7ccc58df7a None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:54.449653 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0582fcc-25da-43f1-ac99-38a75917714d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:37:54.457017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-f0582fcc-25da-43f1-ac99-38a75917714d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:37:54.457017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:54.457017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:54.457017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:54.457017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:54.457017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:54.457017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:54.457017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:54.457017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:54.457017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:54.457017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:54.457017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:54.457017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:37:54.457017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:37:54.457017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:37:54.457017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:37:54.458368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:37:54.458368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:37:54.458368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:37:54.458368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:37:54.458368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:54.458368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:54.458368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:54.458368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:54.458368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:54.458368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:54.458368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:54.458368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:54.458368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:54.458368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:54.458368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:54.458368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:54.459573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:54.459573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:54.459573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:54.459573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:54.459573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:37:54.459573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:37:54.459573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:37:54.459573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:37:54.459573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:37:54.459573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:37:54.459573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:37:54.459573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:37:54.463135 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 81/166] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:37:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:37:54.470085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0582fcc-25da-43f1-ac99-38a75917714d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:54.491902 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:54.611558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:54.617525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 86/167] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:37:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:37:54.624080 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7e13f-4245-4c13-9dad-7f7ccc58df7a None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:54.664681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0582fcc-25da-43f1-ac99-38a75917714d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:54.729616 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9340eb-83e7-4164-839b-1351bb48b249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:54.730594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9340eb-83e7-4164-839b-1351bb48b249 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:54.731075 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9340eb-83e7-4164-839b-1351bb48b249 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:54.731549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9340eb-83e7-4164-839b-1351bb48b249 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:54.732468 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9340eb-83e7-4164-839b-1351bb48b249 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:54.732973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9340eb-83e7-4164-839b-1351bb48b249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:54.734588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9340eb-83e7-4164-839b-1351bb48b249 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:54.744490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 82/168] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:37:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:54.745566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9340eb-83e7-4164-839b-1351bb48b249 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:54.820343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:54.841503 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7e13f-4245-4c13-9dad-7f7ccc58df7a None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:54.856888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9340eb-83e7-4164-839b-1351bb48b249 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:54.897563 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc722944-96bf-488a-8c93-90b7fb7a43bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:54.898535 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc722944-96bf-488a-8c93-90b7fb7a43bb None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:54.899034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc722944-96bf-488a-8c93-90b7fb7a43bb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:54.899504 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc722944-96bf-488a-8c93-90b7fb7a43bb None admin] PATH_INFO: `/v3/projects/69881c0aa4374f1bb110e20848ec9e0b` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:54.900912 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc722944-96bf-488a-8c93-90b7fb7a43bb None admin] RBAC: Authorizing `identity:get_project(project_id=69881c0aa4374f1bb110e20848ec9e0b)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:54.902651 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc722944-96bf-488a-8c93-90b7fb7a43bb None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:54.904518 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 83/169] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:37:54 2022] GET /identity/v3/projects/69881c0aa4374f1bb110e20848ec9e0b => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:54.905600 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc722944-96bf-488a-8c93-90b7fb7a43bb None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:54.918543 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f26c06-3d59-4d28-be7c-72bf60a2a4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:54.919299 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f26c06-3d59-4d28-be7c-72bf60a2a4b7 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:54.919588 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f26c06-3d59-4d28-be7c-72bf60a2a4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:54.919863 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f26c06-3d59-4d28-be7c-72bf60a2a4b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:54.941844 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f26c06-3d59-4d28-be7c-72bf60a2a4b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:37:54.947268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-e4f26c06-3d59-4d28-be7c-72bf60a2a4b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:37:54.947268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:54.947268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:54.947268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:54.947268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:54.947268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:54.947268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:54.947268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:54.947268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:54.947268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:54.947268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:54.947268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:54.947268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:37:54.947268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:37:54.947268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:37:54.947268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:37:54.948151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:37:54.948151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:37:54.948151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:37:54.948151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:37:54.948151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:54.948151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:54.948151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:54.948151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:54.948151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:54.948151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:54.948151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:54.948151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:54.948151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:54.948151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:54.948151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:54.948151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:54.949005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:54.949005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:54.949005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:54.949005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:54.949005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:37:54.949005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:37:54.949005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:37:54.949005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:37:54.949005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:37:54.949005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:37:54.949005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:37:54.949005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:37:54.949005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 87/170] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:37:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:37:54.952177 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f26c06-3d59-4d28-be7c-72bf60a2a4b7 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:55.024800 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc722944-96bf-488a-8c93-90b7fb7a43bb None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:55.061744 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d52014-fa94-4cfb-817c-edd4e10e8e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:55.062782 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d52014-fa94-4cfb-817c-edd4e10e8e85 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:55.063265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d52014-fa94-4cfb-817c-edd4e10e8e85 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:55.063790 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d52014-fa94-4cfb-817c-edd4e10e8e85 None admin] PATH_INFO: `/v3/users/5bdeea17b84e4c4e841735f505cd12e5` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:55.065309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d52014-fa94-4cfb-817c-edd4e10e8e85 None admin] RBAC: Authorizing `identity:get_user(user_id=5bdeea17b84e4c4e841735f505cd12e5)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:55.067042 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d52014-fa94-4cfb-817c-edd4e10e8e85 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:55.068925 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 84/171] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:37:54 2022] GET /identity/v3/users/5bdeea17b84e4c4e841735f505cd12e5 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:55.069892 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d52014-fa94-4cfb-817c-edd4e10e8e85 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:55.082355 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:55.098614 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:55.195463 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f26c06-3d59-4d28-be7c-72bf60a2a4b7 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:55.233709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d52014-fa94-4cfb-817c-edd4e10e8e85 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:55.262230 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea48d43-29db-4c3e-8574-f17ceb1d0a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:55.263515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea48d43-29db-4c3e-8574-f17ceb1d0a30 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:55.264040 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea48d43-29db-4c3e-8574-f17ceb1d0a30 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:55.266057 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea48d43-29db-4c3e-8574-f17ceb1d0a30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:55.267000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea48d43-29db-4c3e-8574-f17ceb1d0a30 None admin] RBAC: Adding query filter params (role.id=093c83b316db4d0f9dc55ec6e3583ba8, scope.project.id=69881c0aa4374f1bb110e20848ec9e0b, user.id=5bdeea17b84e4c4e841735f505cd12e5) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:55.269115 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea48d43-29db-4c3e-8574-f17ceb1d0a30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:55.270776 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea48d43-29db-4c3e-8574-f17ceb1d0a30 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:55.285017 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 88/172] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:37:54 2022] GET /identity/v3/role_assignments?user.id=5bdeea17b84e4c4e841735f505cd12e5&scope.project.id=69881c0aa4374f1bb110e20848ec9e0b&role.id=093c83b316db4d0f9dc55ec6e3583ba8 => generated 608 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:55.293068 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea48d43-29db-4c3e-8574-f17ceb1d0a30 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:55.313126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2857b3-e04f-4b4d-8b6b-ff83d3181ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:55.314176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2857b3-e04f-4b4d-8b6b-ff83d3181ba8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:55.314753 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2857b3-e04f-4b4d-8b6b-ff83d3181ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:55.315354 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2857b3-e04f-4b4d-8b6b-ff83d3181ba8 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:55.316236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2857b3-e04f-4b4d-8b6b-ff83d3181ba8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:55.318288 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2857b3-e04f-4b4d-8b6b-ff83d3181ba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:55.320330 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2857b3-e04f-4b4d-8b6b-ff83d3181ba8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:55.350397 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 85/173] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:37:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:55.361497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2857b3-e04f-4b4d-8b6b-ff83d3181ba8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:55.478949 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea48d43-29db-4c3e-8574-f17ceb1d0a30 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:55.530583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:55.554845 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d217e67-f3a1-4cce-9261-d0a03b595f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:55.555877 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d217e67-f3a1-4cce-9261-d0a03b595f67 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:55.556361 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d217e67-f3a1-4cce-9261-d0a03b595f67 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:55.557002 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d217e67-f3a1-4cce-9261-d0a03b595f67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:55.588875 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:55.625111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2857b3-e04f-4b4d-8b6b-ff83d3181ba8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:55.694329 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9140c1-11cc-4a70-93a4-b10c43364bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:55.694961 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9140c1-11cc-4a70-93a4-b10c43364bb1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:55.695243 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9140c1-11cc-4a70-93a4-b10c43364bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:55.695521 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9140c1-11cc-4a70-93a4-b10c43364bb1 None admin] PATH_INFO: `/v3/users/8c7dd247a668409cb8ef9f1bcc9cb927` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:55.696865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9140c1-11cc-4a70-93a4-b10c43364bb1 None admin] RBAC: Authorizing `identity:get_user(user_id=8c7dd247a668409cb8ef9f1bcc9cb927)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:55.698512 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9140c1-11cc-4a70-93a4-b10c43364bb1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:55.700015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 86/174] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:37:55 2022] GET /identity/v3/users/8c7dd247a668409cb8ef9f1bcc9cb927 => generated 247 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:37:55.701096 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d217e67-f3a1-4cce-9261-d0a03b595f67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:55.702859 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d217e67-f3a1-4cce-9261-d0a03b595f67 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:55.708450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9140c1-11cc-4a70-93a4-b10c43364bb1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:55.829885 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 89/175] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:37:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:37:55.832786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0e20e-720f-40d5-bb16-d62c3654b335 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:55.833303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0e20e-720f-40d5-bb16-d62c3654b335 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:55.834041 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0e20e-720f-40d5-bb16-d62c3654b335 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:55.836118 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 90/176] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:55.837082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0e20e-720f-40d5-bb16-d62c3654b335 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:55.868872 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:55.884312 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9140c1-11cc-4a70-93a4-b10c43364bb1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:55.921867 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8fc6a-5d66-4361-85ef-209dd7240943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:55.922641 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8fc6a-5d66-4361-85ef-209dd7240943 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:55.923017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8fc6a-5d66-4361-85ef-209dd7240943 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:55.923403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8fc6a-5d66-4361-85ef-209dd7240943 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:55.934705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:55.965956 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0e20e-720f-40d5-bb16-d62c3654b335 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:55.999510 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8fc6a-5d66-4361-85ef-209dd7240943 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:56.001191 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8fc6a-5d66-4361-85ef-209dd7240943 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:56.007626 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0da20-e95d-49cd-a018-08cc024ec567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:56.008568 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0da20-e95d-49cd-a018-08cc024ec567 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:56.009035 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0da20-e95d-49cd-a018-08cc024ec567 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:56.009451 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0da20-e95d-49cd-a018-08cc024ec567 None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:56.010792 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0da20-e95d-49cd-a018-08cc024ec567 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad919f473ed42dba141f5a8838458b9)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:56.012598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0da20-e95d-49cd-a018-08cc024ec567 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:56.014928 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 91/177] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:37:55 2022] GET /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:56.016315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c776ba-da61-43ff-aaa2-7fdade8edde5 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:56.016818 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c776ba-da61-43ff-aaa2-7fdade8edde5 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:56.017234 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c776ba-da61-43ff-aaa2-7fdade8edde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:56.037615 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-38c776ba-da61-43ff-aaa2-7fdade8edde5 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:56.039182 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-38c776ba-da61-43ff-aaa2-7fdade8edde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:56.116155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 87/178] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:37:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 22:37:56.117625 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99417c28-ba4c-4c8b-8a78-300bbc958b41 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:56.118010 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99417c28-ba4c-4c8b-8a78-300bbc958b41 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:56.118381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99417c28-ba4c-4c8b-8a78-300bbc958b41 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:56.119878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 88/179] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:56.124409 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99417c28-ba4c-4c8b-8a78-300bbc958b41 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:56.129411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 92/180] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:56.130682 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c776ba-da61-43ff-aaa2-7fdade8edde5 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:56.176805 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:56.181163 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:56.268640 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99417c28-ba4c-4c8b-8a78-300bbc958b41 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:56.291764 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c776ba-da61-43ff-aaa2-7fdade8edde5 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:56.314822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54108c9-b75d-491d-a5c1-a1248c8b9d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:56.315617 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54108c9-b75d-491d-a5c1-a1248c8b9d8c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:56.316221 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54108c9-b75d-491d-a5c1-a1248c8b9d8c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:56.316523 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54108c9-b75d-491d-a5c1-a1248c8b9d8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:56.317538 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54108c9-b75d-491d-a5c1-a1248c8b9d8c None admin] RBAC: Adding query filter params (role.id=01a26dc2b1034e33af13752c154d24f4, scope.project.id=2ad919f473ed42dba141f5a8838458b9, user.id=5bdeea17b84e4c4e841735f505cd12e5) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:56.317847 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54108c9-b75d-491d-a5c1-a1248c8b9d8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:56.320126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54108c9-b75d-491d-a5c1-a1248c8b9d8c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:56.326685 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af768fc-83de-4b32-a58d-1f73fec16963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:56.327660 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af768fc-83de-4b32-a58d-1f73fec16963 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:56.327770 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 89/181] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:37:56 2022] GET /identity/v3/role_assignments?user.id=5bdeea17b84e4c4e841735f505cd12e5&scope.project.id=2ad919f473ed42dba141f5a8838458b9&role.id=01a26dc2b1034e33af13752c154d24f4 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:56.327846 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af768fc-83de-4b32-a58d-1f73fec16963 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:56.327974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af768fc-83de-4b32-a58d-1f73fec16963 None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:56.328956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f86765-94e6-40ff-b548-c9eb4252c502 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:56.329239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f86765-94e6-40ff-b548-c9eb4252c502 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:56.329447 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af768fc-83de-4b32-a58d-1f73fec16963 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad919f473ed42dba141f5a8838458b9)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:56.329554 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f86765-94e6-40ff-b548-c9eb4252c502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:56.331112 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af768fc-83de-4b32-a58d-1f73fec16963 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:56.333531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 93/182] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:37:56 2022] GET /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:56.334947 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc07617-4022-46ca-9513-199d6fe83219 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:56.335333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc07617-4022-46ca-9513-199d6fe83219 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:56.335707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc07617-4022-46ca-9513-199d6fe83219 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:56.337195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 94/183] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:56.344223 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d39c3f-8cf7-4dc0-986b-b29b8ddf8beb None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:56.344589 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d39c3f-8cf7-4dc0-986b-b29b8ddf8beb None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:56.344958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d39c3f-8cf7-4dc0-986b-b29b8ddf8beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:56.357848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c6f86765-94e6-40ff-b548-c9eb4252c502 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:56.359784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c6f86765-94e6-40ff-b548-c9eb4252c502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:56.365925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-78d39c3f-8cf7-4dc0-986b-b29b8ddf8beb None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:56.367330 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-78d39c3f-8cf7-4dc0-986b-b29b8ddf8beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:56.445133 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 90/184] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:56.446159 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f86765-94e6-40ff-b548-c9eb4252c502 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:56.484544 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:56.494488 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 95/185] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:56.495448 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d39c3f-8cf7-4dc0-986b-b29b8ddf8beb None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:56.517429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:56.617321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d39c3f-8cf7-4dc0-986b-b29b8ddf8beb None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:56.650377 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f86765-94e6-40ff-b548-c9eb4252c502 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:56.656935 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e97b1c-2fb6-4a71-a994-bbd21daa2906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:56.657586 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e97b1c-2fb6-4a71-a994-bbd21daa2906 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:56.657866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e97b1c-2fb6-4a71-a994-bbd21daa2906 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:56.658144 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e97b1c-2fb6-4a71-a994-bbd21daa2906 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:56.671644 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e97b1c-2fb6-4a71-a994-bbd21daa2906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:37:56.677493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-20e97b1c-2fb6-4a71-a994-bbd21daa2906 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:37:56.677493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:56.677493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:56.677493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:56.677493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:56.677493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:56.677493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:56.677493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:56.677493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:56.677493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:56.677493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:56.677493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:56.677493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:37:56.677493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:37:56.677493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:37:56.677493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:37:56.678380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:37:56.678380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:37:56.678380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:37:56.678380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:37:56.678380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:56.678380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:56.678380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:56.678380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:56.678380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:56.678380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:56.678380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:56.678380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:56.678380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:56.678380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:56.678380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:56.678380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:56.679192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:56.679192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:56.679192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:56.679192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:56.679192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:37:56.679192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:37:56.679192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:37:56.679192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:37:56.679192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:37:56.679192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:37:56.679192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:37:56.679192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:37:56.679192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 96/186] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:37:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:37:56.690830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e97b1c-2fb6-4a71-a994-bbd21daa2906 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:56.710376 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867575b0-3b2d-48d1-8c19-444b05cc87ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:56.710999 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867575b0-3b2d-48d1-8c19-444b05cc87ea None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:56.711272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867575b0-3b2d-48d1-8c19-444b05cc87ea None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:56.711595 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867575b0-3b2d-48d1-8c19-444b05cc87ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:56.712382 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867575b0-3b2d-48d1-8c19-444b05cc87ea None admin] RBAC: Adding query filter params (role.id=aa2332d1bdb74e48a88ed7c2a7ed2990, scope.project.id=2ad919f473ed42dba141f5a8838458b9, user.id=8c7dd247a668409cb8ef9f1bcc9cb927) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:56.712716 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867575b0-3b2d-48d1-8c19-444b05cc87ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:56.714232 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867575b0-3b2d-48d1-8c19-444b05cc87ea None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:56.720801 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 91/187] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:37:56 2022] GET /identity/v3/role_assignments?user.id=8c7dd247a668409cb8ef9f1bcc9cb927&scope.project.id=2ad919f473ed42dba141f5a8838458b9&role.id=aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:56.831406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:56.861805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e97b1c-2fb6-4a71-a994-bbd21daa2906 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:56.916879 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812bccd-cffa-4a5c-a65c-d8b5fd137c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:56.917424 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812bccd-cffa-4a5c-a65c-d8b5fd137c11 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:56.917829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812bccd-cffa-4a5c-a65c-d8b5fd137c11 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:56.917999 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812bccd-cffa-4a5c-a65c-d8b5fd137c11 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:56.918651 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812bccd-cffa-4a5c-a65c-d8b5fd137c11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:56.918951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812bccd-cffa-4a5c-a65c-d8b5fd137c11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:56.920385 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867575b0-3b2d-48d1-8c19-444b05cc87ea None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:56.920674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812bccd-cffa-4a5c-a65c-d8b5fd137c11 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:56.930562 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 97/188] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:37:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:37:56.931669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812bccd-cffa-4a5c-a65c-d8b5fd137c11 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:57.046862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:57.052839 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812bccd-cffa-4a5c-a65c-d8b5fd137c11 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:57.053024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867575b0-3b2d-48d1-8c19-444b05cc87ea None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:57.091941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cf8db-93f1-41e5-956b-bacc501bd6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:57.092621 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf8db-93f1-41e5-956b-bacc501bd6a0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:57.092904 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf8db-93f1-41e5-956b-bacc501bd6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:57.093176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf8db-93f1-41e5-956b-bacc501bd6a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:57.095528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fb083-104b-4bd0-8b68-1cd9cf42983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:57.096488 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fb083-104b-4bd0-8b68-1cd9cf42983a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:57.096768 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fb083-104b-4bd0-8b68-1cd9cf42983a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:57.097035 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fb083-104b-4bd0-8b68-1cd9cf42983a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:57.098181 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fb083-104b-4bd0-8b68-1cd9cf42983a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:57.099622 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fb083-104b-4bd0-8b68-1cd9cf42983a None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:57.101491 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 98/189] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:37:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:57.102131 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fb083-104b-4bd0-8b68-1cd9cf42983a None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:57.108470 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cf8db-93f1-41e5-956b-bacc501bd6a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:37:57.113435 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:57.113823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-8f7cf8db-93f1-41e5-956b-bacc501bd6a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:37:57.113823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:57.113823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:57.113823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:57.113823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:57.113823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:57.113823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:57.113823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:57.113823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:57.113823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:57.113823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:57.113823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:57.113823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:37:57.113823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:37:57.113823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:37:57.113823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:37:57.114700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:37:57.114700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:37:57.114700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:37:57.114700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:37:57.114700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:57.114700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:57.114700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:57.114700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:57.114700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:57.114700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:57.114700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:57.114700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:57.114700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:57.114700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:57.114700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:57.114700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:57.115517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:57.115517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:57.115517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:57.115517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:57.115517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:37:57.115517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:37:57.115517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:37:57.115517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:37:57.115517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:37:57.115517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:37:57.115517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:37:57.115517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:37:57.115517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 92/190] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:37:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:37:57.116171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cf8db-93f1-41e5-956b-bacc501bd6a0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:57.212475 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fb083-104b-4bd0-8b68-1cd9cf42983a None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:57.241730 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cf8db-93f1-41e5-956b-bacc501bd6a0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:57.250699 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd54f33-175f-4bcf-8d76-b05c4f9e2184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:57.251714 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd54f33-175f-4bcf-8d76-b05c4f9e2184 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:57.252006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd54f33-175f-4bcf-8d76-b05c4f9e2184 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:57.252285 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd54f33-175f-4bcf-8d76-b05c4f9e2184 None admin] PATH_INFO: `/v3/users/26baed18de1b41b4afb0006b41f40431` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:57.267623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd54f33-175f-4bcf-8d76-b05c4f9e2184 None admin] RBAC: Authorizing `identity:get_user(user_id=26baed18de1b41b4afb0006b41f40431)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:57.269768 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd54f33-175f-4bcf-8d76-b05c4f9e2184 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:57.271437 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 99/191] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:37:57 2022] GET /identity/v3/users/26baed18de1b41b4afb0006b41f40431 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:57.272155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd54f33-175f-4bcf-8d76-b05c4f9e2184 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:57.281729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db027259-2beb-4b33-800e-b90a14149aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:57.282347 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db027259-2beb-4b33-800e-b90a14149aae None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:57.282615 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db027259-2beb-4b33-800e-b90a14149aae None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:57.282893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db027259-2beb-4b33-800e-b90a14149aae None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:57.283540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db027259-2beb-4b33-800e-b90a14149aae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:57.285028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db027259-2beb-4b33-800e-b90a14149aae None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:57.339122 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:57.372250 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd54f33-175f-4bcf-8d76-b05c4f9e2184 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:57.375131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 93/192] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Sep 6 22:37:57 2022] POST /identity/v3/users => generated 297 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:37:57.385220 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db027259-2beb-4b33-800e-b90a14149aae None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:57.402813 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:57.414124 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986abbb-ed2f-4001-ad35-3a640ef4d263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:57.414767 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986abbb-ed2f-4001-ad35-3a640ef4d263 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:57.415052 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986abbb-ed2f-4001-ad35-3a640ef4d263 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:57.415325 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986abbb-ed2f-4001-ad35-3a640ef4d263 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:57.416016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986abbb-ed2f-4001-ad35-3a640ef4d263 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:57.416320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986abbb-ed2f-4001-ad35-3a640ef4d263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:57.417749 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986abbb-ed2f-4001-ad35-3a640ef4d263 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:57.427893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 100/193] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:37:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:57.429054 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dd10c-9cb7-4c89-ac44-3c3e9a0d2035 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:57.429354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dd10c-9cb7-4c89-ac44-3c3e9a0d2035 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:57.430543 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dd10c-9cb7-4c89-ac44-3c3e9a0d2035 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:57.431192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 101/194] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:37:57.436401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0dd10c-9cb7-4c89-ac44-3c3e9a0d2035 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:57.513904 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db027259-2beb-4b33-800e-b90a14149aae None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:57.550626 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0dd10c-9cb7-4c89-ac44-3c3e9a0d2035 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:57.553425 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a169a61-d6de-43d6-8a3c-aed09b69bfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:57.554053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a169a61-d6de-43d6-8a3c-aed09b69bfc0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:57.554339 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a169a61-d6de-43d6-8a3c-aed09b69bfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:57.554617 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a169a61-d6de-43d6-8a3c-aed09b69bfc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:57.585301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:57.593707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb46e0-bdc6-40dc-99a1-70691bb5e62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:57.594353 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb46e0-bdc6-40dc-99a1-70691bb5e62a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:57.594630 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb46e0-bdc6-40dc-99a1-70691bb5e62a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:57.594902 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb46e0-bdc6-40dc-99a1-70691bb5e62a None admin] PATH_INFO: `/v3/users/26baed18de1b41b4afb0006b41f40431` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:57.596028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb46e0-bdc6-40dc-99a1-70691bb5e62a None admin] RBAC: Authorizing `identity:get_user(user_id=26baed18de1b41b4afb0006b41f40431)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:57.597556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb46e0-bdc6-40dc-99a1-70691bb5e62a None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:57.599313 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 102/195] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:37:57 2022] GET /identity/v3/users/26baed18de1b41b4afb0006b41f40431 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:57.600268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b20a8-e3d9-43d4-a2a5-60a7bd6e9303 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:57.600633 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b20a8-e3d9-43d4-a2a5-60a7bd6e9303 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:57.600966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b20a8-e3d9-43d4-a2a5-60a7bd6e9303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:57.619526 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-776b20a8-e3d9-43d4-a2a5-60a7bd6e9303 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:37:57.620747 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-776b20a8-e3d9-43d4-a2a5-60a7bd6e9303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:37:57.635669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a169a61-d6de-43d6-8a3c-aed09b69bfc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:57.637189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a169a61-d6de-43d6-8a3c-aed09b69bfc0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:57.653010 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:57.712271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 103/196] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:37:57.713465 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b20a8-e3d9-43d4-a2a5-60a7bd6e9303 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:57.773570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 94/197] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:37:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:37:57.780343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a169a61-d6de-43d6-8a3c-aed09b69bfc0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:57.839987 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b20a8-e3d9-43d4-a2a5-60a7bd6e9303 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:57.869835 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:57.879263 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a624bc-cc90-4a7f-a82e-7324746b3828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:57.883884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a624bc-cc90-4a7f-a82e-7324746b3828 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:57.883884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a624bc-cc90-4a7f-a82e-7324746b3828 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:57.883884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a624bc-cc90-4a7f-a82e-7324746b3828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:57.919962 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a169a61-d6de-43d6-8a3c-aed09b69bfc0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:57.938499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:57.955205 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a624bc-cc90-4a7f-a82e-7324746b3828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:57.956871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a624bc-cc90-4a7f-a82e-7324746b3828 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:57.973450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125811f-2bb2-43a4-ad9e-d53d5b280df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:57.974107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125811f-2bb2-43a4-ad9e-d53d5b280df5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:57.974386 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125811f-2bb2-43a4-ad9e-d53d5b280df5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:57.974658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125811f-2bb2-43a4-ad9e-d53d5b280df5 None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:57.975856 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125811f-2bb2-43a4-ad9e-d53d5b280df5 None admin] RBAC: Authorizing `identity:get_project(project_id=b1baa713334143d9b2b624372a19f941)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:57.977372 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125811f-2bb2-43a4-ad9e-d53d5b280df5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:57.979021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 95/198] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:37:57 2022] GET /identity/v3/projects/b1baa713334143d9b2b624372a19f941 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:37:58.002363 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125811f-2bb2-43a4-ad9e-d53d5b280df5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:58.109688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 104/199] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:37:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:37:58.110757 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a624bc-cc90-4a7f-a82e-7324746b3828 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:58.133689 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125811f-2bb2-43a4-ad9e-d53d5b280df5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:58.139520 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:58.170916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8b58a-3624-4039-bc3b-c606f48076ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:58.171901 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8b58a-3624-4039-bc3b-c606f48076ee None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:58.172380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8b58a-3624-4039-bc3b-c606f48076ee None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:58.172876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8b58a-3624-4039-bc3b-c606f48076ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:58.173908 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8b58a-3624-4039-bc3b-c606f48076ee None admin] RBAC: Adding query filter params (role.id=aa2332d1bdb74e48a88ed7c2a7ed2990, scope.project.id=b1baa713334143d9b2b624372a19f941, user.id=26baed18de1b41b4afb0006b41f40431) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:58.174503 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8b58a-3624-4039-bc3b-c606f48076ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:58.176161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8b58a-3624-4039-bc3b-c606f48076ee None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:58.181795 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 96/200] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:37:58 2022] GET /identity/v3/role_assignments?user.id=26baed18de1b41b4afb0006b41f40431&scope.project.id=b1baa713334143d9b2b624372a19f941&role.id=aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:37:58.182920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8b58a-3624-4039-bc3b-c606f48076ee None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:58.229340 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a624bc-cc90-4a7f-a82e-7324746b3828 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:58.287521 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:58.293350 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8f327-83cc-4a6c-9d8e-d0ea418b592c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:58.294432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8f327-83cc-4a6c-9d8e-d0ea418b592c None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:58.294885 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8f327-83cc-4a6c-9d8e-d0ea418b592c None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:58.295308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8f327-83cc-4a6c-9d8e-d0ea418b592c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:58.308258 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8f327-83cc-4a6c-9d8e-d0ea418b592c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:37:58.314523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-e2c8f327-83cc-4a6c-9d8e-d0ea418b592c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 22:37:58.314523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:37:58.314523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:37:58.314523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:37:58.314523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:37:58.314523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:37:58.314523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:37:58.314523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:37:58.314523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:37:58.314523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:37:58.314523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:37:58.314523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:37:58.314523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:37:58.314523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:37:58.314523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:37:58.314523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:37:58.315484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:37:58.315484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:37:58.315484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:37:58.315484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:37:58.315484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:37:58.315484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:37:58.315484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:37:58.315484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:37:58.315484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:37:58.315484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:37:58.315484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:37:58.315484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:37:58.315484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:37:58.315484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:37:58.315484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:37:58.315484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:37:58.316290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:37:58.316290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:37:58.316290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:37:58.316290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:37:58.316290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:37:58.316290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:37:58.316290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:37:58.316290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:37:58.316290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:37:58.316290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:37:58.316290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 22:37:58.316290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:37:58.318546 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 105/201] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:37:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:37:58.324496 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8f327-83cc-4a6c-9d8e-d0ea418b592c None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:58.411782 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8b58a-3624-4039-bc3b-c606f48076ee None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:58.438148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:58.456833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8f327-83cc-4a6c-9d8e-d0ea418b592c None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:58.488048 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006d981-f34f-4a8b-a0ed-ad08e3f39bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:58.488985 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006d981-f34f-4a8b-a0ed-ad08e3f39bf2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:58.489400 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006d981-f34f-4a8b-a0ed-ad08e3f39bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:58.489830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006d981-f34f-4a8b-a0ed-ad08e3f39bf2 None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:58.494828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006d981-f34f-4a8b-a0ed-ad08e3f39bf2 None admin] RBAC: Authorizing `identity:get_project(project_id=b1baa713334143d9b2b624372a19f941)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:58.496475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006d981-f34f-4a8b-a0ed-ad08e3f39bf2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:58.498286 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 97/202] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:37:58 2022] GET /identity/v3/projects/b1baa713334143d9b2b624372a19f941 => generated 302 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:58.506015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006d981-f34f-4a8b-a0ed-ad08e3f39bf2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:58.533657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312e538-65d5-4893-a339-b2fe04957af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:58.534553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312e538-65d5-4893-a339-b2fe04957af0 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:58.534970 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312e538-65d5-4893-a339-b2fe04957af0 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:58.535378 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312e538-65d5-4893-a339-b2fe04957af0 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:58.536187 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312e538-65d5-4893-a339-b2fe04957af0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:58.536658 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312e538-65d5-4893-a339-b2fe04957af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:58.539814 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312e538-65d5-4893-a339-b2fe04957af0 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:58.556851 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 106/203] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:37:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:37:58.563005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312e538-65d5-4893-a339-b2fe04957af0 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:58.709487 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006d981-f34f-4a8b-a0ed-ad08e3f39bf2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:58.723878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:58.749637 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c97bb-5f73-4af5-b929-43a094014c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:58.750725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c97bb-5f73-4af5-b929-43a094014c71 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:58.751197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c97bb-5f73-4af5-b929-43a094014c71 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:58.751968 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c97bb-5f73-4af5-b929-43a094014c71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:58.753729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c97bb-5f73-4af5-b929-43a094014c71 None admin] RBAC: Adding query filter params (role.id=01a26dc2b1034e33af13752c154d24f4, scope.project.id=b1baa713334143d9b2b624372a19f941, user.id=26baed18de1b41b4afb0006b41f40431) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:58.754238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c97bb-5f73-4af5-b929-43a094014c71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:58.755870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c97bb-5f73-4af5-b929-43a094014c71 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:58.758540 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312e538-65d5-4893-a339-b2fe04957af0 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:58.762633 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 98/204] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:37:58 2022] GET /identity/v3/role_assignments?user.id=26baed18de1b41b4afb0006b41f40431&scope.project.id=b1baa713334143d9b2b624372a19f941&role.id=01a26dc2b1034e33af13752c154d24f4 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:58.847861 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855cbd3-f29f-4e8d-a8e9-9b64d6686a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:58.848569 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855cbd3-f29f-4e8d-a8e9-9b64d6686a08 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:58.848852 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855cbd3-f29f-4e8d-a8e9-9b64d6686a08 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:58.849127 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855cbd3-f29f-4e8d-a8e9-9b64d6686a08 None admin] PATH_INFO: `/v3/users/c7fa823d5f144a378671b1498a2e021e` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:58.851130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855cbd3-f29f-4e8d-a8e9-9b64d6686a08 None admin] RBAC: Authorizing `identity:get_user(user_id=c7fa823d5f144a378671b1498a2e021e)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:58.852710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855cbd3-f29f-4e8d-a8e9-9b64d6686a08 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:58.854544 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 107/205] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:37:58 2022] GET /identity/v3/users/c7fa823d5f144a378671b1498a2e021e => generated 289 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:58.860341 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c97bb-5f73-4af5-b929-43a094014c71 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:59.004320 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c97bb-5f73-4af5-b929-43a094014c71 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:59.050288 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ce8d0-e6a2-43f8-8576-4710dd1dc9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:59.051317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ce8d0-e6a2-43f8-8576-4710dd1dc9fc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:59.051838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ce8d0-e6a2-43f8-8576-4710dd1dc9fc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:59.052309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ce8d0-e6a2-43f8-8576-4710dd1dc9fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:59.124794 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:59.155800 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ce8d0-e6a2-43f8-8576-4710dd1dc9fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:59.157305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ce8d0-e6a2-43f8-8576-4710dd1dc9fc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:59.297014 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 99/206] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:37:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:37:59.303494 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855cbd3-f29f-4e8d-a8e9-9b64d6686a08 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:59.335157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:59.445949 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855cbd3-f29f-4e8d-a8e9-9b64d6686a08 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:59.486259 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37218f4e-23a2-406f-9d34-f9f08d073717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:59.487454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37218f4e-23a2-406f-9d34-f9f08d073717 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:59.487737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37218f4e-23a2-406f-9d34-f9f08d073717 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:59.488011 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37218f4e-23a2-406f-9d34-f9f08d073717 None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:59.489223 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37218f4e-23a2-406f-9d34-f9f08d073717 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad919f473ed42dba141f5a8838458b9)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:59.490673 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37218f4e-23a2-406f-9d34-f9f08d073717 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:59.496445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 108/207] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:37:59 2022] GET /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:37:59.498570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ce8d0-e6a2-43f8-8576-4710dd1dc9fc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:37:59.630440 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:59.655047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ce8d0-e6a2-43f8-8576-4710dd1dc9fc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:37:59.690808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd268a-9f5c-49a4-a317-35953f8bdaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:37:59.691774 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd268a-9f5c-49a4-a317-35953f8bdaa4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:37:59.692253 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd268a-9f5c-49a4-a317-35953f8bdaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:37:59.692935 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd268a-9f5c-49a4-a317-35953f8bdaa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:37:59.693939 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd268a-9f5c-49a4-a317-35953f8bdaa4 None admin] RBAC: Adding query filter params (role.id=ee530d022cde4038bd521a1bb5f5ba6f, scope.project.id=2ad919f473ed42dba141f5a8838458b9, user.id=c7fa823d5f144a378671b1498a2e021e) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:37:59.694670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd268a-9f5c-49a4-a317-35953f8bdaa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:37:59.696351 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd268a-9f5c-49a4-a317-35953f8bdaa4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:37:59.702511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 100/208] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:37:59 2022] GET /identity/v3/role_assignments?user.id=c7fa823d5f144a378671b1498a2e021e&scope.project.id=2ad919f473ed42dba141f5a8838458b9&role.id=ee530d022cde4038bd521a1bb5f5ba6f => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:00.147207 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baadee4-4eb5-4265-8ca8-ad95765fb45b None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:00.147889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baadee4-4eb5-4265-8ca8-ad95765fb45b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:00.148382 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baadee4-4eb5-4265-8ca8-ad95765fb45b None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:00.149998 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 109/209] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:00.159351 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84861802-27f9-4185-ab1d-981cf2eb5a22 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:00.160758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84861802-27f9-4185-ab1d-981cf2eb5a22 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:00.161476 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84861802-27f9-4185-ab1d-981cf2eb5a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:00.181363 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-84861802-27f9-4185-ab1d-981cf2eb5a22 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:00.182975 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-84861802-27f9-4185-ab1d-981cf2eb5a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:00.258393 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 101/210] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 22:38:00.369869 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd7c91-81f0-4044-bbaa-bb673c3c5bba None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:00.370159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd7c91-81f0-4044-bbaa-bb673c3c5bba None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:00.370357 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd7c91-81f0-4044-bbaa-bb673c3c5bba None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:00.371859 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 110/211] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:00.378632 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72bcde-ca63-45cb-a2fe-59705dc49013 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:00.378919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72bcde-ca63-45cb-a2fe-59705dc49013 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:00.379196 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72bcde-ca63-45cb-a2fe-59705dc49013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:00.401155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4e72bcde-ca63-45cb-a2fe-59705dc49013 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:00.402345 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4e72bcde-ca63-45cb-a2fe-59705dc49013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:00.475744 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:00.482885 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 102/212] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:00.572107 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd7c91-81f0-4044-bbaa-bb673c3c5bba None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:00.652507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9a398-0560-4e72-9154-aff11b3b3164 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:00.652808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9a398-0560-4e72-9154-aff11b3b3164 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:00.653004 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9a398-0560-4e72-9154-aff11b3b3164 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:00.654616 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 103/213] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:00.660016 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c6460-9fda-49a3-9a09-6b3f795932c3 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:00.660300 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c6460-9fda-49a3-9a09-6b3f795932c3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:00.660621 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c6460-9fda-49a3-9a09-6b3f795932c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:00.672773 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:00.679044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-652c6460-9fda-49a3-9a09-6b3f795932c3 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:00.680345 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-652c6460-9fda-49a3-9a09-6b3f795932c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:00.680488 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd7c91-81f0-4044-bbaa-bb673c3c5bba None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:00.725296 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafb158-64d0-4974-b58d-6675476bff5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:00.725937 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafb158-64d0-4974-b58d-6675476bff5b None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:00.726636 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafb158-64d0-4974-b58d-6675476bff5b None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:00.726911 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafb158-64d0-4974-b58d-6675476bff5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:00.740109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafb158-64d0-4974-b58d-6675476bff5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:00.746985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-afafb158-64d0-4974-b58d-6675476bff5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:00.746985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:00.746985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:00.746985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:00.746985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:00.746985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:00.746985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:00.746985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:00.746985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:00.746985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:00.746985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:00.746985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:00.746985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:00.746985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:00.746985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:00.746985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:00.747922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:00.747922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:00.747922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:00.747922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:00.747922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:00.747922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:00.747922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:00.747922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:00.747922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:00.747922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:00.747922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:00.747922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:00.747922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:00.747922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:00.747922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:00.747922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:00.748809 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:00.748809 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:00.748809 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:00.748809 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:00.748809 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:00.748809 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:00.748809 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:00.748809 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:00.748809 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:00.748809 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:00.748809 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:00.748809 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:00.748809 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 111/214] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:00.755599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafb158-64d0-4974-b58d-6675476bff5b None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:00.759927 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 104/215] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 22:38:00.765428 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c6460-9fda-49a3-9a09-6b3f795932c3 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:00.872932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c6460-9fda-49a3-9a09-6b3f795932c3 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:00.873808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafb158-64d0-4974-b58d-6675476bff5b None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:00.902410 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:00.909183 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9611247-a8ae-4f3d-8f04-c877dbb83af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:00.909467 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9611247-a8ae-4f3d-8f04-c877dbb83af6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:00.909748 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9611247-a8ae-4f3d-8f04-c877dbb83af6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:00.910227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9611247-a8ae-4f3d-8f04-c877dbb83af6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:00.911484 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9611247-a8ae-4f3d-8f04-c877dbb83af6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:00.912985 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9611247-a8ae-4f3d-8f04-c877dbb83af6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:00.913333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320abfe-219e-49f5-8766-955f469f0b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:00.916680 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320abfe-219e-49f5-8766-955f469f0b7a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:00.916842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 105/216] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:00.916979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320abfe-219e-49f5-8766-955f469f0b7a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:00.916979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320abfe-219e-49f5-8766-955f469f0b7a None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:00.916979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320abfe-219e-49f5-8766-955f469f0b7a None admin] RBAC: Adding query filter params (name=member) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:00.917589 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320abfe-219e-49f5-8766-955f469f0b7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:00.919140 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320abfe-219e-49f5-8766-955f469f0b7a None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:00.920854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9611247-a8ae-4f3d-8f04-c877dbb83af6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:00.930309 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 112/217] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:38:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:00.941621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320abfe-219e-49f5-8766-955f469f0b7a None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:00.953675 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:01.035668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9611247-a8ae-4f3d-8f04-c877dbb83af6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:01.070171 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320abfe-219e-49f5-8766-955f469f0b7a None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:01.072740 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6c991-20ce-4d4e-bb39-300b15bff473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:01.073361 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6c991-20ce-4d4e-bb39-300b15bff473 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:01.073633 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6c991-20ce-4d4e-bb39-300b15bff473 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:01.073904 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6c991-20ce-4d4e-bb39-300b15bff473 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:01.074553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6c991-20ce-4d4e-bb39-300b15bff473 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:01.076007 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6c991-20ce-4d4e-bb39-300b15bff473 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:01.109723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83f14a-a89e-4a37-803e-e42fd2db5631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:01.110514 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83f14a-a89e-4a37-803e-e42fd2db5631 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:01.110991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83f14a-a89e-4a37-803e-e42fd2db5631 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:01.111491 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83f14a-a89e-4a37-803e-e42fd2db5631 None admin] PATH_INFO: `/v3/users/ca13d0fc593c4616af8bc27a303dfe4b` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:01.127542 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83f14a-a89e-4a37-803e-e42fd2db5631 None admin] RBAC: Authorizing `identity:get_user(user_id=ca13d0fc593c4616af8bc27a303dfe4b)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:01.129220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83f14a-a89e-4a37-803e-e42fd2db5631 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:01.130922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 113/218] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:38:00 2022] GET /identity/v3/users/ca13d0fc593c4616af8bc27a303dfe4b => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:01.130922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83f14a-a89e-4a37-803e-e42fd2db5631 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:01.170641 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 106/219] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Sep 6 22:38:00 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:38:01.171412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6c991-20ce-4d4e-bb39-300b15bff473 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:01.224551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:01.255543 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:01.273354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83f14a-a89e-4a37-803e-e42fd2db5631 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:01.317180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4e446-c5bc-4b9a-970e-3a026b9eeed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:01.318249 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4e446-c5bc-4b9a-970e-3a026b9eeed1 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:01.318757 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4e446-c5bc-4b9a-970e-3a026b9eeed1 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:01.319277 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4e446-c5bc-4b9a-970e-3a026b9eeed1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:01.326449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6c991-20ce-4d4e-bb39-300b15bff473 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:01.332940 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4e446-c5bc-4b9a-970e-3a026b9eeed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:01.338646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-5dd4e446-c5bc-4b9a-970e-3a026b9eeed1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:38:01.338646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:01.338646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:01.338646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:01.338646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:01.338646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:01.338646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:01.338646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:01.338646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:01.338646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:01.338646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:01.338646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:01.338646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:01.338646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:01.338646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:01.338646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:01.339789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:01.339789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:01.339789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:01.339789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:01.339789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:01.339789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:01.339789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:01.339789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:01.339789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:01.339789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:01.339789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:01.339789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:01.339789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:01.339789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:01.339789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:01.339789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:01.340748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:01.340748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:01.340748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:01.340748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:01.340748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:01.340748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:01.340748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:01.340748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:01.340748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:01.340748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:01.340748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:38:01.340748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:01.342371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 114/220] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:38:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:01.345860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d184e32-8e9c-418b-ab90-01eaae5a02ce None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:01.346649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d184e32-8e9c-418b-ab90-01eaae5a02ce None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:01.346925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d184e32-8e9c-418b-ab90-01eaae5a02ce None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:01.349286 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 115/221] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:01.353560 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d184e32-8e9c-418b-ab90-01eaae5a02ce None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:01.371016 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1019e9-504e-4c7f-989e-03d19d7e09c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:01.371664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1019e9-504e-4c7f-989e-03d19d7e09c9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:01.371943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1019e9-504e-4c7f-989e-03d19d7e09c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:01.372217 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1019e9-504e-4c7f-989e-03d19d7e09c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:01.454448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1019e9-504e-4c7f-989e-03d19d7e09c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:01.456624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1019e9-504e-4c7f-989e-03d19d7e09c9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:01.481878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d184e32-8e9c-418b-ab90-01eaae5a02ce None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:01.515483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:01.528314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e47c2-f4b4-45b7-bd90-ca787a11321d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:01.529106 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e47c2-f4b4-45b7-bd90-ca787a11321d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:01.529386 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e47c2-f4b4-45b7-bd90-ca787a11321d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:01.529658 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e47c2-f4b4-45b7-bd90-ca787a11321d None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:01.530163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:01.530522 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e47c2-f4b4-45b7-bd90-ca787a11321d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:01.530974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e47c2-f4b4-45b7-bd90-ca787a11321d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:01.534019 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e47c2-f4b4-45b7-bd90-ca787a11321d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:01.542280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 116/222] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:01.543518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6faa96-0af0-4308-a8fa-4db44a4e98b1 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:01.543776 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6faa96-0af0-4308-a8fa-4db44a4e98b1 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:01.544058 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6faa96-0af0-4308-a8fa-4db44a4e98b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:01.562355 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-cc6faa96-0af0-4308-a8fa-4db44a4e98b1 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:01.563566 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-cc6faa96-0af0-4308-a8fa-4db44a4e98b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:01.584218 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 107/223] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:01.584987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1019e9-504e-4c7f-989e-03d19d7e09c9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:01.640391 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 117/224] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:01.642038 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6faa96-0af0-4308-a8fa-4db44a4e98b1 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:01.687971 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1019e9-504e-4c7f-989e-03d19d7e09c9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:01.756984 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0103b5-36a8-4acc-badc-81885f3d0d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:01.758951 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0103b5-36a8-4acc-badc-81885f3d0d3e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:01.758951 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0103b5-36a8-4acc-badc-81885f3d0d3e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:01.758951 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0103b5-36a8-4acc-badc-81885f3d0d3e None admin] PATH_INFO: `/v3/users/26baed18de1b41b4afb0006b41f40431` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:01.760369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0103b5-36a8-4acc-badc-81885f3d0d3e None admin] RBAC: Authorizing `identity:get_user(user_id=26baed18de1b41b4afb0006b41f40431)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:01.762379 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0103b5-36a8-4acc-badc-81885f3d0d3e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:01.764585 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 108/225] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:38:01 2022] GET /identity/v3/users/26baed18de1b41b4afb0006b41f40431 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:01.771044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0103b5-36a8-4acc-badc-81885f3d0d3e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:01.773569 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6faa96-0af0-4308-a8fa-4db44a4e98b1 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:01.804253 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:01.828816 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:01.841190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabc042-a9fe-48af-be82-07fa1f58cd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:01.841888 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabc042-a9fe-48af-be82-07fa1f58cd29 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:01.842218 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabc042-a9fe-48af-be82-07fa1f58cd29 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:01.842496 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabc042-a9fe-48af-be82-07fa1f58cd29 None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:01.843812 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabc042-a9fe-48af-be82-07fa1f58cd29 None admin] RBAC: Authorizing `identity:get_project(project_id=b1baa713334143d9b2b624372a19f941)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:01.845357 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabc042-a9fe-48af-be82-07fa1f58cd29 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:01.847129 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 118/226] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:01 2022] GET /identity/v3/projects/b1baa713334143d9b2b624372a19f941 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:01.853276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabc042-a9fe-48af-be82-07fa1f58cd29 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:01.957082 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0103b5-36a8-4acc-badc-81885f3d0d3e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:02.000716 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca535a2-afbf-430e-bee0-049c2c2c616d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:02.001758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca535a2-afbf-430e-bee0-049c2c2c616d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:02.002713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca535a2-afbf-430e-bee0-049c2c2c616d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:02.003280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca535a2-afbf-430e-bee0-049c2c2c616d None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:02.005229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca535a2-afbf-430e-bee0-049c2c2c616d None admin] RBAC: Authorizing `identity:get_project(project_id=b1baa713334143d9b2b624372a19f941)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:02.007507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca535a2-afbf-430e-bee0-049c2c2c616d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:02.009482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 109/227] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:01 2022] GET /identity/v3/projects/b1baa713334143d9b2b624372a19f941 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:02.010047 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabc042-a9fe-48af-be82-07fa1f58cd29 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:02.010434 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca535a2-afbf-430e-bee0-049c2c2c616d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:02.048276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9768b-ac60-40f3-a7de-6d6589133916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:02.049599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9768b-ac60-40f3-a7de-6d6589133916 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:02.049978 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9768b-ac60-40f3-a7de-6d6589133916 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:02.050351 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9768b-ac60-40f3-a7de-6d6589133916 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:02.051181 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9768b-ac60-40f3-a7de-6d6589133916 None admin] RBAC: Adding query filter params (role.id=093c83b316db4d0f9dc55ec6e3583ba8, scope.project.id=b1baa713334143d9b2b624372a19f941, user.id=ca13d0fc593c4616af8bc27a303dfe4b) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:02.051591 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9768b-ac60-40f3-a7de-6d6589133916 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:02.053142 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9768b-ac60-40f3-a7de-6d6589133916 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:02.065075 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 119/228] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:38:01 2022] GET /identity/v3/role_assignments?user.id=ca13d0fc593c4616af8bc27a303dfe4b&scope.project.id=b1baa713334143d9b2b624372a19f941&role.id=093c83b316db4d0f9dc55ec6e3583ba8 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:02.066240 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9768b-ac60-40f3-a7de-6d6589133916 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:02.126803 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:02.138342 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca535a2-afbf-430e-bee0-049c2c2c616d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:02.171590 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:02.177218 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149975f-63fc-4b9c-9bc5-2faf3ef627e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:02.177911 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149975f-63fc-4b9c-9bc5-2faf3ef627e9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:02.178134 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149975f-63fc-4b9c-9bc5-2faf3ef627e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:02.178388 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149975f-63fc-4b9c-9bc5-2faf3ef627e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:02.191695 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149975f-63fc-4b9c-9bc5-2faf3ef627e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:02.196765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-2149975f-63fc-4b9c-9bc5-2faf3ef627e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:38:02.196765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:02.196765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:02.196765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:02.196765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:02.196765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:02.196765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:02.196765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:02.196765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:02.196765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:02.196765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:02.196765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:02.196765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:02.196765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:02.196765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:02.196765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:02.198762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:02.198762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:02.198762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:02.198762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:02.198762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:02.198762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:02.198762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:02.198762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:02.198762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:02.198762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:02.198762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:02.198762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:02.198762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:02.198762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:02.198762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:02.198762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:02.200553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:02.200553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:02.200553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:02.200553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:02.200553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:02.200553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:02.200553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:02.200553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:02.200553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:02.200553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:02.200553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:38:02.200553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:02.200553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 110/229] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:38:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:02.209710 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149975f-63fc-4b9c-9bc5-2faf3ef627e9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:02.247144 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9768b-ac60-40f3-a7de-6d6589133916 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:02.305514 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc7eee-104d-47b1-93f2-b9134da35baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:02.306128 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc7eee-104d-47b1-93f2-b9134da35baa None admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:02.306408 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc7eee-104d-47b1-93f2-b9134da35baa None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:02.306685 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc7eee-104d-47b1-93f2-b9134da35baa None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941/users/26baed18de1b41b4afb0006b41f40431/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:02.311223 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc7eee-104d-47b1-93f2-b9134da35baa None admin] RBAC: Authorizing `identity:create_grant(project_id=b1baa713334143d9b2b624372a19f941, user_id=26baed18de1b41b4afb0006b41f40431, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:02.312790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc7eee-104d-47b1-93f2-b9134da35baa None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:02.380983 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 120/230] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:38:02 2022] PUT /identity/v3/projects/b1baa713334143d9b2b624372a19f941/users/26baed18de1b41b4afb0006b41f40431/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:38:02.395850 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149975f-63fc-4b9c-9bc5-2faf3ef627e9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:02.439019 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af3cd5-eedc-47e0-81dc-538eb67ba5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:02.439772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af3cd5-eedc-47e0-81dc-538eb67ba5f6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:02.440058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af3cd5-eedc-47e0-81dc-538eb67ba5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:02.440333 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af3cd5-eedc-47e0-81dc-538eb67ba5f6 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:02.441115 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af3cd5-eedc-47e0-81dc-538eb67ba5f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:02.441422 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af3cd5-eedc-47e0-81dc-538eb67ba5f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:02.442932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af3cd5-eedc-47e0-81dc-538eb67ba5f6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:02.453192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 111/231] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:02.459013 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc7eee-104d-47b1-93f2-b9134da35baa None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:02.625153 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc7eee-104d-47b1-93f2-b9134da35baa None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:02.634636 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:02.666392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b44b4-f603-4442-b1f3-47e45b8225ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:02.667116 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b44b4-f603-4442-b1f3-47e45b8225ed None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:02.667320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b44b4-f603-4442-b1f3-47e45b8225ed None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:02.667597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b44b4-f603-4442-b1f3-47e45b8225ed None admin] PATH_INFO: `/v3/users/26baed18de1b41b4afb0006b41f40431` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:02.668826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b44b4-f603-4442-b1f3-47e45b8225ed None admin] RBAC: Authorizing `identity:get_user(user_id=26baed18de1b41b4afb0006b41f40431)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:02.670279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b44b4-f603-4442-b1f3-47e45b8225ed None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:02.671942 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 121/232] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:38:02 2022] GET /identity/v3/users/26baed18de1b41b4afb0006b41f40431 => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:02.678216 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af3cd5-eedc-47e0-81dc-538eb67ba5f6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:02.699413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:02.804559 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af3cd5-eedc-47e0-81dc-538eb67ba5f6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:02.851989 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604d02d-f655-4a27-9d2f-d820566ac304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:02.852673 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d02d-f655-4a27-9d2f-d820566ac304 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:02.852959 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d02d-f655-4a27-9d2f-d820566ac304 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:02.853235 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d02d-f655-4a27-9d2f-d820566ac304 None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:02.854394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604d02d-f655-4a27-9d2f-d820566ac304 None admin] RBAC: Authorizing `identity:get_project(project_id=b1baa713334143d9b2b624372a19f941)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:02.855868 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604d02d-f655-4a27-9d2f-d820566ac304 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:02.857674 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 112/233] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:02 2022] GET /identity/v3/projects/b1baa713334143d9b2b624372a19f941 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:02.863968 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b44b4-f603-4442-b1f3-47e45b8225ed None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:03.001771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b44b4-f603-4442-b1f3-47e45b8225ed None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:03.042443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f20c04-d76c-4831-b695-be61024e31e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:03.043118 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f20c04-d76c-4831-b695-be61024e31e8 None admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:03.043396 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f20c04-d76c-4831-b695-be61024e31e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:03.043670 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f20c04-d76c-4831-b695-be61024e31e8 None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941/users/26baed18de1b41b4afb0006b41f40431/roles/01a26dc2b1034e33af13752c154d24f4` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:03.045878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f20c04-d76c-4831-b695-be61024e31e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1baa713334143d9b2b624372a19f941, user_id=26baed18de1b41b4afb0006b41f40431, role_id=01a26dc2b1034e33af13752c154d24f4)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:03.047387 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f20c04-d76c-4831-b695-be61024e31e8 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:03.152518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 122/234] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:38:02 2022] PUT /identity/v3/projects/b1baa713334143d9b2b624372a19f941/users/26baed18de1b41b4afb0006b41f40431/roles/01a26dc2b1034e33af13752c154d24f4 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:38:03.786500 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf46de-8e11-4e81-9962-71d1e01c1109 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:03.787055 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf46de-8e11-4e81-9962-71d1e01c1109 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:03.787055 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf46de-8e11-4e81-9962-71d1e01c1109 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:03.788628 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 113/235] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:03.794511 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb90ce5-aebf-4463-a7b8-ba3be7d5e6a3 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:03.795012 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb90ce5-aebf-4463-a7b8-ba3be7d5e6a3 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:03.795125 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb90ce5-aebf-4463-a7b8-ba3be7d5e6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:03.825506 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-7bb90ce5-aebf-4463-a7b8-ba3be7d5e6a3 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:03.826734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7bb90ce5-aebf-4463-a7b8-ba3be7d5e6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:03.860712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:03.913835 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 123/236] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:03.955091 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede86b8-18e3-4e34-9f10-2019be3bc143 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:03.955452 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede86b8-18e3-4e34-9f10-2019be3bc143 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:03.955657 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede86b8-18e3-4e34-9f10-2019be3bc143 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:03.957457 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 114/237] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:03.962871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d28b30-8f68-441b-9720-4f361693885a None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:03.963167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d28b30-8f68-441b-9720-4f361693885a None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:03.963448 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d28b30-8f68-441b-9720-4f361693885a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:03.982449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-02d28b30-8f68-441b-9720-4f361693885a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:03.983639 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-02d28b30-8f68-441b-9720-4f361693885a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:04.074904 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 124/238] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:04.315494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede86b8-18e3-4e34-9f10-2019be3bc143 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:04.427064 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:04.453941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede86b8-18e3-4e34-9f10-2019be3bc143 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:04.498744 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d28b30-8f68-441b-9720-4f361693885a None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:04.502391 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7065a-76fb-49e9-b7b7-fa1cd3067ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:04.503040 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7065a-76fb-49e9-b7b7-fa1cd3067ed5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:04.503317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7065a-76fb-49e9-b7b7-fa1cd3067ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:04.503589 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7065a-76fb-49e9-b7b7-fa1cd3067ed5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:04.521911 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7065a-76fb-49e9-b7b7-fa1cd3067ed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:04.526711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-98e7065a-76fb-49e9-b7b7-fa1cd3067ed5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 22:38:04.526711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:04.526711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:04.526711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:04.526711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:04.526711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:04.526711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:04.526711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:04.526711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:04.526711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:04.526711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:04.526711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:04.526711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:04.526711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:04.526711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:04.526711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:04.527607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:04.527607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:04.527607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:04.527607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:04.527607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:04.527607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:04.527607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:04.527607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:04.527607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:04.527607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:04.527607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:04.527607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:04.527607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:04.527607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:04.527607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:04.527607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:04.528441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:04.528441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:04.528441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:04.528441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:04.528441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:04.528441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:04.528441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:04.528441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:04.528441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:04.528441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:04.528441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 22:38:04.528441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:04.528441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 115/239] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:04.535114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7065a-76fb-49e9-b7b7-fa1cd3067ed5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:04.608570 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:04.619454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d28b30-8f68-441b-9720-4f361693885a None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:04.693701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7065a-76fb-49e9-b7b7-fa1cd3067ed5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:04.733518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017133c1-1fd0-477d-a4db-41b8763769eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:04.734156 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017133c1-1fd0-477d-a4db-41b8763769eb None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:04.734435 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017133c1-1fd0-477d-a4db-41b8763769eb None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:04.734708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017133c1-1fd0-477d-a4db-41b8763769eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:04.736797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017133c1-1fd0-477d-a4db-41b8763769eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:04.738246 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017133c1-1fd0-477d-a4db-41b8763769eb None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:04.739824 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 125/240] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:04.741812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0f1f5-de0c-42e7-b935-ca9b10210c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:04.742432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0f1f5-de0c-42e7-b935-ca9b10210c6f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:04.742703 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0f1f5-de0c-42e7-b935-ca9b10210c6f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:04.742971 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0f1f5-de0c-42e7-b935-ca9b10210c6f None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:04.743642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0f1f5-de0c-42e7-b935-ca9b10210c6f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:04.743942 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0f1f5-de0c-42e7-b935-ca9b10210c6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:04.745332 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0f1f5-de0c-42e7-b935-ca9b10210c6f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:04.747663 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017133c1-1fd0-477d-a4db-41b8763769eb None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:04.763051 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 116/241] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:38:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:04.764330 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f13a20-6920-4ffd-b569-1de33d48ae2d None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:04.764646 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f13a20-6920-4ffd-b569-1de33d48ae2d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:04.764922 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f13a20-6920-4ffd-b569-1de33d48ae2d None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:04.766380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 117/242] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:04.771564 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f13a20-6920-4ffd-b569-1de33d48ae2d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:04.774385 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:04.861565 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017133c1-1fd0-477d-a4db-41b8763769eb None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:04.878491 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f13a20-6920-4ffd-b569-1de33d48ae2d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:04.899295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9266469-e5a9-4a41-8c33-55c8dbef66e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:04.900240 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9266469-e5a9-4a41-8c33-55c8dbef66e3 None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:04.900744 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9266469-e5a9-4a41-8c33-55c8dbef66e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:04.901204 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9266469-e5a9-4a41-8c33-55c8dbef66e3 None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:04.902030 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9266469-e5a9-4a41-8c33-55c8dbef66e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:04.903843 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9266469-e5a9-4a41-8c33-55c8dbef66e3 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:04.914661 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd219f6-ed30-4125-ab74-5b887c1fa7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:04.915301 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd219f6-ed30-4125-ab74-5b887c1fa7f7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:04.915638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd219f6-ed30-4125-ab74-5b887c1fa7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:04.915924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd219f6-ed30-4125-ab74-5b887c1fa7f7 None admin] PATH_INFO: `/v3/users/ce8582ed42f44395be2d42253a419beb` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:04.931630 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd219f6-ed30-4125-ab74-5b887c1fa7f7 None admin] RBAC: Authorizing `identity:get_user(user_id=ce8582ed42f44395be2d42253a419beb)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:04.933121 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd219f6-ed30-4125-ab74-5b887c1fa7f7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:04.937656 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 118/243] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:38:04 2022] GET /identity/v3/users/ce8582ed42f44395be2d42253a419beb => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:04.937656 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e9208-e2ee-46f1-9dbc-8997f5fafdc9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:04.937656 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e9208-e2ee-46f1-9dbc-8997f5fafdc9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:04.937656 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e9208-e2ee-46f1-9dbc-8997f5fafdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:04.957063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-5c4e9208-e2ee-46f1-9dbc-8997f5fafdc9 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:04.958581 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5c4e9208-e2ee-46f1-9dbc-8997f5fafdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:05.021604 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:05.026134 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 126/244] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Sep 6 22:38:04 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:38:05.027616 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9266469-e5a9-4a41-8c33-55c8dbef66e3 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:05.034555 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 119/245] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:05.108880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:05.232500 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9266469-e5a9-4a41-8c33-55c8dbef66e3 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:05.278116 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ee5db-962b-4877-b541-4fbb6b2662e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:05.278747 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ee5db-962b-4877-b541-4fbb6b2662e3 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:05.279031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ee5db-962b-4877-b541-4fbb6b2662e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:05.279307 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ee5db-962b-4877-b541-4fbb6b2662e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:05.364016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ee5db-962b-4877-b541-4fbb6b2662e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:05.365886 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ee5db-962b-4877-b541-4fbb6b2662e3 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:05.374003 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e9208-e2ee-46f1-9dbc-8997f5fafdc9 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:05.394863 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:05.498642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e9208-e2ee-46f1-9dbc-8997f5fafdc9 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:05.499294 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 127/246] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:05.500780 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f4fd1-fa94-4bfc-9dbb-4db6b1f5441d None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:05.501288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f4fd1-fa94-4bfc-9dbb-4db6b1f5441d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:05.502279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f4fd1-fa94-4bfc-9dbb-4db6b1f5441d None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:05.503723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 128/247] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:05.511926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a7e22-cd94-4793-b0a6-c2888f4a4582 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:05.512218 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a7e22-cd94-4793-b0a6-c2888f4a4582 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:05.512534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a7e22-cd94-4793-b0a6-c2888f4a4582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:05.532990 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-460a7e22-cd94-4793-b0a6-c2888f4a4582 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:05.533507 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-460a7e22-cd94-4793-b0a6-c2888f4a4582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:05.543470 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17240098-7193-48c6-9b59-fd3811dce72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:05.544484 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17240098-7193-48c6-9b59-fd3811dce72d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:05.544829 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17240098-7193-48c6-9b59-fd3811dce72d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:05.545105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17240098-7193-48c6-9b59-fd3811dce72d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:05.556576 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17240098-7193-48c6-9b59-fd3811dce72d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:05.568012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-17240098-7193-48c6-9b59-fd3811dce72d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:05.568012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:05.568012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:05.568012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:05.568012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:05.568012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:05.568012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:05.568012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:05.568012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:05.568012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:05.568012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:05.568012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:05.568012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:05.568012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:05.568012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:05.568012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:05.569000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:05.569000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:05.569000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:05.569000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:05.569000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:05.569000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:05.569000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:05.569000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:05.569000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:05.569000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:05.569000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:05.569000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:05.569000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:05.569000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:05.569000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:05.569000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:05.569816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:05.569816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:05.569816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:05.569816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:05.569816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:05.569816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:05.569816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:05.569816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:05.569816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:05.569816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:05.569816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:05.569816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:05.572582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 120/248] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:38:05.573648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17240098-7193-48c6-9b59-fd3811dce72d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:05.635144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:05.645400 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 129/249] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:05.655110 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a7e22-cd94-4793-b0a6-c2888f4a4582 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:05.687299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17240098-7193-48c6-9b59-fd3811dce72d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:05.702580 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:05.724152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d404343-46ad-475b-9789-0e23683ffdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:05.724822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d404343-46ad-475b-9789-0e23683ffdb6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:05.725100 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d404343-46ad-475b-9789-0e23683ffdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:05.725370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d404343-46ad-475b-9789-0e23683ffdb6 None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:05.726525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d404343-46ad-475b-9789-0e23683ffdb6 None admin] RBAC: Authorizing `identity:get_project(project_id=b1baa713334143d9b2b624372a19f941)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:05.727986 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d404343-46ad-475b-9789-0e23683ffdb6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:05.729680 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 121/250] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:05 2022] GET /identity/v3/projects/b1baa713334143d9b2b624372a19f941 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:05.735626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d404343-46ad-475b-9789-0e23683ffdb6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:05.759162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a7e22-cd94-4793-b0a6-c2888f4a4582 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:05.799962 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca5bfc-9208-4ad8-8b2f-018f0e733367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:05.800627 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca5bfc-9208-4ad8-8b2f-018f0e733367 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:05.800937 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca5bfc-9208-4ad8-8b2f-018f0e733367 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:05.801283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca5bfc-9208-4ad8-8b2f-018f0e733367 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:05.802118 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca5bfc-9208-4ad8-8b2f-018f0e733367 None admin] RBAC: Adding query filter params (name=member) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:05.802427 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca5bfc-9208-4ad8-8b2f-018f0e733367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:05.803805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca5bfc-9208-4ad8-8b2f-018f0e733367 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:05.813405 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 130/251] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:38:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:05.819806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca5bfc-9208-4ad8-8b2f-018f0e733367 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:05.844506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d404343-46ad-475b-9789-0e23683ffdb6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:05.863205 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:05.881573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec71229-4aba-40db-b5cd-cda1aba4b504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:05.882290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec71229-4aba-40db-b5cd-cda1aba4b504 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:05.890664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec71229-4aba-40db-b5cd-cda1aba4b504 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:05.890664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec71229-4aba-40db-b5cd-cda1aba4b504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:05.890664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec71229-4aba-40db-b5cd-cda1aba4b504 None admin] RBAC: Adding query filter params (role.id=ee530d022cde4038bd521a1bb5f5ba6f, scope.project.id=b1baa713334143d9b2b624372a19f941, user.id=ce8582ed42f44395be2d42253a419beb) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:05.890664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec71229-4aba-40db-b5cd-cda1aba4b504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:05.890664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec71229-4aba-40db-b5cd-cda1aba4b504 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:05.891481 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 122/252] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:38:05 2022] GET /identity/v3/role_assignments?user.id=ce8582ed42f44395be2d42253a419beb&scope.project.id=b1baa713334143d9b2b624372a19f941&role.id=ee530d022cde4038bd521a1bb5f5ba6f => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:05.892343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b3a48-3460-42af-96c0-15a50b61b244 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:05.896844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b3a48-3460-42af-96c0-15a50b61b244 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:05.897152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b3a48-3460-42af-96c0-15a50b61b244 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:05.898577 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 123/253] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:05.904351 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37143ce5-2c56-4097-b1d2-05d6f7db24f9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:05.904690 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37143ce5-2c56-4097-b1d2-05d6f7db24f9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:05.904909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37143ce5-2c56-4097-b1d2-05d6f7db24f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:05.934092 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca5bfc-9208-4ad8-8b2f-018f0e733367 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:05.941596 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-37143ce5-2c56-4097-b1d2-05d6f7db24f9 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:05.942824 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-37143ce5-2c56-4097-b1d2-05d6f7db24f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:05.956871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:05.973075 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd71f61-5acf-4383-84b0-36b73d6f1c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:05.973793 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd71f61-5acf-4383-84b0-36b73d6f1c97 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:05.974078 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd71f61-5acf-4383-84b0-36b73d6f1c97 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:05.974453 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd71f61-5acf-4383-84b0-36b73d6f1c97 None admin] PATH_INFO: `/v3/users/ca13d0fc593c4616af8bc27a303dfe4b` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:05.975723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd71f61-5acf-4383-84b0-36b73d6f1c97 None admin] RBAC: Authorizing `identity:get_user(user_id=ca13d0fc593c4616af8bc27a303dfe4b)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:05.977219 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd71f61-5acf-4383-84b0-36b73d6f1c97 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:05.979296 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 131/254] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:38:05 2022] GET /identity/v3/users/ca13d0fc593c4616af8bc27a303dfe4b => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:05.988039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd71f61-5acf-4383-84b0-36b73d6f1c97 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:06.078150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 124/255] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:06.171431 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37143ce5-2c56-4097-b1d2-05d6f7db24f9 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:06.227350 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd71f61-5acf-4383-84b0-36b73d6f1c97 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:06.299196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928e860-0047-4eac-8d69-a9e7857f4b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:06.299853 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928e860-0047-4eac-8d69-a9e7857f4b73 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:06.300132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928e860-0047-4eac-8d69-a9e7857f4b73 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:06.300402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928e860-0047-4eac-8d69-a9e7857f4b73 None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:06.301688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928e860-0047-4eac-8d69-a9e7857f4b73 None admin] RBAC: Authorizing `identity:get_project(project_id=b1baa713334143d9b2b624372a19f941)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:06.303148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928e860-0047-4eac-8d69-a9e7857f4b73 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:06.304827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 132/256] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:05 2022] GET /identity/v3/projects/b1baa713334143d9b2b624372a19f941 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:06.312958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928e860-0047-4eac-8d69-a9e7857f4b73 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:06.360910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37143ce5-2c56-4097-b1d2-05d6f7db24f9 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:06.377577 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:06.408843 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:06.431124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b387e5-141f-4b3f-80f6-f264e194f48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:06.435501 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b387e5-141f-4b3f-80f6-f264e194f48f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:06.440255 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b387e5-141f-4b3f-80f6-f264e194f48f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:06.440255 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b387e5-141f-4b3f-80f6-f264e194f48f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:06.462776 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928e860-0047-4eac-8d69-a9e7857f4b73 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:06.469388 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b387e5-141f-4b3f-80f6-f264e194f48f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:06.484466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-47b387e5-141f-4b3f-80f6-f264e194f48f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:38:06.484466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:06.484466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:06.484466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:06.484466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:06.484466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:06.484466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:06.484466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:06.484466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:06.484466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:06.484466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:06.484466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:06.484466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:06.484466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:06.484466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:06.484466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:06.485381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:06.485381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:06.485381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:06.485381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:06.485381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:06.485381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:06.485381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:06.485381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:06.485381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:06.485381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:06.485381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:06.485381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:06.485381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:06.485381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:06.485381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:06.485381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:06.486227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:06.486227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:06.486227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:06.486227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:06.486227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:06.486227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:06.486227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:06.486227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:06.486227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:06.486227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:06.486227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:38:06.486227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:06.488932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 125/257] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:38:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:38:06.489959 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b387e5-141f-4b3f-80f6-f264e194f48f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:06.504668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0cdf8-6d83-4a83-8a55-bf6d72698054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:06.505345 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0cdf8-6d83-4a83-8a55-bf6d72698054 None admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:06.505627 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0cdf8-6d83-4a83-8a55-bf6d72698054 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:06.505900 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0cdf8-6d83-4a83-8a55-bf6d72698054 None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941/users/ca13d0fc593c4616af8bc27a303dfe4b/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:06.512442 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0cdf8-6d83-4a83-8a55-bf6d72698054 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1baa713334143d9b2b624372a19f941, user_id=ca13d0fc593c4616af8bc27a303dfe4b, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:06.512442 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0cdf8-6d83-4a83-8a55-bf6d72698054 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:06.607478 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 133/258] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:38:06 2022] PUT /identity/v3/projects/b1baa713334143d9b2b624372a19f941/users/ca13d0fc593c4616af8bc27a303dfe4b/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:38:06.613819 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0cdf8-6d83-4a83-8a55-bf6d72698054 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:06.627170 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b387e5-141f-4b3f-80f6-f264e194f48f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:06.709162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a9d46-f9c2-4e3e-92a4-f203dffe0a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:06.710185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a9d46-f9c2-4e3e-92a4-f203dffe0a73 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:06.710691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a9d46-f9c2-4e3e-92a4-f203dffe0a73 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:06.711171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a9d46-f9c2-4e3e-92a4-f203dffe0a73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:06.739043 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a9d46-f9c2-4e3e-92a4-f203dffe0a73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:06.753245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-b77a9d46-f9c2-4e3e-92a4-f203dffe0a73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:38:06.753245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:06.753245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:06.753245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:06.753245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:06.753245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:06.753245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:06.753245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:06.753245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:06.753245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:06.753245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:06.753245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:06.753245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:06.753245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:06.753245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:06.753245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:06.754222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:06.754222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:06.754222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:06.754222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:06.754222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:06.754222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:06.754222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:06.754222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:06.754222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:06.754222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:06.754222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:06.754222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:06.754222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:06.754222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:06.754222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:06.754222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:06.755032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:06.755032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:06.755032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:06.755032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:06.755032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:06.755032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:06.755032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:06.755032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:06.755032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:06.755032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:06.755032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:38:06.755032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:06.757752 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 126/259] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:38:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:06.769549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a9d46-f9c2-4e3e-92a4-f203dffe0a73 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:06.795596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0cdf8-6d83-4a83-8a55-bf6d72698054 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:06.816894 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:06.834015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:06.877920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e69a6-98d6-4344-98d4-4e455e548908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:06.878524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e69a6-98d6-4344-98d4-4e455e548908 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:06.878884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e69a6-98d6-4344-98d4-4e455e548908 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:06.879210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e69a6-98d6-4344-98d4-4e455e548908 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:06.879908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e69a6-98d6-4344-98d4-4e455e548908 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:06.880215 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e69a6-98d6-4344-98d4-4e455e548908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:06.881704 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e69a6-98d6-4344-98d4-4e455e548908 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:06.906547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 134/260] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:06.913311 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e69a6-98d6-4344-98d4-4e455e548908 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:06.916326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a9d46-f9c2-4e3e-92a4-f203dffe0a73 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:06.966157 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79258165-6540-456a-9024-e6c51dce4b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:06.967187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79258165-6540-456a-9024-e6c51dce4b40 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:06.967669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79258165-6540-456a-9024-e6c51dce4b40 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:06.968150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79258165-6540-456a-9024-e6c51dce4b40 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:06.969080 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79258165-6540-456a-9024-e6c51dce4b40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:06.969582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79258165-6540-456a-9024-e6c51dce4b40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:06.971760 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79258165-6540-456a-9024-e6c51dce4b40 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:06.984392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 127/261] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:06.991037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79258165-6540-456a-9024-e6c51dce4b40 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:07.092496 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:07.100403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79258165-6540-456a-9024-e6c51dce4b40 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:07.136395 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af53d53-a7f7-40c1-aca6-e2fb34ee4c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:07.136992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af53d53-a7f7-40c1-aca6-e2fb34ee4c7d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:07.137273 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af53d53-a7f7-40c1-aca6-e2fb34ee4c7d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:07.140654 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af53d53-a7f7-40c1-aca6-e2fb34ee4c7d None admin] PATH_INFO: `/v3/users/26baed18de1b41b4afb0006b41f40431` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:07.141328 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af53d53-a7f7-40c1-aca6-e2fb34ee4c7d None admin] RBAC: Authorizing `identity:get_user(user_id=26baed18de1b41b4afb0006b41f40431)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:07.144056 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af53d53-a7f7-40c1-aca6-e2fb34ee4c7d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:07.145700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 128/262] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:38:06 2022] GET /identity/v3/users/26baed18de1b41b4afb0006b41f40431 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:07.156398 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af53d53-a7f7-40c1-aca6-e2fb34ee4c7d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:07.162247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e69a6-98d6-4344-98d4-4e455e548908 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:07.239146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b4017-664e-4c82-bdb8-7bc2ff3a52c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:07.239858 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b4017-664e-4c82-bdb8-7bc2ff3a52c7 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:07.240145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b4017-664e-4c82-bdb8-7bc2ff3a52c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:07.240441 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b4017-664e-4c82-bdb8-7bc2ff3a52c7 None admin] PATH_INFO: `/v3/users/26baed18de1b41b4afb0006b41f40431` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:07.241635 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b4017-664e-4c82-bdb8-7bc2ff3a52c7 None admin] RBAC: Authorizing `identity:get_user(user_id=26baed18de1b41b4afb0006b41f40431)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:07.243082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b4017-664e-4c82-bdb8-7bc2ff3a52c7 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:07.244919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 135/263] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:38:06 2022] GET /identity/v3/users/26baed18de1b41b4afb0006b41f40431 => generated 283 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:07.250558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b4017-664e-4c82-bdb8-7bc2ff3a52c7 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:07.315597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af53d53-a7f7-40c1-aca6-e2fb34ee4c7d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:07.340819 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:07.352483 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9e73f-3781-4c59-a1ff-71f56d4b715b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:07.358033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9e73f-3781-4c59-a1ff-71f56d4b715b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:07.358033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9e73f-3781-4c59-a1ff-71f56d4b715b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:07.358033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9e73f-3781-4c59-a1ff-71f56d4b715b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:07.385121 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:07.425002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9e73f-3781-4c59-a1ff-71f56d4b715b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:07.426429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9e73f-3781-4c59-a1ff-71f56d4b715b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:07.457327 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b4017-664e-4c82-bdb8-7bc2ff3a52c7 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:07.520525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d6737-b910-4d28-8840-554c3c1ad349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:07.521164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d6737-b910-4d28-8840-554c3c1ad349 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:07.521447 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d6737-b910-4d28-8840-554c3c1ad349 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:07.521722 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d6737-b910-4d28-8840-554c3c1ad349 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:07.534594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 129/264] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 22:38:07.540128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9e73f-3781-4c59-a1ff-71f56d4b715b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:07.604235 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:07.632111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d6737-b910-4d28-8840-554c3c1ad349 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:07.633633 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d6737-b910-4d28-8840-554c3c1ad349 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:07.644951 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9e73f-3781-4c59-a1ff-71f56d4b715b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:07.682539 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0ac34-280d-42fe-bc48-b6b6736a63ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:07.683099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0ac34-280d-42fe-bc48-b6b6736a63ba None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:07.683379 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0ac34-280d-42fe-bc48-b6b6736a63ba None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:07.683720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0ac34-280d-42fe-bc48-b6b6736a63ba None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:07.684903 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0ac34-280d-42fe-bc48-b6b6736a63ba None admin] RBAC: Authorizing `identity:get_project(project_id=b1baa713334143d9b2b624372a19f941)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:07.686381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0ac34-280d-42fe-bc48-b6b6736a63ba None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:07.688334 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 130/265] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:07 2022] GET /identity/v3/projects/b1baa713334143d9b2b624372a19f941 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:07.693777 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:07.698294 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0ac34-280d-42fe-bc48-b6b6736a63ba None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:07.818269 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 136/266] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:07.823979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d6737-b910-4d28-8840-554c3c1ad349 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:07.894258 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0ac34-280d-42fe-bc48-b6b6736a63ba None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:07.938424 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:07.941614 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26d2c6-fdb2-4230-8ced-c73d156e153e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:07.942477 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26d2c6-fdb2-4230-8ced-c73d156e153e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:07.942962 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26d2c6-fdb2-4230-8ced-c73d156e153e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:07.943436 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26d2c6-fdb2-4230-8ced-c73d156e153e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:07.944404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26d2c6-fdb2-4230-8ced-c73d156e153e None admin] RBAC: Adding query filter params (role.id=01a26dc2b1034e33af13752c154d24f4, scope.project.id=b1baa713334143d9b2b624372a19f941, user.id=26baed18de1b41b4afb0006b41f40431) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:07.944958 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26d2c6-fdb2-4230-8ced-c73d156e153e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:07.946670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26d2c6-fdb2-4230-8ced-c73d156e153e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:07.953389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 131/267] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:38:07 2022] GET /identity/v3/role_assignments?user.id=26baed18de1b41b4afb0006b41f40431&scope.project.id=b1baa713334143d9b2b624372a19f941&role.id=01a26dc2b1034e33af13752c154d24f4 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:08.003167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d6737-b910-4d28-8840-554c3c1ad349 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:08.041698 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114adb6-c8cd-48c7-a22f-83038cf0d4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:08.042359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114adb6-c8cd-48c7-a22f-83038cf0d4ab None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:08.042640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114adb6-c8cd-48c7-a22f-83038cf0d4ab None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:08.042913 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114adb6-c8cd-48c7-a22f-83038cf0d4ab None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:08.044092 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114adb6-c8cd-48c7-a22f-83038cf0d4ab None admin] RBAC: Authorizing `identity:get_project(project_id=b1baa713334143d9b2b624372a19f941)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:08.045600 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114adb6-c8cd-48c7-a22f-83038cf0d4ab None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:08.047627 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 137/268] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:07 2022] GET /identity/v3/projects/b1baa713334143d9b2b624372a19f941 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:08.057847 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26d2c6-fdb2-4230-8ced-c73d156e153e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:08.200352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26d2c6-fdb2-4230-8ced-c73d156e153e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:08.238526 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616bc44-439d-4a70-95e3-7019291f4f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:08.239227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616bc44-439d-4a70-95e3-7019291f4f75 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:08.239516 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616bc44-439d-4a70-95e3-7019291f4f75 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:08.239789 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616bc44-439d-4a70-95e3-7019291f4f75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:08.240588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616bc44-439d-4a70-95e3-7019291f4f75 None admin] RBAC: Adding query filter params (role.id=aa2332d1bdb74e48a88ed7c2a7ed2990, scope.project.id=b1baa713334143d9b2b624372a19f941, user.id=26baed18de1b41b4afb0006b41f40431) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:08.240903 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616bc44-439d-4a70-95e3-7019291f4f75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:08.242382 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616bc44-439d-4a70-95e3-7019291f4f75 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:08.249380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 132/269] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:38:08 2022] GET /identity/v3/role_assignments?user.id=26baed18de1b41b4afb0006b41f40431&scope.project.id=b1baa713334143d9b2b624372a19f941&role.id=aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:08.526059 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dbfff-fa43-4167-83e7-f66faec4a893 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:08.526596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dbfff-fa43-4167-83e7-f66faec4a893 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:08.526596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dbfff-fa43-4167-83e7-f66faec4a893 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:08.528205 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 138/270] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:08.533963 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2036-e3d5-449d-acb8-7e62b051c672 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:08.534496 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2036-e3d5-449d-acb8-7e62b051c672 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:08.534966 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2036-e3d5-449d-acb8-7e62b051c672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:08.555255 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-405a2036-e3d5-449d-acb8-7e62b051c672 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:08.556803 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-405a2036-e3d5-449d-acb8-7e62b051c672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:08.628334 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:08.643734 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 133/271] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:08.701139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09119e10-96ca-4477-9753-43a37294902e None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:08.701445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09119e10-96ca-4477-9753-43a37294902e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:08.701690 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09119e10-96ca-4477-9753-43a37294902e None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:08.703277 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 139/272] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:08.709604 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d7b30-c280-4bbf-a4ba-7d7890bc6293 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:08.709891 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d7b30-c280-4bbf-a4ba-7d7890bc6293 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:08.710162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d7b30-c280-4bbf-a4ba-7d7890bc6293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:08.733264 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-538d7b30-c280-4bbf-a4ba-7d7890bc6293 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:08.734455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-538d7b30-c280-4bbf-a4ba-7d7890bc6293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:08.812456 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 134/273] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 22:38:08.898116 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421f45c-8ff8-4335-8145-2e1c21ba5a98 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:08.898850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421f45c-8ff8-4335-8145-2e1c21ba5a98 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:08.899335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421f45c-8ff8-4335-8145-2e1c21ba5a98 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:08.901172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 140/274] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:08.906258 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c78e29-ef03-43d4-98a9-e376a65cf157 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:08.906548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c78e29-ef03-43d4-98a9-e376a65cf157 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:08.906828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c78e29-ef03-43d4-98a9-e376a65cf157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:08.927384 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-31c78e29-ef03-43d4-98a9-e376a65cf157 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:08.928594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-31c78e29-ef03-43d4-98a9-e376a65cf157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:08.952006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421f45c-8ff8-4335-8145-2e1c21ba5a98 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:08.961629 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:09.011479 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 135/275] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:09.062100 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421f45c-8ff8-4335-8145-2e1c21ba5a98 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:09.097880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8bc71-be3c-48e1-a636-8347a46d2c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:09.098535 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8bc71-be3c-48e1-a636-8347a46d2c9a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:09.098813 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8bc71-be3c-48e1-a636-8347a46d2c9a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:09.099133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8bc71-be3c-48e1-a636-8347a46d2c9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:09.102698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c78e29-ef03-43d4-98a9-e376a65cf157 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:09.109896 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8bc71-be3c-48e1-a636-8347a46d2c9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:09.115948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-40e8bc71-be3c-48e1-a636-8347a46d2c9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:09.115948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:09.115948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:09.115948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:09.115948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:09.115948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:09.115948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:09.115948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:09.115948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:09.115948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:09.115948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:09.115948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:09.115948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:09.115948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:09.115948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:09.115948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:09.116860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:09.116860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:09.116860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:09.116860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:09.116860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:09.116860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:09.116860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:09.116860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:09.116860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:09.116860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:09.116860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:09.116860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:09.116860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:09.116860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:09.116860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:09.116860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:09.117982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:09.117982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:09.117982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:09.117982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:09.117982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:09.117982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:09.117982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:09.117982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:09.117982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:09.117982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:09.117982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:09.117982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:09.117982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 141/276] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:09.122948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8bc71-be3c-48e1-a636-8347a46d2c9a None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:09.161417 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:09.208190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:09.227162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c78e29-ef03-43d4-98a9-e376a65cf157 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:09.252661 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8bc71-be3c-48e1-a636-8347a46d2c9a None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:09.278020 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b14d2a-9fd4-484a-b9f6-df956c287490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:09.279298 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b14d2a-9fd4-484a-b9f6-df956c287490 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:09.279861 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b14d2a-9fd4-484a-b9f6-df956c287490 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:09.280404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b14d2a-9fd4-484a-b9f6-df956c287490 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:09.281940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b14d2a-9fd4-484a-b9f6-df956c287490 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:09.284818 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b14d2a-9fd4-484a-b9f6-df956c287490 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:09.287483 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 136/277] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:09.292477 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093cfa5-4272-4eae-8b50-7e2ebed7a64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:09.292477 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093cfa5-4272-4eae-8b50-7e2ebed7a64e None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:09.292477 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093cfa5-4272-4eae-8b50-7e2ebed7a64e None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:09.292477 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093cfa5-4272-4eae-8b50-7e2ebed7a64e None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:09.293107 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093cfa5-4272-4eae-8b50-7e2ebed7a64e None admin] RBAC: Adding query filter params (name=member) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:09.293510 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093cfa5-4272-4eae-8b50-7e2ebed7a64e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:09.294073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b14d2a-9fd4-484a-b9f6-df956c287490 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:09.295057 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093cfa5-4272-4eae-8b50-7e2ebed7a64e None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:09.304087 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 142/278] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:38:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:09.305061 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093cfa5-4272-4eae-8b50-7e2ebed7a64e None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:09.396359 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b14d2a-9fd4-484a-b9f6-df956c287490 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:09.413274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:09.427945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093cfa5-4272-4eae-8b50-7e2ebed7a64e None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:09.432084 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741593f8-1986-4917-baf9-9101831f84c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:09.432737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741593f8-1986-4917-baf9-9101831f84c8 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:09.433014 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741593f8-1986-4917-baf9-9101831f84c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:09.433283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741593f8-1986-4917-baf9-9101831f84c8 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:09.433930 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741593f8-1986-4917-baf9-9101831f84c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:09.435815 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741593f8-1986-4917-baf9-9101831f84c8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:09.455831 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:09.463782 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca2293-0e97-4759-910d-ce0c61198b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:09.464824 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca2293-0e97-4759-910d-ce0c61198b64 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:09.465123 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca2293-0e97-4759-910d-ce0c61198b64 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:09.465395 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca2293-0e97-4759-910d-ce0c61198b64 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:09.476244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca2293-0e97-4759-910d-ce0c61198b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:09.481064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-31ca2293-0e97-4759-910d-ce0c61198b64 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 22:38:09.481064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:09.481064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:09.481064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:09.481064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:09.481064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:09.481064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:09.481064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:09.481064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:09.481064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:09.481064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:09.481064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:09.481064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:09.481064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:09.481064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:09.481064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:09.481951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:09.481951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:09.481951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:09.481951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:09.481951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:09.481951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:09.481951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:09.481951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:09.481951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:09.481951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:09.481951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:09.481951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:09.481951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:09.481951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:09.481951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:09.481951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:09.482778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:09.482778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:09.482778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:09.482778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:09.482778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:09.482778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:09.482778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:09.482778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:09.482778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:09.482778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:09.482778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 22:38:09.482778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:09.482778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 143/279] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:09.483589 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca2293-0e97-4759-910d-ce0c61198b64 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:09.517037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 137/280] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Sep 6 22:38:09 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:38:09.518138 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741593f8-1986-4917-baf9-9101831f84c8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:09.604699 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca2293-0e97-4759-910d-ce0c61198b64 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:09.652566 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d117185-648c-4bf7-b2c3-97edeecef412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:09.653843 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d117185-648c-4bf7-b2c3-97edeecef412 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:09.654317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d117185-648c-4bf7-b2c3-97edeecef412 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:09.654772 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d117185-648c-4bf7-b2c3-97edeecef412 None admin] PATH_INFO: `/v3/users/edbbfbe1ee624d2bb2da45a9fa0ad1fc` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:09.666066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741593f8-1986-4917-baf9-9101831f84c8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:09.677256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d117185-648c-4bf7-b2c3-97edeecef412 None admin] RBAC: Authorizing `identity:get_user(user_id=edbbfbe1ee624d2bb2da45a9fa0ad1fc)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:09.679659 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d117185-648c-4bf7-b2c3-97edeecef412 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:09.682389 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 144/281] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:38:09 2022] GET /identity/v3/users/edbbfbe1ee624d2bb2da45a9fa0ad1fc => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:09.688871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d117185-648c-4bf7-b2c3-97edeecef412 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:09.709287 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de0bb7-c71b-40ec-a099-45d23d6307f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:09.710066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de0bb7-c71b-40ec-a099-45d23d6307f3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:09.710349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de0bb7-c71b-40ec-a099-45d23d6307f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:09.711176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de0bb7-c71b-40ec-a099-45d23d6307f3 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:09.711356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de0bb7-c71b-40ec-a099-45d23d6307f3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:09.711611 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de0bb7-c71b-40ec-a099-45d23d6307f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:09.715187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de0bb7-c71b-40ec-a099-45d23d6307f3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:09.723861 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 138/282] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:38:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:09.729444 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de0bb7-c71b-40ec-a099-45d23d6307f3 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:09.756778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:09.769759 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:09.830763 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d117185-648c-4bf7-b2c3-97edeecef412 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:09.845976 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de0bb7-c71b-40ec-a099-45d23d6307f3 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:09.874844 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e872ef4-a37a-4e05-9a9f-28f9923c6994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:09.875906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e872ef4-a37a-4e05-9a9f-28f9923c6994 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:09.875906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e872ef4-a37a-4e05-9a9f-28f9923c6994 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:09.876096 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e872ef4-a37a-4e05-9a9f-28f9923c6994 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:09.876860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e872ef4-a37a-4e05-9a9f-28f9923c6994 None admin] RBAC: Adding query filter params (role.id=093c83b316db4d0f9dc55ec6e3583ba8, user.id=edbbfbe1ee624d2bb2da45a9fa0ad1fc, scope.system=all) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:09.877169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e872ef4-a37a-4e05-9a9f-28f9923c6994 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:09.878610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e872ef4-a37a-4e05-9a9f-28f9923c6994 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:09.885976 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 145/283] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Sep 6 22:38:09 2022] GET /identity/v3/role_assignments?user.id=edbbfbe1ee624d2bb2da45a9fa0ad1fc&scope.system=all&role.id=093c83b316db4d0f9dc55ec6e3583ba8 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:09.886871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c753e6-6c39-4320-947c-9c42a29d0a8c None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:09.887151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c753e6-6c39-4320-947c-9c42a29d0a8c None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:09.887418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c753e6-6c39-4320-947c-9c42a29d0a8c None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:09.889030 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 146/284] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:09.892530 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b82c9-5ab5-4875-8423-39c268534904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:09.893401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b82c9-5ab5-4875-8423-39c268534904 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:09.893627 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b82c9-5ab5-4875-8423-39c268534904 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:09.893883 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b82c9-5ab5-4875-8423-39c268534904 None admin] PATH_INFO: `/v3/users/ce8582ed42f44395be2d42253a419beb` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:09.894804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71eb8d-562e-4a3c-8a71-43576c6fe3f4 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:09.895095 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71eb8d-562e-4a3c-8a71-43576c6fe3f4 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:09.895207 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b82c9-5ab5-4875-8423-39c268534904 None admin] RBAC: Authorizing `identity:get_user(user_id=ce8582ed42f44395be2d42253a419beb)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:09.895364 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71eb8d-562e-4a3c-8a71-43576c6fe3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:09.896677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b82c9-5ab5-4875-8423-39c268534904 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:09.898846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 139/285] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:38:09 2022] GET /identity/v3/users/ce8582ed42f44395be2d42253a419beb => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:09.906003 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b82c9-5ab5-4875-8423-39c268534904 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:09.918843 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-da71eb8d-562e-4a3c-8a71-43576c6fe3f4 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:09.921001 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-da71eb8d-562e-4a3c-8a71-43576c6fe3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:10.024459 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 147/286] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 22:38:10.050213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b82c9-5ab5-4875-8423-39c268534904 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:10.051891 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:10.102913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ec363-7851-4d86-bb17-0064489a22b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:10.103575 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ec363-7851-4d86-bb17-0064489a22b4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:10.103856 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ec363-7851-4d86-bb17-0064489a22b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:10.104151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ec363-7851-4d86-bb17-0064489a22b4 None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:10.106108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ec363-7851-4d86-bb17-0064489a22b4 None admin] RBAC: Authorizing `identity:get_project(project_id=b1baa713334143d9b2b624372a19f941)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:10.107695 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ec363-7851-4d86-bb17-0064489a22b4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:10.109688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 140/287] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:09 2022] GET /identity/v3/projects/b1baa713334143d9b2b624372a19f941 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:10.115577 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71eb8d-562e-4a3c-8a71-43576c6fe3f4 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:10.174069 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:10.260224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71eb8d-562e-4a3c-8a71-43576c6fe3f4 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:10.309167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b3198-c3a7-40c0-9148-00108610f21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:10.309853 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b3198-c3a7-40c0-9148-00108610f21d None admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:10.310138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b3198-c3a7-40c0-9148-00108610f21d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:10.310413 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b3198-c3a7-40c0-9148-00108610f21d None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941/users/ce8582ed42f44395be2d42253a419beb/roles/ee530d022cde4038bd521a1bb5f5ba6f` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:10.317763 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b3198-c3a7-40c0-9148-00108610f21d None admin] RBAC: Authorizing `identity:create_grant(project_id=b1baa713334143d9b2b624372a19f941, user_id=ce8582ed42f44395be2d42253a419beb, role_id=ee530d022cde4038bd521a1bb5f5ba6f)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:10.319301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b3198-c3a7-40c0-9148-00108610f21d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:10.324949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ec363-7851-4d86-bb17-0064489a22b4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:10.396588 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 148/288] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:38:10 2022] PUT /identity/v3/projects/b1baa713334143d9b2b624372a19f941/users/ce8582ed42f44395be2d42253a419beb/roles/ee530d022cde4038bd521a1bb5f5ba6f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:38:10.453103 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ec363-7851-4d86-bb17-0064489a22b4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:10.498458 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1e1cb-8e8a-4059-a21f-e750b1beac04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:10.499130 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1e1cb-8e8a-4059-a21f-e750b1beac04 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:10.499412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1e1cb-8e8a-4059-a21f-e750b1beac04 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:10.499689 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1e1cb-8e8a-4059-a21f-e750b1beac04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:10.512460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1e1cb-8e8a-4059-a21f-e750b1beac04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:10.518534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-1ec1e1cb-8e8a-4059-a21f-e750b1beac04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:10.518534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:10.518534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:10.518534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:10.518534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:10.518534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:10.518534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:10.518534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:10.518534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:10.518534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:10.518534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:10.518534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:10.518534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:10.518534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:10.518534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:10.518534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:10.519490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:10.519490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:10.519490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:10.519490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:10.519490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:10.519490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:10.519490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:10.519490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:10.519490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:10.519490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:10.519490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:10.519490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:10.519490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:10.519490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:10.519490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:10.519490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:10.520949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:10.520949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:10.520949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:10.520949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:10.520949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:10.520949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:10.520949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:10.520949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:10.520949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:10.520949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:10.520949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:10.520949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:10.520949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 141/289] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:10.529622 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b3198-c3a7-40c0-9148-00108610f21d None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:10.663723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:10.670467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b3198-c3a7-40c0-9148-00108610f21d None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:10.709976 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8464bc-d580-4a8b-bbea-2acf2ec731a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:10.710579 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8464bc-d580-4a8b-bbea-2acf2ec731a0 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:10.710864 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8464bc-d580-4a8b-bbea-2acf2ec731a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:10.711141 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8464bc-d580-4a8b-bbea-2acf2ec731a0 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:10.711815 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8464bc-d580-4a8b-bbea-2acf2ec731a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:10.712115 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8464bc-d580-4a8b-bbea-2acf2ec731a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:10.713549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8464bc-d580-4a8b-bbea-2acf2ec731a0 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:10.724496 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 149/290] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:38:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:10.730257 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1e1cb-8e8a-4059-a21f-e750b1beac04 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:10.778149 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:10.868610 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1e1cb-8e8a-4059-a21f-e750b1beac04 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:10.908067 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2edc3-e0cc-47a6-a261-dc4ab1c487e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:10.908744 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2edc3-e0cc-47a6-a261-dc4ab1c487e5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:10.909024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2edc3-e0cc-47a6-a261-dc4ab1c487e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:10.909306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2edc3-e0cc-47a6-a261-dc4ab1c487e5 None admin] PATH_INFO: `/v3/users/ca13d0fc593c4616af8bc27a303dfe4b` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:10.910465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2edc3-e0cc-47a6-a261-dc4ab1c487e5 None admin] RBAC: Authorizing `identity:get_user(user_id=ca13d0fc593c4616af8bc27a303dfe4b)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:10.911925 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2edc3-e0cc-47a6-a261-dc4ab1c487e5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:10.913843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 142/291] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:38:10 2022] GET /identity/v3/users/ca13d0fc593c4616af8bc27a303dfe4b => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:10.921588 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8464bc-d580-4a8b-bbea-2acf2ec731a0 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:11.106163 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8464bc-d580-4a8b-bbea-2acf2ec731a0 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:11.158555 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed168c9c-c6ae-4529-8f1c-e13edb25661d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:11.159182 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed168c9c-c6ae-4529-8f1c-e13edb25661d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:11.159460 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed168c9c-c6ae-4529-8f1c-e13edb25661d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:11.159730 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed168c9c-c6ae-4529-8f1c-e13edb25661d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:11.204992 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:11.253454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed168c9c-c6ae-4529-8f1c-e13edb25661d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:11.254935 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed168c9c-c6ae-4529-8f1c-e13edb25661d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:11.374358 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 150/292] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:11.379554 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2edc3-e0cc-47a6-a261-dc4ab1c487e5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:11.498486 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:11.510083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2edc3-e0cc-47a6-a261-dc4ab1c487e5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:11.552401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f77052-65a2-4622-b27d-00f8009737b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:11.553076 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f77052-65a2-4622-b27d-00f8009737b2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:11.553357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f77052-65a2-4622-b27d-00f8009737b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:11.553631 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f77052-65a2-4622-b27d-00f8009737b2 None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:11.554777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f77052-65a2-4622-b27d-00f8009737b2 None admin] RBAC: Authorizing `identity:get_project(project_id=b1baa713334143d9b2b624372a19f941)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:11.556241 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f77052-65a2-4622-b27d-00f8009737b2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:11.557914 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 143/293] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:11 2022] GET /identity/v3/projects/b1baa713334143d9b2b624372a19f941 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:11.563805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed168c9c-c6ae-4529-8f1c-e13edb25661d None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:11.639237 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:11.684993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed168c9c-c6ae-4529-8f1c-e13edb25661d None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:11.733088 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d49ebb-2956-4770-b1c2-61f496a8c548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:11.733715 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d49ebb-2956-4770-b1c2-61f496a8c548 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:11.733996 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d49ebb-2956-4770-b1c2-61f496a8c548 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:11.734271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d49ebb-2956-4770-b1c2-61f496a8c548 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:11.735003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d49ebb-2956-4770-b1c2-61f496a8c548 None admin] RBAC: Adding query filter params (role.id=093c83b316db4d0f9dc55ec6e3583ba8, scope.project.id=b1baa713334143d9b2b624372a19f941, user.id=ca13d0fc593c4616af8bc27a303dfe4b) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:11.735313 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d49ebb-2956-4770-b1c2-61f496a8c548 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:11.736872 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d49ebb-2956-4770-b1c2-61f496a8c548 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:11.743125 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 151/294] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:38:11 2022] GET /identity/v3/role_assignments?user.id=ca13d0fc593c4616af8bc27a303dfe4b&scope.project.id=b1baa713334143d9b2b624372a19f941&role.id=093c83b316db4d0f9dc55ec6e3583ba8 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:12.319482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9f7d7-e549-431f-a458-347a02422fbf None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:12.319753 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9f7d7-e549-431f-a458-347a02422fbf None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:12.320011 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9f7d7-e549-431f-a458-347a02422fbf None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:12.321419 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 144/295] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:12.327010 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068a5b7-579b-44dc-a032-754ec647d52c None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:12.327302 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068a5b7-579b-44dc-a032-754ec647d52c None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:12.327578 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068a5b7-579b-44dc-a032-754ec647d52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:12.353010 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-3068a5b7-579b-44dc-a032-754ec647d52c None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:12.354138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3068a5b7-579b-44dc-a032-754ec647d52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:12.443576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 152/296] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:12.633127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4a428-2775-4771-80e5-f4d12c544589 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:12.634133 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4a428-2775-4771-80e5-f4d12c544589 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:12.634630 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4a428-2775-4771-80e5-f4d12c544589 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:12.636264 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 145/297] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:12.643037 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77517e55-3651-4a4f-9655-49ab6ffc8353 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:12.643651 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77517e55-3651-4a4f-9655-49ab6ffc8353 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:12.644139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77517e55-3651-4a4f-9655-49ab6ffc8353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:12.668145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-77517e55-3651-4a4f-9655-49ab6ffc8353 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:12.669377 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-77517e55-3651-4a4f-9655-49ab6ffc8353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:12.722384 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:12.732634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4a428-2775-4771-80e5-f4d12c544589 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:12.738910 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 153/298] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:12.747261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7241aa-0ba5-47b6-9e16-d21488d58913 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:12.747553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7241aa-0ba5-47b6-9e16-d21488d58913 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:12.747833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7241aa-0ba5-47b6-9e16-d21488d58913 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:12.749406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 154/299] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:38:12.757728 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bbdf0-5481-49af-a1d7-915f3e96e4fb None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:12.758292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bbdf0-5481-49af-a1d7-915f3e96e4fb None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:12.758785 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bbdf0-5481-49af-a1d7-915f3e96e4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:12.781982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-a29bbdf0-5481-49af-a1d7-915f3e96e4fb None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:12.784358 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-a29bbdf0-5481-49af-a1d7-915f3e96e4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:12.848968 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4a428-2775-4771-80e5-f4d12c544589 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:12.879416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 155/300] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:12.890334 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6668353-6205-4e5a-ac57-827e78da10fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:12.891173 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6668353-6205-4e5a-ac57-827e78da10fc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:12.891621 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6668353-6205-4e5a-ac57-827e78da10fc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:12.892151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6668353-6205-4e5a-ac57-827e78da10fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:12.893524 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6668353-6205-4e5a-ac57-827e78da10fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:12.895176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6668353-6205-4e5a-ac57-827e78da10fc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:12.897262 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 146/301] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:12.902907 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bbdf0-5481-49af-a1d7-915f3e96e4fb None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:12.951304 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea464eef-513e-45eb-8424-d9f5007cad97 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:12.951595 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea464eef-513e-45eb-8424-d9f5007cad97 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:12.951866 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea464eef-513e-45eb-8424-d9f5007cad97 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:12.953494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 147/302] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:38:12.958585 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53331980-f18b-4b1c-a9cb-fcb805bccc26 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:12.958867 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53331980-f18b-4b1c-a9cb-fcb805bccc26 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:12.959139 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53331980-f18b-4b1c-a9cb-fcb805bccc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:12.978742 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-53331980-f18b-4b1c-a9cb-fcb805bccc26 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:12.979944 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-53331980-f18b-4b1c-a9cb-fcb805bccc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:13.008843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:13.026114 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bbdf0-5481-49af-a1d7-915f3e96e4fb None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:13.048766 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:13.062244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 148/303] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 22:38:13.062912 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53331980-f18b-4b1c-a9cb-fcb805bccc26 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:13.072480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188e4bb-43e6-46ce-8ed8-d0d47d6cb08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:13.073106 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188e4bb-43e6-46ce-8ed8-d0d47d6cb08e None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:13.073381 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188e4bb-43e6-46ce-8ed8-d0d47d6cb08e None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:13.073649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188e4bb-43e6-46ce-8ed8-d0d47d6cb08e None admin] PATH_INFO: `/v3/groups` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:13.074290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188e4bb-43e6-46ce-8ed8-d0d47d6cb08e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:13.075731 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188e4bb-43e6-46ce-8ed8-d0d47d6cb08e None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:13.159839 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 156/304] 10.222.0.30 () {60 vars in 1134 bytes} [Tue Sep 6 22:38:12 2022] POST /identity/v3/groups => generated 229 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:38:13.175568 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188e4bb-43e6-46ce-8ed8-d0d47d6cb08e None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:13.188016 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53331980-f18b-4b1c-a9cb-fcb805bccc26 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:13.230149 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59743847-cd8f-42ae-9e9c-f664c0f83733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:13.231205 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59743847-cd8f-42ae-9e9c-f664c0f83733 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:13.231740 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59743847-cd8f-42ae-9e9c-f664c0f83733 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:13.232201 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59743847-cd8f-42ae-9e9c-f664c0f83733 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:13.245551 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59743847-cd8f-42ae-9e9c-f664c0f83733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:13.251364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-59743847-cd8f-42ae-9e9c-f664c0f83733 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 22:38:13.251364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:13.251364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:13.251364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:13.251364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:13.251364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:13.251364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:13.251364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:13.251364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:13.251364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:13.251364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:13.251364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:13.251364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:13.251364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:13.251364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:13.251364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:13.252325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:13.252325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:13.252325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:13.252325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:13.252325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:13.252325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:13.252325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:13.252325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:13.252325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:13.252325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:13.252325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:13.252325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:13.252325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:13.252325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:13.252325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:13.252325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:13.253166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:13.253166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:13.253166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:13.253166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:13.253166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:13.253166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:13.253166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:13.253166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:13.253166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:13.253166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:13.253166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 22:38:13.253166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:13.255580 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 149/305] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:13.264925 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59743847-cd8f-42ae-9e9c-f664c0f83733 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:13.296542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:13.296738 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188e4bb-43e6-46ce-8ed8-d0d47d6cb08e None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:13.344339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58ac3b-6e1a-4c7b-8676-db7e233eb116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:13.345920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58ac3b-6e1a-4c7b-8676-db7e233eb116 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:13.346036 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58ac3b-6e1a-4c7b-8676-db7e233eb116 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:13.346319 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58ac3b-6e1a-4c7b-8676-db7e233eb116 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:13.360818 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58ac3b-6e1a-4c7b-8676-db7e233eb116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:13.367969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-2a58ac3b-6e1a-4c7b-8676-db7e233eb116 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:13.367969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:13.367969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:13.367969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:13.367969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:13.367969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:13.367969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:13.367969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:13.367969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:13.367969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:13.367969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:13.367969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:13.367969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:13.367969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:13.367969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:13.367969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:13.369044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:13.369044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:13.369044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:13.369044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:13.369044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:13.369044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:13.369044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:13.369044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:13.369044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:13.369044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:13.369044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:13.369044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:13.369044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:13.369044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:13.369044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:13.369044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:13.369848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:13.369848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:13.369848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:13.369848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:13.369848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:13.369848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:13.369848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:13.369848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:13.369848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:13.369848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:13.369848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:13.369848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:13.373127 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 157/306] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:38:13.374221 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58ac3b-6e1a-4c7b-8676-db7e233eb116 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:13.397892 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59743847-cd8f-42ae-9e9c-f664c0f83733 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:13.416439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:13.442462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf7d06-b012-4ef5-9195-47e62a5b8ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:13.443186 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf7d06-b012-4ef5-9195-47e62a5b8ed5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:13.443463 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf7d06-b012-4ef5-9195-47e62a5b8ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:13.443882 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf7d06-b012-4ef5-9195-47e62a5b8ed5 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:13.444930 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf7d06-b012-4ef5-9195-47e62a5b8ed5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:13.445504 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf7d06-b012-4ef5-9195-47e62a5b8ed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:13.446890 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf7d06-b012-4ef5-9195-47e62a5b8ed5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:13.456019 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 150/307] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:38:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:13.456689 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf7d06-b012-4ef5-9195-47e62a5b8ed5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:13.491264 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58ac3b-6e1a-4c7b-8676-db7e233eb116 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:13.525755 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca1a63-d3d0-4f04-800b-8d03a38c6707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:13.526392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca1a63-d3d0-4f04-800b-8d03a38c6707 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:13.526668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca1a63-d3d0-4f04-800b-8d03a38c6707 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:13.526937 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca1a63-d3d0-4f04-800b-8d03a38c6707 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:13.536979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca1a63-d3d0-4f04-800b-8d03a38c6707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:13.548271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-3dca1a63-d3d0-4f04-800b-8d03a38c6707 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 22:38:13.548271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:13.548271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:13.548271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:13.548271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:13.548271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:13.548271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:13.548271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:13.548271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:13.548271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:13.548271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:13.548271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:13.548271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:13.548271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:13.548271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:13.548271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:13.549429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:13.549429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:13.549429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:13.549429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:13.549429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:13.549429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:13.549429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:13.549429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:13.549429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:13.549429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:13.549429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:13.549429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:13.549429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:13.549429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:13.549429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:13.549429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:13.555308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:13.555308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:13.555308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:13.555308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:13.555308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:13.555308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:13.555308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:13.555308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:13.555308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:13.555308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:13.555308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 22:38:13.555308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:13.555308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 158/308] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:13.555308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca1a63-d3d0-4f04-800b-8d03a38c6707 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:13.560760 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:13.577174 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf7d06-b012-4ef5-9195-47e62a5b8ed5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:13.614364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5584b19-0490-45cd-b6ab-90b658f655ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:13.614978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5584b19-0490-45cd-b6ab-90b658f655ea None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:13.615257 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5584b19-0490-45cd-b6ab-90b658f655ea None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:13.615526 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5584b19-0490-45cd-b6ab-90b658f655ea None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:13.616193 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5584b19-0490-45cd-b6ab-90b658f655ea None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:13.616523 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5584b19-0490-45cd-b6ab-90b658f655ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:13.617911 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5584b19-0490-45cd-b6ab-90b658f655ea None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:13.627002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 151/309] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:38:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:13.627708 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5584b19-0490-45cd-b6ab-90b658f655ea None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:13.660151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:13.670605 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca1a63-d3d0-4f04-800b-8d03a38c6707 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:13.706314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b3fb4-eb60-4082-b87a-43deda9851ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:13.707731 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b3fb4-eb60-4082-b87a-43deda9851ca None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:13.708093 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b3fb4-eb60-4082-b87a-43deda9851ca None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:13.708451 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b3fb4-eb60-4082-b87a-43deda9851ca None admin] PATH_INFO: `/v3/users/d87a6f392e964f4bb4faa195fb275c1c` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:13.725794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b3fb4-eb60-4082-b87a-43deda9851ca None admin] RBAC: Authorizing `identity:get_user(user_id=d87a6f392e964f4bb4faa195fb275c1c)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:13.727605 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b3fb4-eb60-4082-b87a-43deda9851ca None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:13.729604 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 159/310] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:38:13 2022] GET /identity/v3/users/d87a6f392e964f4bb4faa195fb275c1c => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:13.730440 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b3fb4-eb60-4082-b87a-43deda9851ca None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:13.736195 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5584b19-0490-45cd-b6ab-90b658f655ea None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:13.778708 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d38f69-46c6-479f-a09d-0c6d9bfaca3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:13.779332 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d38f69-46c6-479f-a09d-0c6d9bfaca3b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:13.779614 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d38f69-46c6-479f-a09d-0c6d9bfaca3b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:13.779887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d38f69-46c6-479f-a09d-0c6d9bfaca3b None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:13.780583 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d38f69-46c6-479f-a09d-0c6d9bfaca3b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:13.780889 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d38f69-46c6-479f-a09d-0c6d9bfaca3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:13.782296 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d38f69-46c6-479f-a09d-0c6d9bfaca3b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:13.790410 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 152/311] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:38:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:13.793312 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d38f69-46c6-479f-a09d-0c6d9bfaca3b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:13.806754 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:13.836098 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b3fb4-eb60-4082-b87a-43deda9851ca None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:13.872901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b091705-8a80-4dce-ae70-bc4b7cc31da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:13.873772 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b091705-8a80-4dce-ae70-bc4b7cc31da1 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:13.873899 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b091705-8a80-4dce-ae70-bc4b7cc31da1 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:13.874061 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b091705-8a80-4dce-ae70-bc4b7cc31da1 None admin] PATH_INFO: `/v3/users/edbbfbe1ee624d2bb2da45a9fa0ad1fc` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:13.875187 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b091705-8a80-4dce-ae70-bc4b7cc31da1 None admin] RBAC: Authorizing `identity:get_user(user_id=edbbfbe1ee624d2bb2da45a9fa0ad1fc)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:13.877277 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b091705-8a80-4dce-ae70-bc4b7cc31da1 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:13.883625 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 160/312] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:38:13 2022] GET /identity/v3/users/edbbfbe1ee624d2bb2da45a9fa0ad1fc => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:13.884248 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b091705-8a80-4dce-ae70-bc4b7cc31da1 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:13.900632 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d38f69-46c6-479f-a09d-0c6d9bfaca3b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:13.910648 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:13.946570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ffb5f-d56a-4fc9-8978-1c0317b0cd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:13.947105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ffb5f-d56a-4fc9-8978-1c0317b0cd89 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:13.947391 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ffb5f-d56a-4fc9-8978-1c0317b0cd89 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:13.947732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ffb5f-d56a-4fc9-8978-1c0317b0cd89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:13.948509 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ffb5f-d56a-4fc9-8978-1c0317b0cd89 None admin] RBAC: Adding query filter params (role.id=ee530d022cde4038bd521a1bb5f5ba6f, user.id=d87a6f392e964f4bb4faa195fb275c1c, scope.system=all) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:13.948824 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ffb5f-d56a-4fc9-8978-1c0317b0cd89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:13.950360 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ffb5f-d56a-4fc9-8978-1c0317b0cd89 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:13.960501 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 153/313] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Sep 6 22:38:13 2022] GET /identity/v3/role_assignments?user.id=d87a6f392e964f4bb4faa195fb275c1c&scope.system=all&role.id=ee530d022cde4038bd521a1bb5f5ba6f => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:13.960501 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ffb5f-d56a-4fc9-8978-1c0317b0cd89 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:14.018181 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b091705-8a80-4dce-ae70-bc4b7cc31da1 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:14.056840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e9901-159e-4d05-84aa-5991cf69562b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:14.057535 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e9901-159e-4d05-84aa-5991cf69562b None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:14.057811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e9901-159e-4d05-84aa-5991cf69562b None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:14.058133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e9901-159e-4d05-84aa-5991cf69562b None admin] PATH_INFO: `/v3/users/ce8582ed42f44395be2d42253a419beb` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:14.059355 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e9901-159e-4d05-84aa-5991cf69562b None admin] RBAC: Authorizing `identity:get_user(user_id=ce8582ed42f44395be2d42253a419beb)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:14.060417 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:14.061087 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e9901-159e-4d05-84aa-5991cf69562b None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:14.062692 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 161/314] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:38:13 2022] GET /identity/v3/users/ce8582ed42f44395be2d42253a419beb => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:14.069430 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e9901-159e-4d05-84aa-5991cf69562b None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:14.106554 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ffb5f-d56a-4fc9-8978-1c0317b0cd89 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:14.161957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e90b0c-ac9a-46f5-918f-c1cc23b61d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:14.163515 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e90b0c-ac9a-46f5-918f-c1cc23b61d88 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:14.163804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e90b0c-ac9a-46f5-918f-c1cc23b61d88 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:14.164080 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e90b0c-ac9a-46f5-918f-c1cc23b61d88 None admin] PATH_INFO: `/v3/system/users/edbbfbe1ee624d2bb2da45a9fa0ad1fc/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:14.165575 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e90b0c-ac9a-46f5-918f-c1cc23b61d88 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=edbbfbe1ee624d2bb2da45a9fa0ad1fc, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:14.166980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e90b0c-ac9a-46f5-918f-c1cc23b61d88 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:14.185939 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:14.195838 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e9901-159e-4d05-84aa-5991cf69562b None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:14.229509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c961bb-7694-4b59-99c1-e6cccbd5e39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:14.230125 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c961bb-7694-4b59-99c1-e6cccbd5e39e None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:14.230359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c961bb-7694-4b59-99c1-e6cccbd5e39e None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:14.230626 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c961bb-7694-4b59-99c1-e6cccbd5e39e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:14.260504 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 154/315] 10.222.0.30 () {58 vars in 1334 bytes} [Tue Sep 6 22:38:13 2022] PUT /identity/v3/system/users/edbbfbe1ee624d2bb2da45a9fa0ad1fc/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:38:14.311729 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c961bb-7694-4b59-99c1-e6cccbd5e39e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:14.313247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c961bb-7694-4b59-99c1-e6cccbd5e39e None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:14.416972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:14.427046 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 162/316] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:14.433394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e90b0c-ac9a-46f5-918f-c1cc23b61d88 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:14.549183 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e90b0c-ac9a-46f5-918f-c1cc23b61d88 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:14.585888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce88c01-98ce-42d1-bb7f-836ef16dbbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:14.586865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce88c01-98ce-42d1-bb7f-836ef16dbbba None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:14.587386 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce88c01-98ce-42d1-bb7f-836ef16dbbba None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:14.587861 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce88c01-98ce-42d1-bb7f-836ef16dbbba None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:14.589187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce88c01-98ce-42d1-bb7f-836ef16dbbba None admin] RBAC: Authorizing `identity:get_project(project_id=b1baa713334143d9b2b624372a19f941)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:14.590826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce88c01-98ce-42d1-bb7f-836ef16dbbba None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:14.592680 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 155/317] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:14 2022] GET /identity/v3/projects/b1baa713334143d9b2b624372a19f941 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:14.600483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c961bb-7694-4b59-99c1-e6cccbd5e39e None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:14.699437 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c961bb-7694-4b59-99c1-e6cccbd5e39e None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:14.733672 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81789ebb-0a3e-4ed2-abe8-362708e94a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:14.734306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81789ebb-0a3e-4ed2-abe8-362708e94a6d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:14.734576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81789ebb-0a3e-4ed2-abe8-362708e94a6d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:14.734818 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81789ebb-0a3e-4ed2-abe8-362708e94a6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:14.736084 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81789ebb-0a3e-4ed2-abe8-362708e94a6d None admin] RBAC: Adding query filter params (role.id=ee530d022cde4038bd521a1bb5f5ba6f, scope.project.id=b1baa713334143d9b2b624372a19f941, user.id=ce8582ed42f44395be2d42253a419beb) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:14.736392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81789ebb-0a3e-4ed2-abe8-362708e94a6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:14.737843 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81789ebb-0a3e-4ed2-abe8-362708e94a6d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:14.748544 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 163/318] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:38:14 2022] GET /identity/v3/role_assignments?user.id=ce8582ed42f44395be2d42253a419beb&scope.project.id=b1baa713334143d9b2b624372a19f941&role.id=ee530d022cde4038bd521a1bb5f5ba6f => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:15.442264 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0411cd0-021e-4ff4-a450-9a792cce5ec5 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:15.442750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0411cd0-021e-4ff4-a450-9a792cce5ec5 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:15.442750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0411cd0-021e-4ff4-a450-9a792cce5ec5 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:15.444238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 156/319] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:15.449300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1db85-518a-4ddb-a653-9267e8b8b484 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:15.449592 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1db85-518a-4ddb-a653-9267e8b8b484 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:15.449985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1db85-518a-4ddb-a653-9267e8b8b484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:15.469069 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-4fe1db85-518a-4ddb-a653-9267e8b8b484 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:15.470871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4fe1db85-518a-4ddb-a653-9267e8b8b484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:15.525712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:15.542920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 164/320] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:15.815819 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0411cd0-021e-4ff4-a450-9a792cce5ec5 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:15.825800 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:15.920236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0411cd0-021e-4ff4-a450-9a792cce5ec5 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:15.955026 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233a58c-d1cd-4deb-a41a-14e3d6809b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:15.955666 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233a58c-d1cd-4deb-a41a-14e3d6809b51 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:15.955944 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233a58c-d1cd-4deb-a41a-14e3d6809b51 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:15.956205 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233a58c-d1cd-4deb-a41a-14e3d6809b51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:15.957579 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233a58c-d1cd-4deb-a41a-14e3d6809b51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:15.959071 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233a58c-d1cd-4deb-a41a-14e3d6809b51 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:15.961488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 157/321] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:15.975090 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1db85-518a-4ddb-a653-9267e8b8b484 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:16.082216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1db85-518a-4ddb-a653-9267e8b8b484 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:16.122622 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba338613-f530-4562-b207-61e9a7270d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:16.123242 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba338613-f530-4562-b207-61e9a7270d7f None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:16.123518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba338613-f530-4562-b207-61e9a7270d7f None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:16.123793 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba338613-f530-4562-b207-61e9a7270d7f None admin] PATH_INFO: `/v3/groups` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:16.124416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba338613-f530-4562-b207-61e9a7270d7f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:16.125968 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba338613-f530-4562-b207-61e9a7270d7f None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:16.199036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039d2c-7ca0-4cc5-890e-ef7a9492565c None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:16.199434 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039d2c-7ca0-4cc5-890e-ef7a9492565c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:16.199770 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039d2c-7ca0-4cc5-890e-ef7a9492565c None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:16.201222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 158/322] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:38:16.206570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb73f2-9f67-4a53-b367-661f5d1c86d2 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:16.207108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb73f2-9f67-4a53-b367-661f5d1c86d2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:16.207389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb73f2-9f67-4a53-b367-661f5d1c86d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:16.226716 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-bceb73f2-9f67-4a53-b367-661f5d1c86d2 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:16.227116 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 165/323] 10.222.0.30 () {60 vars in 1134 bytes} [Tue Sep 6 22:38:15 2022] POST /identity/v3/groups => generated 226 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:38:16.229786 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bceb73f2-9f67-4a53-b367-661f5d1c86d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:16.310896 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 159/324] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 22:38:16.486657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da4cbc-30ed-468a-b151-127de28faa6c None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:16.486990 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da4cbc-30ed-468a-b151-127de28faa6c None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:16.487164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da4cbc-30ed-468a-b151-127de28faa6c None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:16.488665 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 166/325] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:16.493932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8bf27-5338-4b16-b815-f582e5079a49 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:16.494400 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8bf27-5338-4b16-b815-f582e5079a49 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:16.494572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8bf27-5338-4b16-b815-f582e5079a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:16.502700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:16.514666 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-65c8bf27-5338-4b16-b815-f582e5079a49 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:16.515869 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-65c8bf27-5338-4b16-b815-f582e5079a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:16.578657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da4cbc-30ed-468a-b151-127de28faa6c None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:16.588148 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 160/326] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:16.634617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:16.693025 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da4cbc-30ed-468a-b151-127de28faa6c None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:16.734824 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e1253-e6d1-46d9-ad2c-0d6faaeda4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:16.735521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e1253-e6d1-46d9-ad2c-0d6faaeda4a9 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:16.735807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e1253-e6d1-46d9-ad2c-0d6faaeda4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:16.736076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e1253-e6d1-46d9-ad2c-0d6faaeda4a9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:16.747985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e1253-e6d1-46d9-ad2c-0d6faaeda4a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:16.754006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-3e2e1253-e6d1-46d9-ad2c-0d6faaeda4a9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 22:38:16.754006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:16.754006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:16.754006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:16.754006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:16.754006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:16.754006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:16.754006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:16.754006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:16.754006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:16.754006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:16.754006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:16.754006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:16.754006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:16.754006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:16.754006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:16.754906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:16.754906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:16.754906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:16.754906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:16.754906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:16.754906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:16.754906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:16.754906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:16.754906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:16.754906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:16.754906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:16.754906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:16.754906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:16.754906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:16.754906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:16.754906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:16.755725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:16.755725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:16.755725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:16.755725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:16.755725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:16.755725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:16.755725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:16.755725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:16.755725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:16.755725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:16.755725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 22:38:16.755725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:16.755725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 167/327] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:38:16.761013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8bf27-5338-4b16-b815-f582e5079a49 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:16.874786 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8bf27-5338-4b16-b815-f582e5079a49 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:16.897605 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e1253-e6d1-46d9-ad2c-0d6faaeda4a9 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:16.917851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe75f5-95d2-4ff6-b135-b5c568341fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:16.919226 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe75f5-95d2-4ff6-b135-b5c568341fac None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:16.919712 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe75f5-95d2-4ff6-b135-b5c568341fac None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:16.920187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe75f5-95d2-4ff6-b135-b5c568341fac None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:16.921354 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe75f5-95d2-4ff6-b135-b5c568341fac None admin] RBAC: Adding query filter params (name=reader) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:16.921883 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe75f5-95d2-4ff6-b135-b5c568341fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:16.924937 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe75f5-95d2-4ff6-b135-b5c568341fac None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:16.935767 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 161/328] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:38:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:16.940458 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:16.949697 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe75f5-95d2-4ff6-b135-b5c568341fac None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:17.024079 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e1253-e6d1-46d9-ad2c-0d6faaeda4a9 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:17.027360 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:17.063132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162c7a0-471a-4ecc-9c95-aa17f2987d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:17.065025 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162c7a0-471a-4ecc-9c95-aa17f2987d63 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:17.065490 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162c7a0-471a-4ecc-9c95-aa17f2987d63 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:17.065906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162c7a0-471a-4ecc-9c95-aa17f2987d63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:17.077955 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162c7a0-471a-4ecc-9c95-aa17f2987d63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:17.084180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-6162c7a0-471a-4ecc-9c95-aa17f2987d63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:17.084180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:17.084180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:17.084180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:17.084180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:17.084180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:17.084180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:17.084180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:17.084180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:17.084180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:17.084180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:17.084180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:17.084180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:17.084180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:17.084180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:17.084180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:17.085315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:17.085315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:17.085315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:17.085315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:17.085315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:17.085315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:17.085315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:17.085315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:17.085315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:17.085315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:17.085315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:17.085315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:17.085315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:17.085315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:17.085315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:17.085315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:17.086276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:17.086276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:17.086276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:17.086276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:17.086276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:17.086276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:17.086276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:17.086276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:17.086276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:17.086276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:17.086276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:17.086276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:17.088243 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 168/329] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:38:17.095582 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162c7a0-471a-4ecc-9c95-aa17f2987d63 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:17.157922 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe75f5-95d2-4ff6-b135-b5c568341fac None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:17.226455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5ad63-8ee6-4714-bbbc-257e67a112b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:17.227217 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5ad63-8ee6-4714-bbbc-257e67a112b8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:17.227506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5ad63-8ee6-4714-bbbc-257e67a112b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:17.227781 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5ad63-8ee6-4714-bbbc-257e67a112b8 None admin] PATH_INFO: `/v3/users/d87a6f392e964f4bb4faa195fb275c1c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:17.229807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5ad63-8ee6-4714-bbbc-257e67a112b8 None admin] RBAC: Authorizing `identity:get_user(user_id=d87a6f392e964f4bb4faa195fb275c1c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:17.231274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5ad63-8ee6-4714-bbbc-257e67a112b8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:17.233101 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 162/330] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:38:16 2022] GET /identity/v3/users/d87a6f392e964f4bb4faa195fb275c1c => generated 293 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:17.239620 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5ad63-8ee6-4714-bbbc-257e67a112b8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:17.268719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162c7a0-471a-4ecc-9c95-aa17f2987d63 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:17.309141 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee452df-47cb-4e50-81c2-749efa1e47a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:17.309752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee452df-47cb-4e50-81c2-749efa1e47a1 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:17.310036 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee452df-47cb-4e50-81c2-749efa1e47a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:17.310312 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee452df-47cb-4e50-81c2-749efa1e47a1 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:17.310995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee452df-47cb-4e50-81c2-749efa1e47a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:17.311299 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee452df-47cb-4e50-81c2-749efa1e47a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:17.313404 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee452df-47cb-4e50-81c2-749efa1e47a1 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:17.326722 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 169/331] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:38:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:17.332995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee452df-47cb-4e50-81c2-749efa1e47a1 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:17.365450 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:17.367155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:17.439188 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5ad63-8ee6-4714-bbbc-257e67a112b8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:17.445038 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee452df-47cb-4e50-81c2-749efa1e47a1 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:17.481621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cca7c5-1b1d-49f8-9b88-fb2e8eac87c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:17.482278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cca7c5-1b1d-49f8-9b88-fb2e8eac87c7 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:17.482558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cca7c5-1b1d-49f8-9b88-fb2e8eac87c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:17.482833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cca7c5-1b1d-49f8-9b88-fb2e8eac87c7 None admin] PATH_INFO: `/v3/users/edbbfbe1ee624d2bb2da45a9fa0ad1fc` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:17.483996 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cca7c5-1b1d-49f8-9b88-fb2e8eac87c7 None admin] RBAC: Authorizing `identity:get_user(user_id=edbbfbe1ee624d2bb2da45a9fa0ad1fc)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:17.486197 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cca7c5-1b1d-49f8-9b88-fb2e8eac87c7 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:17.488022 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 170/332] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:38:17 2022] GET /identity/v3/users/edbbfbe1ee624d2bb2da45a9fa0ad1fc => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:17.493526 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cca7c5-1b1d-49f8-9b88-fb2e8eac87c7 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:17.509302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036d77f-48f5-40fe-9ae8-99365254efb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:17.510073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036d77f-48f5-40fe-9ae8-99365254efb5 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:17.510357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036d77f-48f5-40fe-9ae8-99365254efb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:17.510637 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036d77f-48f5-40fe-9ae8-99365254efb5 None admin] PATH_INFO: `/v3/system/users/d87a6f392e964f4bb4faa195fb275c1c/roles/ee530d022cde4038bd521a1bb5f5ba6f` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:17.512183 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036d77f-48f5-40fe-9ae8-99365254efb5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d87a6f392e964f4bb4faa195fb275c1c, role_id=ee530d022cde4038bd521a1bb5f5ba6f)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:17.513706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036d77f-48f5-40fe-9ae8-99365254efb5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:17.586853 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 163/333] 10.222.0.30 () {58 vars in 1334 bytes} [Tue Sep 6 22:38:17 2022] PUT /identity/v3/system/users/d87a6f392e964f4bb4faa195fb275c1c/roles/ee530d022cde4038bd521a1bb5f5ba6f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:38:17.591956 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:17.599867 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cca7c5-1b1d-49f8-9b88-fb2e8eac87c7 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:17.637286 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fbfe7-52fe-4dac-8228-2f4a5688ae70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:17.637929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fbfe7-52fe-4dac-8228-2f4a5688ae70 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:17.638211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fbfe7-52fe-4dac-8228-2f4a5688ae70 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:17.638489 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fbfe7-52fe-4dac-8228-2f4a5688ae70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:17.639246 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fbfe7-52fe-4dac-8228-2f4a5688ae70 None admin] RBAC: Adding query filter params (role.id=093c83b316db4d0f9dc55ec6e3583ba8, user.id=edbbfbe1ee624d2bb2da45a9fa0ad1fc, scope.system=all) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:17.639555 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fbfe7-52fe-4dac-8228-2f4a5688ae70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:17.641106 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fbfe7-52fe-4dac-8228-2f4a5688ae70 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:17.655359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 171/334] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Sep 6 22:38:17 2022] GET /identity/v3/role_assignments?user.id=edbbfbe1ee624d2bb2da45a9fa0ad1fc&scope.system=all&role.id=093c83b316db4d0f9dc55ec6e3583ba8 => generated 510 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:18.989935 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61cc51-1da1-4b09-a089-4e9aae0058c8 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:18.990512 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61cc51-1da1-4b09-a089-4e9aae0058c8 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:18.990512 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61cc51-1da1-4b09-a089-4e9aae0058c8 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:18.992072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 164/335] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:18.998783 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7cfe7-10b2-4867-bed8-615f28689ab6 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:18.999253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7cfe7-10b2-4867-bed8-615f28689ab6 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:18.999851 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7cfe7-10b2-4867-bed8-615f28689ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:19.022516 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-c6a7cfe7-10b2-4867-bed8-615f28689ab6 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:19.023755 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c6a7cfe7-10b2-4867-bed8-615f28689ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:19.122978 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 172/336] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:19.287490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4699f-28dc-47a8-9a2e-3e89d409a221 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:19.288027 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4699f-28dc-47a8-9a2e-3e89d409a221 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:19.288459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4699f-28dc-47a8-9a2e-3e89d409a221 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:19.290180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 165/337] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:19.295204 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c8e3d-037e-4e8b-8d20-934f0c49240e None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:19.295493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c8e3d-037e-4e8b-8d20-934f0c49240e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:19.295776 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c8e3d-037e-4e8b-8d20-934f0c49240e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:19.317506 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-1a8c8e3d-037e-4e8b-8d20-934f0c49240e None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:19.318728 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1a8c8e3d-037e-4e8b-8d20-934f0c49240e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:19.409750 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 173/338] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:19.604413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4699f-28dc-47a8-9a2e-3e89d409a221 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:19.724092 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c8e3d-037e-4e8b-8d20-934f0c49240e None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:19.736784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4699f-28dc-47a8-9a2e-3e89d409a221 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:19.749385 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:19.789364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:19.800776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1cd01-0c6c-48c2-93e6-29efdbebb3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:19.801436 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1cd01-0c6c-48c2-93e6-29efdbebb3f3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:19.801715 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1cd01-0c6c-48c2-93e6-29efdbebb3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:19.801982 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1cd01-0c6c-48c2-93e6-29efdbebb3f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:19.813565 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1cd01-0c6c-48c2-93e6-29efdbebb3f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:19.818602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-b5a1cd01-0c6c-48c2-93e6-29efdbebb3f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:19.818602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:19.818602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:19.818602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:19.818602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:19.818602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:19.818602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:19.818602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:19.818602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:19.818602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:19.818602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:19.818602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:19.818602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:19.818602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:19.818602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:19.818602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:19.819688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:19.819688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:19.819688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:19.819688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:19.819688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:19.819688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:19.819688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:19.819688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:19.819688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:19.819688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:19.819688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:19.819688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:19.819688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:19.819688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:19.819688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:19.819688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:19.820701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:19.820701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:19.820701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:19.820701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:19.820701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:19.820701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:19.820701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:19.820701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:19.820701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:19.820701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:19.820701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:19.820701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:19.822796 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 166/339] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:19.828472 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1cd01-0c6c-48c2-93e6-29efdbebb3f3 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:19.894986 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c8e3d-037e-4e8b-8d20-934f0c49240e None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:19.971390 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c834120-b1d8-4baf-8f9f-87c34b4693cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:19.973016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834120-b1d8-4baf-8f9f-87c34b4693cf None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:19.973486 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834120-b1d8-4baf-8f9f-87c34b4693cf None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:19.978393 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834120-b1d8-4baf-8f9f-87c34b4693cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:20.004668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c834120-b1d8-4baf-8f9f-87c34b4693cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:20.011003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-7c834120-b1d8-4baf-8f9f-87c34b4693cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:38:20.011003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:20.011003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:20.011003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:20.011003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:20.011003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:20.011003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:20.011003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:20.011003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:20.011003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:20.011003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:20.011003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:20.011003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:20.011003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:20.011003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:20.011003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:20.012065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:20.012065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:20.012065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:20.012065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:20.012065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:20.012065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:20.012065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:20.012065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:20.012065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:20.012065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:20.012065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:20.012065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:20.012065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:20.012065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:20.012065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:20.012065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:20.013065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:20.013065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:20.013065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:20.013065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:20.013065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:20.013065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:20.013065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:20.013065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:20.013065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:20.013065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:20.013065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:38:20.013065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:20.020055 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 174/340] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:38:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:20.026267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c834120-b1d8-4baf-8f9f-87c34b4693cf None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:20.045453 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1cd01-0c6c-48c2-93e6-29efdbebb3f3 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:20.127759 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3957863-6771-4aef-b758-059e46ec5708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:20.129726 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3957863-6771-4aef-b758-059e46ec5708 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:20.130346 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3957863-6771-4aef-b758-059e46ec5708 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:20.131412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3957863-6771-4aef-b758-059e46ec5708 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:20.132389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3957863-6771-4aef-b758-059e46ec5708 None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:20.134128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3957863-6771-4aef-b758-059e46ec5708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:20.135677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3957863-6771-4aef-b758-059e46ec5708 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:20.155346 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 167/341] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:38:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:20.173073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3957863-6771-4aef-b758-059e46ec5708 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:20.193480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:20.259471 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c834120-b1d8-4baf-8f9f-87c34b4693cf None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:20.260169 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:20.343533 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ab551-fe84-4646-bf64-a70e918a3dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:20.345063 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ab551-fe84-4646-bf64-a70e918a3dc9 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:20.345477 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ab551-fe84-4646-bf64-a70e918a3dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:20.345882 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ab551-fe84-4646-bf64-a70e918a3dc9 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:20.346685 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ab551-fe84-4646-bf64-a70e918a3dc9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:20.347147 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ab551-fe84-4646-bf64-a70e918a3dc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:20.348684 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ab551-fe84-4646-bf64-a70e918a3dc9 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:20.356117 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3957863-6771-4aef-b758-059e46ec5708 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:20.359361 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 175/342] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:20.365675 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ab551-fe84-4646-bf64-a70e918a3dc9 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:20.394084 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fab72-9b88-4854-8f95-6916fa3500e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:20.394952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fab72-9b88-4854-8f95-6916fa3500e4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:20.395379 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fab72-9b88-4854-8f95-6916fa3500e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:20.395915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fab72-9b88-4854-8f95-6916fa3500e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:20.466810 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fab72-9b88-4854-8f95-6916fa3500e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:20.468542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fab72-9b88-4854-8f95-6916fa3500e4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:20.524799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:20.578480 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 168/343] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 22:38:20.580566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c93712-ef41-4d8a-a24e-6297f6cfb730 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:20.581037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c93712-ef41-4d8a-a24e-6297f6cfb730 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:20.581512 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c93712-ef41-4d8a-a24e-6297f6cfb730 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:20.584154 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 169/344] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:20.592057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4c264-293f-4368-9dde-a560195e0625 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:20.593039 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4c264-293f-4368-9dde-a560195e0625 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:20.593497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4c264-293f-4368-9dde-a560195e0625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:20.614112 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-49d4c264-293f-4368-9dde-a560195e0625 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:20.615584 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-49d4c264-293f-4368-9dde-a560195e0625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:20.658989 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ab551-fe84-4646-bf64-a70e918a3dc9 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:20.692062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 170/345] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:20.693266 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4c264-293f-4368-9dde-a560195e0625 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:20.719834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a60045-d560-45e6-9120-368ce3ea118e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:20.720797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a60045-d560-45e6-9120-368ce3ea118e None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:20.721226 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a60045-d560-45e6-9120-368ce3ea118e None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:20.721647 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a60045-d560-45e6-9120-368ce3ea118e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:20.798191 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:20.798558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a60045-d560-45e6-9120-368ce3ea118e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:20.801935 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a60045-d560-45e6-9120-368ce3ea118e None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:20.812873 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:20.820642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4c264-293f-4368-9dde-a560195e0625 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:20.869672 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c7801-bc7e-4c27-8f53-b7c0a322c475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:20.870968 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c7801-bc7e-4c27-8f53-b7c0a322c475 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:20.871768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c7801-bc7e-4c27-8f53-b7c0a322c475 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:20.872185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c7801-bc7e-4c27-8f53-b7c0a322c475 None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:20.874002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c7801-bc7e-4c27-8f53-b7c0a322c475 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad919f473ed42dba141f5a8838458b9)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:20.876088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c7801-bc7e-4c27-8f53-b7c0a322c475 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:20.878536 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 171/346] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:20 2022] GET /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:20.880170 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5db4d-6b4f-46c0-b6eb-c9e594c86726 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:20.885003 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5db4d-6b4f-46c0-b6eb-c9e594c86726 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:20.885134 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5db4d-6b4f-46c0-b6eb-c9e594c86726 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:20.886462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 172/347] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:20.887197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5db4d-6b4f-46c0-b6eb-c9e594c86726 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:20.931893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 176/348] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:20.937710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5055c5d-2774-4073-8f31-0fca71dde17d None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:20.938737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5055c5d-2774-4073-8f31-0fca71dde17d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:20.939218 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5055c5d-2774-4073-8f31-0fca71dde17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:20.988653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-c5055c5d-2774-4073-8f31-0fca71dde17d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:20.988653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c5055c5d-2774-4073-8f31-0fca71dde17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:21.017141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5db4d-6b4f-46c0-b6eb-c9e594c86726 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:21.036820 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:21.057746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72401943-9715-4c0f-93cc-3f49f0084c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:21.058448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72401943-9715-4c0f-93cc-3f49f0084c0f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:21.058726 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72401943-9715-4c0f-93cc-3f49f0084c0f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:21.058997 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72401943-9715-4c0f-93cc-3f49f0084c0f None admin] PATH_INFO: `/v3/groups/b30ccd35a8404a14943d1403745fd580` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:21.072450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72401943-9715-4c0f-93cc-3f49f0084c0f None admin] RBAC: Authorizing `identity:get_group(group_id=b30ccd35a8404a14943d1403745fd580)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:21.072450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72401943-9715-4c0f-93cc-3f49f0084c0f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:21.072450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 173/349] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Sep 6 22:38:20 2022] GET /identity/v3/groups/b30ccd35a8404a14943d1403745fd580 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:21.072450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72401943-9715-4c0f-93cc-3f49f0084c0f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:21.096805 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:21.123114 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 177/350] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:21.123977 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5055c5d-2774-4073-8f31-0fca71dde17d None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:21.257574 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72401943-9715-4c0f-93cc-3f49f0084c0f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:21.303917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5055c5d-2774-4073-8f31-0fca71dde17d None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:21.314669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708c2ac-69ac-4989-83be-a3b489d671f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:21.315611 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708c2ac-69ac-4989-83be-a3b489d671f3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:21.316107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708c2ac-69ac-4989-83be-a3b489d671f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:21.316639 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708c2ac-69ac-4989-83be-a3b489d671f3 None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:21.318122 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708c2ac-69ac-4989-83be-a3b489d671f3 None admin] RBAC: Authorizing `identity:get_project(project_id=2ad919f473ed42dba141f5a8838458b9)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:21.319767 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708c2ac-69ac-4989-83be-a3b489d671f3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:21.322592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 174/351] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:21 2022] GET /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:21.323602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708c2ac-69ac-4989-83be-a3b489d671f3 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:21.378722 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6908ed0-3ce7-4957-bc10-3715eea63178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:21.379351 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6908ed0-3ce7-4957-bc10-3715eea63178 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:21.379625 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6908ed0-3ce7-4957-bc10-3715eea63178 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:21.379894 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6908ed0-3ce7-4957-bc10-3715eea63178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:21.380658 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6908ed0-3ce7-4957-bc10-3715eea63178 None admin] RBAC: Adding query filter params (group.id=b30ccd35a8404a14943d1403745fd580, role.id=093c83b316db4d0f9dc55ec6e3583ba8, scope.project.id=2ad919f473ed42dba141f5a8838458b9) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:21.380962 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6908ed0-3ce7-4957-bc10-3715eea63178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:21.382397 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6908ed0-3ce7-4957-bc10-3715eea63178 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:21.402043 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 178/352] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Sep 6 22:38:21 2022] GET /identity/v3/role_assignments?group.id=b30ccd35a8404a14943d1403745fd580&scope.project.id=2ad919f473ed42dba141f5a8838458b9&role.id=093c83b316db4d0f9dc55ec6e3583ba8 => generated 260 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:21.402957 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6908ed0-3ce7-4957-bc10-3715eea63178 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:21.454711 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:21.494184 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:21.530669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708c2ac-69ac-4989-83be-a3b489d671f3 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:21.578250 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6908ed0-3ce7-4957-bc10-3715eea63178 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:21.588067 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450883fc-9020-455a-b8b6-d288b356a943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:21.589039 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450883fc-9020-455a-b8b6-d288b356a943 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:21.589319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450883fc-9020-455a-b8b6-d288b356a943 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:21.589589 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450883fc-9020-455a-b8b6-d288b356a943 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:21.609054 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450883fc-9020-455a-b8b6-d288b356a943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:21.616812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-450883fc-9020-455a-b8b6-d288b356a943 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:38:21.616812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:21.616812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:21.616812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:21.616812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:21.616812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:21.616812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:21.616812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:21.616812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:21.616812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:21.616812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:21.616812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:21.616812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:21.616812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:21.616812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:21.616812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:21.617807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:21.617807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:21.617807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:21.617807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:21.617807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:21.617807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:21.617807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:21.617807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:21.617807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:21.617807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:21.617807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:21.617807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:21.617807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:21.617807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:21.617807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:21.617807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:21.618634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:21.618634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:21.618634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:21.618634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:21.618634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:21.618634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:21.618634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:21.618634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:21.618634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:21.618634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:21.618634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:38:21.618634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:21.621682 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 175/353] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:38:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:21.623099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450883fc-9020-455a-b8b6-d288b356a943 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:21.633393 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46981c56-8a0d-4e3e-9e34-e4c5faaaaa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:21.634064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46981c56-8a0d-4e3e-9e34-e4c5faaaaa7d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:21.634347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46981c56-8a0d-4e3e-9e34-e4c5faaaaa7d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:21.634622 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46981c56-8a0d-4e3e-9e34-e4c5faaaaa7d None admin] PATH_INFO: `/v3/groups/b30ccd35a8404a14943d1403745fd580` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:21.637044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46981c56-8a0d-4e3e-9e34-e4c5faaaaa7d None admin] RBAC: Authorizing `identity:get_group(group_id=b30ccd35a8404a14943d1403745fd580)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:21.638252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46981c56-8a0d-4e3e-9e34-e4c5faaaaa7d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:21.640126 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 179/354] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Sep 6 22:38:21 2022] GET /identity/v3/groups/b30ccd35a8404a14943d1403745fd580 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:21.641328 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b5bd8-2f67-40d1-8e04-ae94b325ed7d None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:21.641539 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b5bd8-2f67-40d1-8e04-ae94b325ed7d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:21.646991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b5bd8-2f67-40d1-8e04-ae94b325ed7d None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:21.648229 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 180/355] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:21.648909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b5bd8-2f67-40d1-8e04-ae94b325ed7d None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:21.770587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:21.776761 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b5bd8-2f67-40d1-8e04-ae94b325ed7d None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:21.776909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450883fc-9020-455a-b8b6-d288b356a943 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:21.817519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c36a4-a085-4b06-8041-3ab6ee211109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:21.818065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c36a4-a085-4b06-8041-3ab6ee211109 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:21.818348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c36a4-a085-4b06-8041-3ab6ee211109 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:21.818620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c36a4-a085-4b06-8041-3ab6ee211109 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:21.819296 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c36a4-a085-4b06-8041-3ab6ee211109 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:21.819598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c36a4-a085-4b06-8041-3ab6ee211109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:21.821007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c36a4-a085-4b06-8041-3ab6ee211109 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:21.823389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fd8ad-da67-4080-8474-788688863986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:21.824579 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fd8ad-da67-4080-8474-788688863986 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:21.824862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fd8ad-da67-4080-8474-788688863986 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:21.825132 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fd8ad-da67-4080-8474-788688863986 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:21.830546 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 181/356] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:21.832241 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c36a4-a085-4b06-8041-3ab6ee211109 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:21.837226 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:21.844791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fd8ad-da67-4080-8474-788688863986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:21.851152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-393fd8ad-da67-4080-8474-788688863986 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:21.851152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:21.851152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:21.851152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:21.851152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:21.851152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:21.851152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:21.851152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:21.851152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:21.851152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:21.851152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:21.851152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:21.851152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:21.851152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:21.851152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:21.851152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:21.852074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:21.852074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:21.852074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:21.852074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:21.852074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:21.852074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:21.852074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:21.852074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:21.852074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:21.852074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:21.852074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:21.852074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:21.852074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:21.852074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:21.852074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:21.852074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:21.852952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:21.852952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:21.852952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:21.852952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:21.852952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:21.852952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:21.852952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:21.852952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:21.852952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:21.852952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:21.852952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:21.852952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:21.852952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 176/357] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:21.854162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153c66f-5465-4f4e-83c8-de2b0b766c4f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:21.854162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153c66f-5465-4f4e-83c8-de2b0b766c4f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:21.854406 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153c66f-5465-4f4e-83c8-de2b0b766c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:21.876146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e153c66f-5465-4f4e-83c8-de2b0b766c4f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:21.877397 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e153c66f-5465-4f4e-83c8-de2b0b766c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:21.961963 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 177/358] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:21.963302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a2f3c-8808-44a9-aea5-88e0ad2a106f None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:21.963587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a2f3c-8808-44a9-aea5-88e0ad2a106f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:21.963859 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a2f3c-8808-44a9-aea5-88e0ad2a106f None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:21.965371 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 178/359] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:21.966088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a2f3c-8808-44a9-aea5-88e0ad2a106f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:21.983028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c36a4-a085-4b06-8041-3ab6ee211109 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:22.030036 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deece0f-f4ec-494b-a30f-28bae3f46b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:22.031043 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deece0f-f4ec-494b-a30f-28bae3f46b94 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:22.032148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deece0f-f4ec-494b-a30f-28bae3f46b94 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:22.032456 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deece0f-f4ec-494b-a30f-28bae3f46b94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:22.033210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deece0f-f4ec-494b-a30f-28bae3f46b94 None admin] RBAC: Adding query filter params (group.id=b30ccd35a8404a14943d1403745fd580, role.id=01a26dc2b1034e33af13752c154d24f4, scope.project.id=2ad919f473ed42dba141f5a8838458b9) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:22.033677 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deece0f-f4ec-494b-a30f-28bae3f46b94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:22.035412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deece0f-f4ec-494b-a30f-28bae3f46b94 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:22.042393 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 182/360] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Sep 6 22:38:21 2022] GET /identity/v3/role_assignments?group.id=b30ccd35a8404a14943d1403745fd580&scope.project.id=2ad919f473ed42dba141f5a8838458b9&role.id=01a26dc2b1034e33af13752c154d24f4 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:22.043478 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deece0f-f4ec-494b-a30f-28bae3f46b94 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:22.108067 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:22.144314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a2f3c-8808-44a9-aea5-88e0ad2a106f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:22.186609 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:22.197562 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deece0f-f4ec-494b-a30f-28bae3f46b94 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:22.209338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564b7b3-e79c-4540-b6f7-ddea10777214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:22.209979 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564b7b3-e79c-4540-b6f7-ddea10777214 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:22.210259 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564b7b3-e79c-4540-b6f7-ddea10777214 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:22.210525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564b7b3-e79c-4540-b6f7-ddea10777214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:22.239789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262126a-b9c1-4a86-b948-42ca3185fa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:22.240563 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262126a-b9c1-4a86-b948-42ca3185fa5a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:22.240844 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262126a-b9c1-4a86-b948-42ca3185fa5a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:22.241170 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262126a-b9c1-4a86-b948-42ca3185fa5a None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:22.241849 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262126a-b9c1-4a86-b948-42ca3185fa5a None admin] RBAC: Adding query filter params (name=member) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:22.242181 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262126a-b9c1-4a86-b948-42ca3185fa5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:22.243573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262126a-b9c1-4a86-b948-42ca3185fa5a None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:22.254026 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 183/361] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:38:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:22.255327 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd64339-15fc-4b2e-80b2-0d283f93818d None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:22.255616 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd64339-15fc-4b2e-80b2-0d283f93818d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:22.255950 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd64339-15fc-4b2e-80b2-0d283f93818d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:22.284507 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-ecd64339-15fc-4b2e-80b2-0d283f93818d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:22.285709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ecd64339-15fc-4b2e-80b2-0d283f93818d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:22.321077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564b7b3-e79c-4540-b6f7-ddea10777214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:22.323292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564b7b3-e79c-4540-b6f7-ddea10777214 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:22.363950 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 184/362] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:22.364224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd64339-15fc-4b2e-80b2-0d283f93818d None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:22.379602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:22.442438 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 179/363] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:22.443665 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564b7b3-e79c-4540-b6f7-ddea10777214 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:22.472255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd64339-15fc-4b2e-80b2-0d283f93818d None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:22.487398 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:22.509811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5922f4-6263-4b9f-8c86-af79f0952a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:22.510430 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5922f4-6263-4b9f-8c86-af79f0952a72 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:22.510706 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5922f4-6263-4b9f-8c86-af79f0952a72 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:22.510978 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5922f4-6263-4b9f-8c86-af79f0952a72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:22.574369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564b7b3-e79c-4540-b6f7-ddea10777214 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:22.615018 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1881c6-6300-492c-8f15-8b766a9694bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:22.616309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1881c6-6300-492c-8f15-8b766a9694bc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:22.616968 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1881c6-6300-492c-8f15-8b766a9694bc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:22.617938 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1881c6-6300-492c-8f15-8b766a9694bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:22.630623 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1881c6-6300-492c-8f15-8b766a9694bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:22.635862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-df1881c6-6300-492c-8f15-8b766a9694bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 22:38:22.635862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:22.635862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:22.635862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:22.635862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:22.635862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:22.635862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:22.635862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:22.635862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:22.635862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:22.635862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:22.635862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:22.635862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:22.635862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:22.635862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:22.635862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:22.636772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:22.636772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:22.636772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:22.636772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:22.636772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:22.636772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:22.636772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:22.636772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:22.636772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:22.636772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:22.636772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:22.636772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:22.636772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:22.636772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:22.636772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:22.636772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:22.637593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:22.637593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:22.637593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:22.637593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:22.637593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:22.637593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:22.637593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:22.637593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:22.637593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:22.637593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:22.637593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 22:38:22.637593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:22.640292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 180/364] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:22.641878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1881c6-6300-492c-8f15-8b766a9694bc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:22.698695 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5922f4-6263-4b9f-8c86-af79f0952a72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:22.700256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5922f4-6263-4b9f-8c86-af79f0952a72 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:22.716642 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:22.744378 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:22.778432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1881c6-6300-492c-8f15-8b766a9694bc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:22.823721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 185/365] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:22.826418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5922f4-6263-4b9f-8c86-af79f0952a72 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:22.832262 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444e96a-10a9-46a1-8bd8-de951a135e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:22.832998 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444e96a-10a9-46a1-8bd8-de951a135e6c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:22.833275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444e96a-10a9-46a1-8bd8-de951a135e6c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:22.833543 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444e96a-10a9-46a1-8bd8-de951a135e6c None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:22.834727 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444e96a-10a9-46a1-8bd8-de951a135e6c None admin] RBAC: Authorizing `identity:get_project(project_id=b1baa713334143d9b2b624372a19f941)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:22.836757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444e96a-10a9-46a1-8bd8-de951a135e6c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:22.839235 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 181/366] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:22 2022] GET /identity/v3/projects/b1baa713334143d9b2b624372a19f941 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:22.840454 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444e96a-10a9-46a1-8bd8-de951a135e6c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:22.948648 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5922f4-6263-4b9f-8c86-af79f0952a72 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:22.965482 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:22.987338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444e96a-10a9-46a1-8bd8-de951a135e6c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:22.990865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f5d7e-9583-41aa-8a6c-f06cc244e66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:22.991560 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f5d7e-9583-41aa-8a6c-f06cc244e66b None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:22.991850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f5d7e-9583-41aa-8a6c-f06cc244e66b None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:22.992118 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f5d7e-9583-41aa-8a6c-f06cc244e66b None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:22.992874 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f5d7e-9583-41aa-8a6c-f06cc244e66b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:22.993181 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f5d7e-9583-41aa-8a6c-f06cc244e66b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:22.994562 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f5d7e-9583-41aa-8a6c-f06cc244e66b None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:23.006150 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 186/367] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:38:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:23.007000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f5d7e-9583-41aa-8a6c-f06cc244e66b None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:23.044488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8af38c-4ec5-438a-af23-51fe2490546b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:23.045148 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8af38c-4ec5-438a-af23-51fe2490546b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:23.045433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8af38c-4ec5-438a-af23-51fe2490546b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:23.045814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8af38c-4ec5-438a-af23-51fe2490546b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:23.058669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8af38c-4ec5-438a-af23-51fe2490546b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:23.064552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ae8af38c-4ec5-438a-af23-51fe2490546b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:38:23.064552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:23.064552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:23.064552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:23.064552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:23.064552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:23.064552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:23.064552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:23.064552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:23.064552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:23.064552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:23.064552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:23.064552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:23.064552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:23.064552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:23.064552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:23.065448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:23.065448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:23.065448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:23.065448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:23.065448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:23.065448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:23.065448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:23.065448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:23.065448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:23.065448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:23.065448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:23.065448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:23.065448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:23.065448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:23.065448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:23.065448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:23.066297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:23.066297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:23.066297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:23.066297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:23.066297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:23.066297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:23.066297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:23.066297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:23.066297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:23.066297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:23.066297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:38:23.066297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:23.066297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 182/368] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:38:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:23.066965 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8af38c-4ec5-438a-af23-51fe2490546b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:23.093385 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:23.154279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f5d7e-9583-41aa-8a6c-f06cc244e66b None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:23.198881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f708842-16f9-47ea-a203-952e1a011513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:23.199846 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f708842-16f9-47ea-a203-952e1a011513 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:23.200273 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f708842-16f9-47ea-a203-952e1a011513 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:23.200856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f708842-16f9-47ea-a203-952e1a011513 None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:23.202741 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f708842-16f9-47ea-a203-952e1a011513 None admin] RBAC: Authorizing `identity:get_project(project_id=b1baa713334143d9b2b624372a19f941)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:23.204363 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f708842-16f9-47ea-a203-952e1a011513 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:23.204986 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8af38c-4ec5-438a-af23-51fe2490546b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:23.207655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 187/369] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:23 2022] GET /identity/v3/projects/b1baa713334143d9b2b624372a19f941 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:23.209411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f708842-16f9-47ea-a203-952e1a011513 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:23.248283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36978a-d818-4e6e-8e24-8c637d579efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:23.248999 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36978a-d818-4e6e-8e24-8c637d579efd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:23.249283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36978a-d818-4e6e-8e24-8c637d579efd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:23.249555 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36978a-d818-4e6e-8e24-8c637d579efd None admin] PATH_INFO: `/v3/groups/b30ccd35a8404a14943d1403745fd580` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:23.250718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36978a-d818-4e6e-8e24-8c637d579efd None admin] RBAC: Authorizing `identity:get_group(group_id=b30ccd35a8404a14943d1403745fd580)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:23.252571 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36978a-d818-4e6e-8e24-8c637d579efd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:23.259295 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 183/370] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Sep 6 22:38:23 2022] GET /identity/v3/groups/b30ccd35a8404a14943d1403745fd580 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:23.260135 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36978a-d818-4e6e-8e24-8c637d579efd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:23.269827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:23.336553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f708842-16f9-47ea-a203-952e1a011513 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:23.374312 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:23.385646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c68dfe-736a-468b-b0ab-b73ad27c42e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:23.386939 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c68dfe-736a-468b-b0ab-b73ad27c42e7 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:23.387380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c68dfe-736a-468b-b0ab-b73ad27c42e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:23.388175 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c68dfe-736a-468b-b0ab-b73ad27c42e7 None admin] PATH_INFO: `/v3/users/d87a6f392e964f4bb4faa195fb275c1c` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:23.389919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c68dfe-736a-468b-b0ab-b73ad27c42e7 None admin] RBAC: Authorizing `identity:get_user(user_id=d87a6f392e964f4bb4faa195fb275c1c)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:23.392371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c68dfe-736a-468b-b0ab-b73ad27c42e7 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:23.393816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36978a-d818-4e6e-8e24-8c637d579efd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:23.397829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 188/371] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:38:23 2022] GET /identity/v3/users/d87a6f392e964f4bb4faa195fb275c1c => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:23.397829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c68dfe-736a-468b-b0ab-b73ad27c42e7 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:23.442815 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b46839-69a1-42c5-babe-455104f6063c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:23.442815 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b46839-69a1-42c5-babe-455104f6063c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:23.443076 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b46839-69a1-42c5-babe-455104f6063c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:23.443319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b46839-69a1-42c5-babe-455104f6063c None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:23.443953 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b46839-69a1-42c5-babe-455104f6063c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:23.444316 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b46839-69a1-42c5-babe-455104f6063c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:23.446682 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b46839-69a1-42c5-babe-455104f6063c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:23.458308 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 184/372] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:23.459090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b46839-69a1-42c5-babe-455104f6063c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:23.533192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c68dfe-736a-468b-b0ab-b73ad27c42e7 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:23.551058 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:23.576860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd99d4-7e2f-4c54-9fab-cc4a31aed1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:23.577927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd99d4-7e2f-4c54-9fab-cc4a31aed1dd None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:23.578989 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd99d4-7e2f-4c54-9fab-cc4a31aed1dd None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:23.579455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd99d4-7e2f-4c54-9fab-cc4a31aed1dd None admin] PATH_INFO: `/v3/groups/b30ccd35a8404a14943d1403745fd580` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:23.580856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd99d4-7e2f-4c54-9fab-cc4a31aed1dd None admin] RBAC: Authorizing `identity:get_group(group_id=b30ccd35a8404a14943d1403745fd580)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:23.582745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd99d4-7e2f-4c54-9fab-cc4a31aed1dd None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:23.584979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 189/373] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Sep 6 22:38:23 2022] GET /identity/v3/groups/b30ccd35a8404a14943d1403745fd580 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:23.585939 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b46839-69a1-42c5-babe-455104f6063c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:23.586307 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd99d4-7e2f-4c54-9fab-cc4a31aed1dd None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:23.626495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c263a-9bf0-4c49-968e-67d4c0466009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:23.627125 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c263a-9bf0-4c49-968e-67d4c0466009 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:23.627412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c263a-9bf0-4c49-968e-67d4c0466009 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:23.627739 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c263a-9bf0-4c49-968e-67d4c0466009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:23.630108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c263a-9bf0-4c49-968e-67d4c0466009 None admin] RBAC: Adding query filter params (group.id=b30ccd35a8404a14943d1403745fd580, role.id=01a26dc2b1034e33af13752c154d24f4, scope.project.id=b1baa713334143d9b2b624372a19f941) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:23.630108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c263a-9bf0-4c49-968e-67d4c0466009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:23.630299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c263a-9bf0-4c49-968e-67d4c0466009 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:23.637174 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 185/374] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Sep 6 22:38:23 2022] GET /identity/v3/role_assignments?group.id=b30ccd35a8404a14943d1403745fd580&scope.project.id=b1baa713334143d9b2b624372a19f941&role.id=01a26dc2b1034e33af13752c154d24f4 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:23.638230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c263a-9bf0-4c49-968e-67d4c0466009 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:23.664652 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:23.700949 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd99d4-7e2f-4c54-9fab-cc4a31aed1dd None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:23.738565 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d497c71-b66e-4d93-af65-a531d139d785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:23.739527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d497c71-b66e-4d93-af65-a531d139d785 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:23.740004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d497c71-b66e-4d93-af65-a531d139d785 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:23.740494 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d497c71-b66e-4d93-af65-a531d139d785 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:23.741457 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d497c71-b66e-4d93-af65-a531d139d785 None admin] RBAC: Adding query filter params (role.id=ee530d022cde4038bd521a1bb5f5ba6f, user.id=d87a6f392e964f4bb4faa195fb275c1c, scope.system=all) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:23.741963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d497c71-b66e-4d93-af65-a531d139d785 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:23.743645 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d497c71-b66e-4d93-af65-a531d139d785 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:23.764996 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 190/375] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Sep 6 22:38:23 2022] GET /identity/v3/role_assignments?user.id=d87a6f392e964f4bb4faa195fb275c1c&scope.system=all&role.id=ee530d022cde4038bd521a1bb5f5ba6f => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:23.766867 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d497c71-b66e-4d93-af65-a531d139d785 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:23.866093 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:23.887262 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c263a-9bf0-4c49-968e-67d4c0466009 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:23.940133 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219483d-74b1-4787-b4ee-f98925e7cb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:23.941143 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219483d-74b1-4787-b4ee-f98925e7cb76 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:23.941620 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219483d-74b1-4787-b4ee-f98925e7cb76 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:23.942132 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219483d-74b1-4787-b4ee-f98925e7cb76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:23.964491 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d497c71-b66e-4d93-af65-a531d139d785 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:24.014788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7d8a0-5717-4e84-a498-35b2a8e2dc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:24.015425 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7d8a0-5717-4e84-a498-35b2a8e2dc21 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:24.015759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7d8a0-5717-4e84-a498-35b2a8e2dc21 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:24.016576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7d8a0-5717-4e84-a498-35b2a8e2dc21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:24.017430 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7d8a0-5717-4e84-a498-35b2a8e2dc21 None admin] RBAC: Adding query filter params (group.id=b30ccd35a8404a14943d1403745fd580, role.id=093c83b316db4d0f9dc55ec6e3583ba8, scope.project.id=b1baa713334143d9b2b624372a19f941) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:24.017743 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7d8a0-5717-4e84-a498-35b2a8e2dc21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:24.020004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7d8a0-5717-4e84-a498-35b2a8e2dc21 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:24.028835 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 191/376] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Sep 6 22:38:23 2022] GET /identity/v3/role_assignments?group.id=b30ccd35a8404a14943d1403745fd580&scope.project.id=b1baa713334143d9b2b624372a19f941&role.id=093c83b316db4d0f9dc55ec6e3583ba8 => generated 260 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:24.039878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219483d-74b1-4787-b4ee-f98925e7cb76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:24.041732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219483d-74b1-4787-b4ee-f98925e7cb76 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:24.062259 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:24.189298 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 186/377] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:24.195457 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7d8a0-5717-4e84-a498-35b2a8e2dc21 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:24.315868 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7d8a0-5717-4e84-a498-35b2a8e2dc21 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:24.317850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:24.357763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190e07f-06a4-43b4-be91-2714d062db35 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:24.358712 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190e07f-06a4-43b4-be91-2714d062db35 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:24.359188 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190e07f-06a4-43b4-be91-2714d062db35 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:24.361422 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 187/378] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:24.364026 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe27b30-7a13-4ddc-b759-108ac0acdfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:24.364925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe27b30-7a13-4ddc-b759-108ac0acdfba None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:24.365384 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe27b30-7a13-4ddc-b759-108ac0acdfba None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:24.365834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe27b30-7a13-4ddc-b759-108ac0acdfba None admin] PATH_INFO: `/v3/projects/ff1d6ddadcad498caaf30606299b1515` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:24.367190 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0233b3f-cc2c-4922-9cf4-adb22a0eee85 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:24.367394 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe27b30-7a13-4ddc-b759-108ac0acdfba None admin] RBAC: Authorizing `identity:get_project(project_id=ff1d6ddadcad498caaf30606299b1515)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:24.367610 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0233b3f-cc2c-4922-9cf4-adb22a0eee85 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:24.367962 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0233b3f-cc2c-4922-9cf4-adb22a0eee85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:24.369445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe27b30-7a13-4ddc-b759-108ac0acdfba None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:24.371693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 192/379] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:24 2022] GET /identity/v3/projects/ff1d6ddadcad498caaf30606299b1515 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:24.377968 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe27b30-7a13-4ddc-b759-108ac0acdfba None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:24.400665 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d0233b3f-cc2c-4922-9cf4-adb22a0eee85 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:24.402209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d0233b3f-cc2c-4922-9cf4-adb22a0eee85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:24.517027 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 188/380] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 22:38:24.540265 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe27b30-7a13-4ddc-b759-108ac0acdfba None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:24.593206 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f9180-e378-494a-b1f4-c97b9ea96525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:24.593771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9180-e378-494a-b1f4-c97b9ea96525 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:24.594160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9180-e378-494a-b1f4-c97b9ea96525 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:24.594436 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9180-e378-494a-b1f4-c97b9ea96525 None admin] PATH_INFO: `/v3/groups/be72e47f08d6416e935204bda13434bf` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:24.600882 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f9180-e378-494a-b1f4-c97b9ea96525 None admin] RBAC: Authorizing `identity:get_group(group_id=be72e47f08d6416e935204bda13434bf)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:24.602438 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f9180-e378-494a-b1f4-c97b9ea96525 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:24.604074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 193/381] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Sep 6 22:38:24 2022] GET /identity/v3/groups/be72e47f08d6416e935204bda13434bf => generated 229 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:24.610848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0233b3f-cc2c-4922-9cf4-adb22a0eee85 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:24.669779 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:24.742312 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0233b3f-cc2c-4922-9cf4-adb22a0eee85 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:24.779315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c533aed-1068-4ac8-8955-07768430184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:24.780025 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c533aed-1068-4ac8-8955-07768430184b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:24.780308 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c533aed-1068-4ac8-8955-07768430184b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:24.780639 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c533aed-1068-4ac8-8955-07768430184b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:24.781905 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c533aed-1068-4ac8-8955-07768430184b None admin] RBAC: Adding query filter params (group.id=be72e47f08d6416e935204bda13434bf, role.id=aa2332d1bdb74e48a88ed7c2a7ed2990, scope.project.id=ff1d6ddadcad498caaf30606299b1515) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:24.782214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c533aed-1068-4ac8-8955-07768430184b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:24.783649 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c533aed-1068-4ac8-8955-07768430184b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:24.789629 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 189/382] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Sep 6 22:38:24 2022] GET /identity/v3/role_assignments?group.id=be72e47f08d6416e935204bda13434bf&scope.project.id=ff1d6ddadcad498caaf30606299b1515&role.id=aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:24.872522 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f9180-e378-494a-b1f4-c97b9ea96525 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:24.899035 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98a2aa-aabe-4dfe-9f68-6b15d93b45a3 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:24.899601 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98a2aa-aabe-4dfe-9f68-6b15d93b45a3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:24.900161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98a2aa-aabe-4dfe-9f68-6b15d93b45a3 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:24.901720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 190/383] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:38:24.908036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d06b3-0953-4c1e-8de1-74c9723bc302 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:24.908615 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d06b3-0953-4c1e-8de1-74c9723bc302 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:24.909138 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d06b3-0953-4c1e-8de1-74c9723bc302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:24.914397 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:24.945571 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f07d06b3-0953-4c1e-8de1-74c9723bc302 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:24.947139 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f07d06b3-0953-4c1e-8de1-74c9723bc302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:24.994250 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f9180-e378-494a-b1f4-c97b9ea96525 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:25.049663 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b84f73-b275-49ff-b671-ca8a0d0702e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:25.050667 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b84f73-b275-49ff-b671-ca8a0d0702e3 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:25.051157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b84f73-b275-49ff-b671-ca8a0d0702e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:25.051625 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b84f73-b275-49ff-b671-ca8a0d0702e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:25.074114 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b84f73-b275-49ff-b671-ca8a0d0702e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:25.080610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-f4b84f73-b275-49ff-b671-ca8a0d0702e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:25.080610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:25.080610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:25.080610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:25.080610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:25.080610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:25.080610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:25.080610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:25.080610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:25.080610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:25.080610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:25.080610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:25.080610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:25.080610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:25.080610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:25.080610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:25.081794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:25.081794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:25.081794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:25.081794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:25.081794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:25.081794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:25.081794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:25.081794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:25.081794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:25.081794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:25.081794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:25.081794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:25.081794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:25.081794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:25.081794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:25.081794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:25.082597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:25.082597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:25.082597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:25.082597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:25.082597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:25.082597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:25.082597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:25.082597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:25.082597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:25.082597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:25.082597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:25.082597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:25.087668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 191/384] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 22:38:25.089047 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 194/385] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:25.095410 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d06b3-0953-4c1e-8de1-74c9723bc302 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:25.145593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:25.226690 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d06b3-0953-4c1e-8de1-74c9723bc302 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:25.269197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e7b4b-6d80-47ec-a960-f68590b50b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:25.269819 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e7b4b-6d80-47ec-a960-f68590b50b4d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:25.270092 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e7b4b-6d80-47ec-a960-f68590b50b4d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:25.270360 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e7b4b-6d80-47ec-a960-f68590b50b4d None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:25.271034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e7b4b-6d80-47ec-a960-f68590b50b4d None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:25.271334 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e7b4b-6d80-47ec-a960-f68590b50b4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:25.272842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e7b4b-6d80-47ec-a960-f68590b50b4d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:25.282091 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 192/386] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:38:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:25.287568 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b84f73-b275-49ff-b671-ca8a0d0702e3 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:25.411883 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:25.421895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b84f73-b275-49ff-b671-ca8a0d0702e3 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:25.431646 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e7b4b-6d80-47ec-a960-f68590b50b4d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:25.461273 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e5fbe-4062-4c9a-bc64-5dde9b13075e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:25.461924 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e5fbe-4062-4c9a-bc64-5dde9b13075e None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:25.462203 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e5fbe-4062-4c9a-bc64-5dde9b13075e None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:25.462480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e5fbe-4062-4c9a-bc64-5dde9b13075e None admin] PATH_INFO: `/v3/groups/b30ccd35a8404a14943d1403745fd580` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:25.463621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e5fbe-4062-4c9a-bc64-5dde9b13075e None admin] RBAC: Authorizing `identity:get_group(group_id=b30ccd35a8404a14943d1403745fd580)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:25.466231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e5fbe-4062-4c9a-bc64-5dde9b13075e None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:25.466712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 195/387] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Sep 6 22:38:25 2022] GET /identity/v3/groups/b30ccd35a8404a14943d1403745fd580 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:25.472576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e5fbe-4062-4c9a-bc64-5dde9b13075e None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:25.553098 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e7b4b-6d80-47ec-a960-f68590b50b4d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:25.556770 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:25.592414 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3039a-2f04-46b6-a9b7-ea0c8c5065d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:25.594298 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3039a-2f04-46b6-a9b7-ea0c8c5065d7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:25.594784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3039a-2f04-46b6-a9b7-ea0c8c5065d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:25.595255 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3039a-2f04-46b6-a9b7-ea0c8c5065d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:25.607823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3039a-2f04-46b6-a9b7-ea0c8c5065d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:25.614024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-eae3039a-2f04-46b6-a9b7-ea0c8c5065d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:38:25.614024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:25.614024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:25.614024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:25.614024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:25.614024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:25.614024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:25.614024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:25.614024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:25.614024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:25.614024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:25.614024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:25.614024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:25.614024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:25.614024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:25.614024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:25.614916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:25.614916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:25.614916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:25.614916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:25.614916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:25.614916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:25.614916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:25.614916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:25.614916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:25.614916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:25.614916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:25.614916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:25.614916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:25.614916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:25.614916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:25.614916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:25.615720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:25.615720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:25.615720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:25.615720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:25.615720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:25.615720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:25.615720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:25.615720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:25.615720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:25.615720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:25.615720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:38:25.615720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:25.618586 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 193/388] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:38:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:38:25.626441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3039a-2f04-46b6-a9b7-ea0c8c5065d7 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:25.692823 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e5fbe-4062-4c9a-bc64-5dde9b13075e None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:25.731720 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45d52d-2afa-4f66-99a8-16733218b64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:25.732782 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45d52d-2afa-4f66-99a8-16733218b64b None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:25.733264 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45d52d-2afa-4f66-99a8-16733218b64b None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:25.733747 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45d52d-2afa-4f66-99a8-16733218b64b None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:25.735110 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45d52d-2afa-4f66-99a8-16733218b64b None admin] RBAC: Authorizing `identity:get_project(project_id=2ad919f473ed42dba141f5a8838458b9)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:25.736873 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45d52d-2afa-4f66-99a8-16733218b64b None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:25.739033 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 196/389] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:25 2022] GET /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:25.753382 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45d52d-2afa-4f66-99a8-16733218b64b None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:25.776317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3039a-2f04-46b6-a9b7-ea0c8c5065d7 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:25.806064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:25.811091 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17599e-c356-4a7b-95ac-4c9c7f8b8673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:25.812153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17599e-c356-4a7b-95ac-4c9c7f8b8673 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:25.812153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17599e-c356-4a7b-95ac-4c9c7f8b8673 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:25.812348 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17599e-c356-4a7b-95ac-4c9c7f8b8673 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:25.813512 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17599e-c356-4a7b-95ac-4c9c7f8b8673 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:25.813818 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17599e-c356-4a7b-95ac-4c9c7f8b8673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:25.815214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17599e-c356-4a7b-95ac-4c9c7f8b8673 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:25.824408 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 194/390] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:25.830257 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17599e-c356-4a7b-95ac-4c9c7f8b8673 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:25.854307 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:25.907333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45d52d-2afa-4f66-99a8-16733218b64b None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:25.940391 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17599e-c356-4a7b-95ac-4c9c7f8b8673 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:25.971841 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4026684-8d4c-4684-899f-fe95dc8be664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:25.972842 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4026684-8d4c-4684-899f-fe95dc8be664 None admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:25.973299 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4026684-8d4c-4684-899f-fe95dc8be664 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:25.973738 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4026684-8d4c-4684-899f-fe95dc8be664 None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9/groups/b30ccd35a8404a14943d1403745fd580/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:25.975869 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4026684-8d4c-4684-899f-fe95dc8be664 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad919f473ed42dba141f5a8838458b9, group_id=b30ccd35a8404a14943d1403745fd580, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:25.977528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4026684-8d4c-4684-899f-fe95dc8be664 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:25.978657 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064efe02-165e-4307-b766-365b6ebf6821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:25.979381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064efe02-165e-4307-b766-365b6ebf6821 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:25.979745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064efe02-165e-4307-b766-365b6ebf6821 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:25.980097 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064efe02-165e-4307-b766-365b6ebf6821 None admin] PATH_INFO: `/v3/groups/b30ccd35a8404a14943d1403745fd580` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:25.981337 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064efe02-165e-4307-b766-365b6ebf6821 None admin] RBAC: Authorizing `identity:get_group(group_id=b30ccd35a8404a14943d1403745fd580)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:25.988446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064efe02-165e-4307-b766-365b6ebf6821 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:25.988446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 195/391] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Sep 6 22:38:25 2022] GET /identity/v3/groups/b30ccd35a8404a14943d1403745fd580 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:25.991361 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064efe02-165e-4307-b766-365b6ebf6821 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:26.078216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 197/392] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Sep 6 22:38:25 2022] PUT /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9/groups/b30ccd35a8404a14943d1403745fd580/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:38:26.090836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:26.099844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064efe02-165e-4307-b766-365b6ebf6821 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:26.137935 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5b71f-477c-4222-96b1-e2d7fb77050a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:26.138593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5b71f-477c-4222-96b1-e2d7fb77050a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:26.138874 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5b71f-477c-4222-96b1-e2d7fb77050a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:26.139151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5b71f-477c-4222-96b1-e2d7fb77050a None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:26.140325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5b71f-477c-4222-96b1-e2d7fb77050a None admin] RBAC: Authorizing `identity:get_project(project_id=2ad919f473ed42dba141f5a8838458b9)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:26.141871 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5b71f-477c-4222-96b1-e2d7fb77050a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:26.143901 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 196/393] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:25 2022] GET /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:26.149769 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4026684-8d4c-4684-899f-fe95dc8be664 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:26.254264 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:26.264460 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4026684-8d4c-4684-899f-fe95dc8be664 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:26.306762 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfeeb6-e65a-4c41-99d9-30fee3ef6e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:26.308151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfeeb6-e65a-4c41-99d9-30fee3ef6e3e None admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:26.308635 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfeeb6-e65a-4c41-99d9-30fee3ef6e3e None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:26.309052 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfeeb6-e65a-4c41-99d9-30fee3ef6e3e None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9/groups/b30ccd35a8404a14943d1403745fd580/roles/01a26dc2b1034e33af13752c154d24f4` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:26.311535 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfeeb6-e65a-4c41-99d9-30fee3ef6e3e None admin] RBAC: Authorizing `identity:create_grant(project_id=2ad919f473ed42dba141f5a8838458b9, group_id=b30ccd35a8404a14943d1403745fd580, role_id=01a26dc2b1034e33af13752c154d24f4)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:26.313220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfeeb6-e65a-4c41-99d9-30fee3ef6e3e None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:26.409041 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 198/394] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Sep 6 22:38:26 2022] PUT /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9/groups/b30ccd35a8404a14943d1403745fd580/roles/01a26dc2b1034e33af13752c154d24f4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:38:26.605272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a47c9-ac58-4915-9932-b278e181b5d3 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:26.606089 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a47c9-ac58-4915-9932-b278e181b5d3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:26.606528 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a47c9-ac58-4915-9932-b278e181b5d3 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:26.608370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 197/395] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:26.614939 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9dd48-4f3e-4840-b19f-37bd2f3828a3 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:26.615429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9dd48-4f3e-4840-b19f-37bd2f3828a3 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:26.615852 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9dd48-4f3e-4840-b19f-37bd2f3828a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:26.635494 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-26a9dd48-4f3e-4840-b19f-37bd2f3828a3 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:26.636992 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-26a9dd48-4f3e-4840-b19f-37bd2f3828a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:26.719770 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 199/396] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:26.977884 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c891244-9a75-4474-a959-242cd8343489 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:26.978534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c891244-9a75-4474-a959-242cd8343489 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:26.979039 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c891244-9a75-4474-a959-242cd8343489 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:26.980870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 198/397] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:26.986468 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072caa6a-0716-445d-ab48-d2385a1bdb9d None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:26.987004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072caa6a-0716-445d-ab48-d2385a1bdb9d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:26.987478 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072caa6a-0716-445d-ab48-d2385a1bdb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:27.008215 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-072caa6a-0716-445d-ab48-d2385a1bdb9d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:27.008721 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c891244-9a75-4474-a959-242cd8343489 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:27.010108 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-072caa6a-0716-445d-ab48-d2385a1bdb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:27.100908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 200/398] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:27.153366 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c891244-9a75-4474-a959-242cd8343489 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:27.200005 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b98516-6c59-4756-998a-af6a9a6d17d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:27.200674 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b98516-6c59-4756-998a-af6a9a6d17d9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:27.200954 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b98516-6c59-4756-998a-af6a9a6d17d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:27.201227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b98516-6c59-4756-998a-af6a9a6d17d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:27.219388 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b98516-6c59-4756-998a-af6a9a6d17d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:27.224804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-50b98516-6c59-4756-998a-af6a9a6d17d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:38:27.224804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:27.224804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:27.224804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:27.224804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:27.224804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:27.224804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:27.224804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:27.224804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:27.224804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:27.224804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:27.224804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:27.224804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:27.224804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:27.224804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:27.224804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:27.225711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:27.225711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:27.225711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:27.225711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:27.225711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:27.225711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:27.225711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:27.225711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:27.225711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:27.225711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:27.225711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:27.225711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:27.225711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:27.225711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:27.225711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:27.225711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:27.226541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:27.226541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:27.226541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:27.226541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:27.226541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:27.226541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:27.226541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:27.226541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:27.226541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:27.226541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:27.226541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:38:27.226541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:27.226541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 199/399] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:38:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:27.232238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072caa6a-0716-445d-ab48-d2385a1bdb9d None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:27.247989 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:27.355158 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072caa6a-0716-445d-ab48-d2385a1bdb9d None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:27.395872 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2805c-fd74-4841-8a72-3c32e37a4f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:27.396516 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2805c-fd74-4841-8a72-3c32e37a4f12 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:27.396798 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2805c-fd74-4841-8a72-3c32e37a4f12 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:27.397064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2805c-fd74-4841-8a72-3c32e37a4f12 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:27.397729 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2805c-fd74-4841-8a72-3c32e37a4f12 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:27.398024 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2805c-fd74-4841-8a72-3c32e37a4f12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:27.399487 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2805c-fd74-4841-8a72-3c32e37a4f12 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:27.408317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 201/400] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:27.413903 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b98516-6c59-4756-998a-af6a9a6d17d9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:27.442604 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:27.442779 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2805c-fd74-4841-8a72-3c32e37a4f12 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:27.544065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:27.581629 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2805c-fd74-4841-8a72-3c32e37a4f12 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:27.619498 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b98516-6c59-4756-998a-af6a9a6d17d9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:27.621962 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00379b82-0d77-45a1-b04f-a665b968bd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:27.622605 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00379b82-0d77-45a1-b04f-a665b968bd19 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:27.622886 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00379b82-0d77-45a1-b04f-a665b968bd19 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:27.623154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00379b82-0d77-45a1-b04f-a665b968bd19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:27.644531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00379b82-0d77-45a1-b04f-a665b968bd19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:27.652132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-00379b82-0d77-45a1-b04f-a665b968bd19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:27.652132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:27.652132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:27.652132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:27.652132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:27.652132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:27.652132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:27.652132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:27.652132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:27.652132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:27.652132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:27.652132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:27.652132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:27.652132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:27.652132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:27.652132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:27.653160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:27.653160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:27.653160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:27.653160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:27.653160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:27.653160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:27.653160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:27.653160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:27.653160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:27.653160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:27.653160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:27.653160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:27.653160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:27.653160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:27.653160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:27.653160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:27.653959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:27.653959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:27.653959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:27.653959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:27.653959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:27.653959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:27.653959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:27.653959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:27.653959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:27.653959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:27.653959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:27.653959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:27.653959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 202/401] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:38:27.661990 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00379b82-0d77-45a1-b04f-a665b968bd19 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:27.691479 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55759039-9ed8-4ec0-94d6-f6574f04e802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:27.692117 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55759039-9ed8-4ec0-94d6-f6574f04e802 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:27.692394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55759039-9ed8-4ec0-94d6-f6574f04e802 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:27.692689 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55759039-9ed8-4ec0-94d6-f6574f04e802 None admin] PATH_INFO: `/v3/groups/b30ccd35a8404a14943d1403745fd580` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:27.693816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55759039-9ed8-4ec0-94d6-f6574f04e802 None admin] RBAC: Authorizing `identity:get_group(group_id=b30ccd35a8404a14943d1403745fd580)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:27.696057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55759039-9ed8-4ec0-94d6-f6574f04e802 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:27.702569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 200/402] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Sep 6 22:38:27 2022] GET /identity/v3/groups/b30ccd35a8404a14943d1403745fd580 => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:27.704349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55759039-9ed8-4ec0-94d6-f6574f04e802 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:27.848054 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00379b82-0d77-45a1-b04f-a665b968bd19 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:27.870535 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:27.883461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:27.888850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad385852-d54a-4ebf-9df9-f7aa66e4ccb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:27.889464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad385852-d54a-4ebf-9df9-f7aa66e4ccb0 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:27.889885 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad385852-d54a-4ebf-9df9-f7aa66e4ccb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:27.890164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad385852-d54a-4ebf-9df9-f7aa66e4ccb0 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:27.890895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad385852-d54a-4ebf-9df9-f7aa66e4ccb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:27.891193 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad385852-d54a-4ebf-9df9-f7aa66e4ccb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:27.892572 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad385852-d54a-4ebf-9df9-f7aa66e4ccb0 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:27.902357 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 203/403] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:38:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:27.910687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad385852-d54a-4ebf-9df9-f7aa66e4ccb0 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:27.912749 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55759039-9ed8-4ec0-94d6-f6574f04e802 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:27.973142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dcc95-b74a-477e-8032-2cb6052cc1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:27.974150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dcc95-b74a-477e-8032-2cb6052cc1bb None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:27.974692 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dcc95-b74a-477e-8032-2cb6052cc1bb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:27.975156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dcc95-b74a-477e-8032-2cb6052cc1bb None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:27.976547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6dcc95-b74a-477e-8032-2cb6052cc1bb None admin] RBAC: Authorizing `identity:get_project(project_id=b1baa713334143d9b2b624372a19f941)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:27.978173 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6dcc95-b74a-477e-8032-2cb6052cc1bb None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:27.980387 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 201/404] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:27 2022] GET /identity/v3/projects/b1baa713334143d9b2b624372a19f941 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:27.986957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dcc95-b74a-477e-8032-2cb6052cc1bb None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:28.058707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad385852-d54a-4ebf-9df9-f7aa66e4ccb0 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:28.102934 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87502f-c99a-4a11-8460-4c6aa8dabfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:28.104002 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87502f-c99a-4a11-8460-4c6aa8dabfc1 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:28.104396 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87502f-c99a-4a11-8460-4c6aa8dabfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:28.104700 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87502f-c99a-4a11-8460-4c6aa8dabfc1 None admin] PATH_INFO: `/v3/groups/b30ccd35a8404a14943d1403745fd580` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:28.105974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87502f-c99a-4a11-8460-4c6aa8dabfc1 None admin] RBAC: Authorizing `identity:get_group(group_id=b30ccd35a8404a14943d1403745fd580)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:28.108054 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87502f-c99a-4a11-8460-4c6aa8dabfc1 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:28.109489 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dcc95-b74a-477e-8032-2cb6052cc1bb None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:28.110027 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 204/405] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Sep 6 22:38:27 2022] GET /identity/v3/groups/b30ccd35a8404a14943d1403745fd580 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:28.111417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690de1cf-b251-495e-9839-ec3313a82b73 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:28.111699 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690de1cf-b251-495e-9839-ec3313a82b73 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:28.111972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690de1cf-b251-495e-9839-ec3313a82b73 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:28.118697 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 205/406] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:28.119535 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690de1cf-b251-495e-9839-ec3313a82b73 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:28.152849 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae264df-bc6d-4e19-bd41-d0d9a6765851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:28.153528 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae264df-bc6d-4e19-bd41-d0d9a6765851 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:28.153830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae264df-bc6d-4e19-bd41-d0d9a6765851 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:28.154097 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae264df-bc6d-4e19-bd41-d0d9a6765851 None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941/groups/b30ccd35a8404a14943d1403745fd580/roles/01a26dc2b1034e33af13752c154d24f4` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:28.164463 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae264df-bc6d-4e19-bd41-d0d9a6765851 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1baa713334143d9b2b624372a19f941, group_id=b30ccd35a8404a14943d1403745fd580, role_id=01a26dc2b1034e33af13752c154d24f4)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:28.164463 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae264df-bc6d-4e19-bd41-d0d9a6765851 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:28.191927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:28.231283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690de1cf-b251-495e-9839-ec3313a82b73 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:28.245269 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 202/407] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Sep 6 22:38:27 2022] PUT /identity/v3/projects/b1baa713334143d9b2b624372a19f941/groups/b30ccd35a8404a14943d1403745fd580/roles/01a26dc2b1034e33af13752c154d24f4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:38:28.248980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6380b94-2f94-4966-b3da-b34c3378684e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:28.249302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6380b94-2f94-4966-b3da-b34c3378684e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:28.250493 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6380b94-2f94-4966-b3da-b34c3378684e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:28.295596 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e6380b94-2f94-4966-b3da-b34c3378684e None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:28.296894 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e6380b94-2f94-4966-b3da-b34c3378684e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:28.306527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995c2bf-a055-4a72-8da0-58c2e6ae21f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:28.307252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995c2bf-a055-4a72-8da0-58c2e6ae21f0 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:28.307527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995c2bf-a055-4a72-8da0-58c2e6ae21f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:28.307796 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995c2bf-a055-4a72-8da0-58c2e6ae21f0 None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:28.310805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995c2bf-a055-4a72-8da0-58c2e6ae21f0 None admin] RBAC: Authorizing `identity:get_project(project_id=b1baa713334143d9b2b624372a19f941)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:28.314439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995c2bf-a055-4a72-8da0-58c2e6ae21f0 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:28.315879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:28.317118 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 206/408] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:28 2022] GET /identity/v3/projects/b1baa713334143d9b2b624372a19f941 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:28.322875 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995c2bf-a055-4a72-8da0-58c2e6ae21f0 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:28.448882 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 203/409] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:28.490383 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995c2bf-a055-4a72-8da0-58c2e6ae21f0 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:28.529496 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:28.540650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390557e7-adfe-4cf7-b54f-7b5f9adab209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:28.541325 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390557e7-adfe-4cf7-b54f-7b5f9adab209 None admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:28.541632 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390557e7-adfe-4cf7-b54f-7b5f9adab209 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:28.541904 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390557e7-adfe-4cf7-b54f-7b5f9adab209 None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941/groups/b30ccd35a8404a14943d1403745fd580/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:28.543812 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390557e7-adfe-4cf7-b54f-7b5f9adab209 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1baa713334143d9b2b624372a19f941, group_id=b30ccd35a8404a14943d1403745fd580, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:28.545317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390557e7-adfe-4cf7-b54f-7b5f9adab209 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:28.630985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 207/410] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Sep 6 22:38:28 2022] PUT /identity/v3/projects/b1baa713334143d9b2b624372a19f941/groups/b30ccd35a8404a14943d1403745fd580/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:38:28.755691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6380b94-2f94-4966-b3da-b34c3378684e None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:28.884500 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6380b94-2f94-4966-b3da-b34c3378684e None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:28.927137 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e808f-02ad-43bd-889d-fd0d1bf03ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:28.927804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e808f-02ad-43bd-889d-fd0d1bf03ad8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:28.928083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e808f-02ad-43bd-889d-fd0d1bf03ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:28.928355 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e808f-02ad-43bd-889d-fd0d1bf03ad8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:28.943292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e808f-02ad-43bd-889d-fd0d1bf03ad8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:28.948324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-459e808f-02ad-43bd-889d-fd0d1bf03ad8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:38:28.948324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:28.948324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:28.948324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:28.948324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:28.948324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:28.948324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:28.948324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:28.948324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:28.948324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:28.948324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:28.948324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:28.948324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:28.948324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:28.948324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:28.948324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:28.949289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:28.949289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:28.949289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:28.949289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:28.949289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:28.949289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:28.949289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:28.949289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:28.949289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:28.949289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:28.949289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:28.949289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:28.949289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:28.949289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:28.949289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:28.949289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:28.950111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:28.950111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:28.950111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:28.950111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:28.950111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:28.950111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:28.950111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:28.950111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:28.950111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:28.950111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:28.950111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:38:28.950111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:28.950111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 204/411] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:38:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:28.956731 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390557e7-adfe-4cf7-b54f-7b5f9adab209 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:29.036021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3c983-0b13-487e-9785-3491b7f3d2b2 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:29.036331 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3c983-0b13-487e-9785-3491b7f3d2b2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:29.036578 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3c983-0b13-487e-9785-3491b7f3d2b2 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:29.037829 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 205/412] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:29.043324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b98797-d4cf-4f8a-8d6c-af79e0d50a33 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:29.043606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b98797-d4cf-4f8a-8d6c-af79e0d50a33 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:29.043878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b98797-d4cf-4f8a-8d6c-af79e0d50a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:29.060777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:29.086616 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390557e7-adfe-4cf7-b54f-7b5f9adab209 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:29.093288 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b0b98797-d4cf-4f8a-8d6c-af79e0d50a33 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:29.094729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b0b98797-d4cf-4f8a-8d6c-af79e0d50a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:29.128232 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785552a-10d9-4182-88e3-52961cd19749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:29.129148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785552a-10d9-4182-88e3-52961cd19749 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:29.129569 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785552a-10d9-4182-88e3-52961cd19749 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:29.130017 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785552a-10d9-4182-88e3-52961cd19749 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:29.130860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785552a-10d9-4182-88e3-52961cd19749 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:29.131357 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785552a-10d9-4182-88e3-52961cd19749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:29.133035 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785552a-10d9-4182-88e3-52961cd19749 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:29.142710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 208/413] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:29.144305 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cd5f0-e14e-4971-952d-91d0a62e5598 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:29.144791 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cd5f0-e14e-4971-952d-91d0a62e5598 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:29.145244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cd5f0-e14e-4971-952d-91d0a62e5598 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:29.146892 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 209/414] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:29.151007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cd5f0-e14e-4971-952d-91d0a62e5598 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:29.186844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 206/415] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:29.188598 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626ab5a-53e1-405d-a597-5d88e8464a65 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:29.189076 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626ab5a-53e1-405d-a597-5d88e8464a65 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:29.189560 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626ab5a-53e1-405d-a597-5d88e8464a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:29.210549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c626ab5a-53e1-405d-a597-5d88e8464a65 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:29.212059 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c626ab5a-53e1-405d-a597-5d88e8464a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:29.259432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:29.345820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 207/416] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:29.350701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cd5f0-e14e-4971-952d-91d0a62e5598 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:29.385577 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93403e31-3888-430e-956d-e4f9b89971c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:29.386259 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93403e31-3888-430e-956d-e4f9b89971c6 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:29.386527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93403e31-3888-430e-956d-e4f9b89971c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:29.386804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93403e31-3888-430e-956d-e4f9b89971c6 None admin] PATH_INFO: `/v3/groups/be72e47f08d6416e935204bda13434bf` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:29.388031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93403e31-3888-430e-956d-e4f9b89971c6 None admin] RBAC: Authorizing `identity:get_group(group_id=be72e47f08d6416e935204bda13434bf)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:29.389547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93403e31-3888-430e-956d-e4f9b89971c6 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:29.391512 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 210/417] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Sep 6 22:38:29 2022] GET /identity/v3/groups/be72e47f08d6416e935204bda13434bf => generated 229 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:29.398572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626ab5a-53e1-405d-a597-5d88e8464a65 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:29.488169 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:29.518441 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93403e31-3888-430e-956d-e4f9b89971c6 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:29.540208 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626ab5a-53e1-405d-a597-5d88e8464a65 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:29.630057 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93403e31-3888-430e-956d-e4f9b89971c6 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:29.642022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0d278-2ef5-42bb-b92e-e434acbbfbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:29.642772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0d278-2ef5-42bb-b92e-e434acbbfbe2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:29.642949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0d278-2ef5-42bb-b92e-e434acbbfbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:29.643214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0d278-2ef5-42bb-b92e-e434acbbfbe2 None admin] PATH_INFO: `/v3/projects/ff1d6ddadcad498caaf30606299b1515` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:29.646054 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0d278-2ef5-42bb-b92e-e434acbbfbe2 None admin] RBAC: Authorizing `identity:get_project(project_id=ff1d6ddadcad498caaf30606299b1515)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:29.647507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0d278-2ef5-42bb-b92e-e434acbbfbe2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:29.649472 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 208/418] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:29 2022] GET /identity/v3/projects/ff1d6ddadcad498caaf30606299b1515 => generated 344 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:29.650246 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0d278-2ef5-42bb-b92e-e434acbbfbe2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:29.664150 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:29.674094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4475f7-5c39-45c0-9239-eb57af07bc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:29.674748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4475f7-5c39-45c0-9239-eb57af07bc6d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:29.675083 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4475f7-5c39-45c0-9239-eb57af07bc6d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:29.675415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4475f7-5c39-45c0-9239-eb57af07bc6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:29.686967 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4475f7-5c39-45c0-9239-eb57af07bc6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:29.692200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-5f4475f7-5c39-45c0-9239-eb57af07bc6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:29.692200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:29.692200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:29.692200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:29.692200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:29.692200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:29.692200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:29.692200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:29.692200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:29.692200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:29.692200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:29.692200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:29.692200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:29.692200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:29.692200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:29.692200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:29.693146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:29.693146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:29.693146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:29.693146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:29.693146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:29.693146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:29.693146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:29.693146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:29.693146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:29.693146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:29.693146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:29.693146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:29.693146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:29.693146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:29.693146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:29.693146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:29.693972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:29.693972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:29.693972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:29.693972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:29.693972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:29.693972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:29.693972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:29.693972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:29.693972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:29.693972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:29.693972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:29.693972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:29.693972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 211/419] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:29.694652 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4475f7-5c39-45c0-9239-eb57af07bc6d None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:29.772517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0d278-2ef5-42bb-b92e-e434acbbfbe2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:29.803515 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:29.810827 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f14c0b-649f-4c11-938b-a65de2d088e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:29.811007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4475f7-5c39-45c0-9239-eb57af07bc6d None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:29.811621 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f14c0b-649f-4c11-938b-a65de2d088e9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:29.811960 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f14c0b-649f-4c11-938b-a65de2d088e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:29.812360 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f14c0b-649f-4c11-938b-a65de2d088e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:29.826663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f14c0b-649f-4c11-938b-a65de2d088e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:29.834177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-d9f14c0b-649f-4c11-938b-a65de2d088e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:38:29.834177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:29.834177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:29.834177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:29.834177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:29.834177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:29.834177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:29.834177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:29.834177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:29.834177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:29.834177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:29.834177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:29.834177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:29.834177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:29.834177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:29.834177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:29.835272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:29.835272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:29.835272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:29.835272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:29.835272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:29.835272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:29.835272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:29.835272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:29.835272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:29.835272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:29.835272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:29.835272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:29.835272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:29.835272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:29.835272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:29.835272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:29.836553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:29.836553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:29.836553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:29.836553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:29.836553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:29.836553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:29.836553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:29.836553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:29.836553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:29.836553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:29.836553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:38:29.836553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:29.836553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 209/420] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:38:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:29.837431 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f14c0b-649f-4c11-938b-a65de2d088e9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:29.851464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc2d18-3018-4d6e-8f15-0c16b16720c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:29.852365 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc2d18-3018-4d6e-8f15-0c16b16720c7 None admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:29.852779 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc2d18-3018-4d6e-8f15-0c16b16720c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:29.853264 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc2d18-3018-4d6e-8f15-0c16b16720c7 None admin] PATH_INFO: `/v3/projects/ff1d6ddadcad498caaf30606299b1515/groups/be72e47f08d6416e935204bda13434bf/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:29.855292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc2d18-3018-4d6e-8f15-0c16b16720c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff1d6ddadcad498caaf30606299b1515, group_id=be72e47f08d6416e935204bda13434bf, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:29.857136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc2d18-3018-4d6e-8f15-0c16b16720c7 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:29.946583 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f14c0b-649f-4c11-938b-a65de2d088e9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:29.955547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 212/421] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Sep 6 22:38:29 2022] PUT /identity/v3/projects/ff1d6ddadcad498caaf30606299b1515/groups/be72e47f08d6416e935204bda13434bf/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:38:29.956652 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc2d18-3018-4d6e-8f15-0c16b16720c7 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:30.022817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bbd6a-fb85-41a9-b5b4-64ebd5b48267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:30.023445 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bbd6a-fb85-41a9-b5b4-64ebd5b48267 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:30.023725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bbd6a-fb85-41a9-b5b4-64ebd5b48267 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:30.023996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bbd6a-fb85-41a9-b5b4-64ebd5b48267 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:30.025140 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bbd6a-fb85-41a9-b5b4-64ebd5b48267 None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:30.025448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bbd6a-fb85-41a9-b5b4-64ebd5b48267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:30.027103 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bbd6a-fb85-41a9-b5b4-64ebd5b48267 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:30.037917 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 210/422] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:38:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:30.042662 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:30.044358 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bbd6a-fb85-41a9-b5b4-64ebd5b48267 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:30.161933 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc2d18-3018-4d6e-8f15-0c16b16720c7 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:30.169466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:30.200778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947c991-57ea-44bf-b53a-15cd02dcfece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:30.201324 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947c991-57ea-44bf-b53a-15cd02dcfece None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:30.201603 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947c991-57ea-44bf-b53a-15cd02dcfece None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:30.201878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947c991-57ea-44bf-b53a-15cd02dcfece None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:30.202550 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947c991-57ea-44bf-b53a-15cd02dcfece None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:30.203408 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947c991-57ea-44bf-b53a-15cd02dcfece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:30.204917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947c991-57ea-44bf-b53a-15cd02dcfece None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:30.214087 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 213/423] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:30.219962 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947c991-57ea-44bf-b53a-15cd02dcfece None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:30.244227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bbd6a-fb85-41a9-b5b4-64ebd5b48267 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:30.295040 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12f832-9a39-4a8c-88d4-ae02bad2af7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:30.296010 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12f832-9a39-4a8c-88d4-ae02bad2af7b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:30.297326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12f832-9a39-4a8c-88d4-ae02bad2af7b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:30.297821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12f832-9a39-4a8c-88d4-ae02bad2af7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:30.370528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947c991-57ea-44bf-b53a-15cd02dcfece None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:30.372237 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:30.413665 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12f832-9a39-4a8c-88d4-ae02bad2af7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:30.415819 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12f832-9a39-4a8c-88d4-ae02bad2af7b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:30.445041 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f77f16-8472-4b78-a305-b4e8cc0f84d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:30.445664 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f77f16-8472-4b78-a305-b4e8cc0f84d6 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:30.445940 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f77f16-8472-4b78-a305-b4e8cc0f84d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:30.446211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f77f16-8472-4b78-a305-b4e8cc0f84d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:30.500810 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:30.573977 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f77f16-8472-4b78-a305-b4e8cc0f84d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:30.576550 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f77f16-8472-4b78-a305-b4e8cc0f84d6 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:30.583212 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 211/424] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:30.589125 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12f832-9a39-4a8c-88d4-ae02bad2af7b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:30.753642 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 214/425] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:30.761147 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f77f16-8472-4b78-a305-b4e8cc0f84d6 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:30.764722 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:30.766926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12f832-9a39-4a8c-88d4-ae02bad2af7b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:30.840626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2e70f-fba5-4845-81b8-427f3c2dda8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:30.842595 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2e70f-fba5-4845-81b8-427f3c2dda8e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:30.843146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2e70f-fba5-4845-81b8-427f3c2dda8e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:30.843594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2e70f-fba5-4845-81b8-427f3c2dda8e None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:30.845579 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2e70f-fba5-4845-81b8-427f3c2dda8e None admin] RBAC: Authorizing `identity:get_project(project_id=2ad919f473ed42dba141f5a8838458b9)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:30.847212 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2e70f-fba5-4845-81b8-427f3c2dda8e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:30.850198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 212/426] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:30 2022] GET /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:30.851584 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54740124-5a30-4503-b5d8-e7cc47c9d556 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:30.852027 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54740124-5a30-4503-b5d8-e7cc47c9d556 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:30.852468 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54740124-5a30-4503-b5d8-e7cc47c9d556 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:30.858269 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 213/427] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:30.859725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54740124-5a30-4503-b5d8-e7cc47c9d556 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:30.883797 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:30.911232 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f77f16-8472-4b78-a305-b4e8cc0f84d6 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:30.950061 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a3df3-7caf-45b9-919f-7cb3482c369d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:30.950712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a3df3-7caf-45b9-919f-7cb3482c369d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:30.950993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a3df3-7caf-45b9-919f-7cb3482c369d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:30.951266 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a3df3-7caf-45b9-919f-7cb3482c369d None admin] PATH_INFO: `/v3/projects/2ad919f473ed42dba141f5a8838458b9` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:30.952405 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a3df3-7caf-45b9-919f-7cb3482c369d None admin] RBAC: Authorizing `identity:get_project(project_id=2ad919f473ed42dba141f5a8838458b9)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:30.954463 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a3df3-7caf-45b9-919f-7cb3482c369d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:30.956553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 215/428] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:30 2022] GET /identity/v3/projects/2ad919f473ed42dba141f5a8838458b9 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:30.957575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640263d3-1fc4-4ccf-b717-e610b6673f88 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:30.957862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640263d3-1fc4-4ccf-b717-e610b6673f88 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:30.958133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640263d3-1fc4-4ccf-b717-e610b6673f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:30.976381 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-640263d3-1fc4-4ccf-b717-e610b6673f88 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:30.977628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-640263d3-1fc4-4ccf-b717-e610b6673f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:30.990149 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54740124-5a30-4503-b5d8-e7cc47c9d556 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:31.028196 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f4296-3b1b-4b3f-9c21-61d6a0d32c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:31.029245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f4296-3b1b-4b3f-9c21-61d6a0d32c9c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:31.029524 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f4296-3b1b-4b3f-9c21-61d6a0d32c9c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:31.029797 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f4296-3b1b-4b3f-9c21-61d6a0d32c9c None admin] PATH_INFO: `/v3/groups/b30ccd35a8404a14943d1403745fd580` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:31.031338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f4296-3b1b-4b3f-9c21-61d6a0d32c9c None admin] RBAC: Authorizing `identity:get_group(group_id=b30ccd35a8404a14943d1403745fd580)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:31.033091 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f4296-3b1b-4b3f-9c21-61d6a0d32c9c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:31.040219 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 214/429] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Sep 6 22:38:30 2022] GET /identity/v3/groups/b30ccd35a8404a14943d1403745fd580 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:31.040219 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f4296-3b1b-4b3f-9c21-61d6a0d32c9c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:31.061085 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:31.072695 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 216/430] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:31.073741 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640263d3-1fc4-4ccf-b717-e610b6673f88 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:31.143543 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:31.158787 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f4296-3b1b-4b3f-9c21-61d6a0d32c9c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:31.203375 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f98dea-cc20-4daa-b93c-dc83b60ea6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:31.204187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f98dea-cc20-4daa-b93c-dc83b60ea6d0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:31.204569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f98dea-cc20-4daa-b93c-dc83b60ea6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:31.204922 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f98dea-cc20-4daa-b93c-dc83b60ea6d0 None admin] PATH_INFO: `/v3/groups/b30ccd35a8404a14943d1403745fd580` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:31.206511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f98dea-cc20-4daa-b93c-dc83b60ea6d0 None admin] RBAC: Authorizing `identity:get_group(group_id=b30ccd35a8404a14943d1403745fd580)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:31.208229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f98dea-cc20-4daa-b93c-dc83b60ea6d0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:31.210460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 215/431] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Sep 6 22:38:31 2022] GET /identity/v3/groups/b30ccd35a8404a14943d1403745fd580 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:31.216641 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f98dea-cc20-4daa-b93c-dc83b60ea6d0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:31.314603 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640263d3-1fc4-4ccf-b717-e610b6673f88 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:31.321480 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f98dea-cc20-4daa-b93c-dc83b60ea6d0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:31.363397 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19f83b-4b66-4dce-af33-b0bf42f62bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:31.364013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19f83b-4b66-4dce-af33-b0bf42f62bb8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:31.364291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19f83b-4b66-4dce-af33-b0bf42f62bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:31.364664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19f83b-4b66-4dce-af33-b0bf42f62bb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:31.365342 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19f83b-4b66-4dce-af33-b0bf42f62bb8 None admin] RBAC: Adding query filter params (group.id=b30ccd35a8404a14943d1403745fd580, role.id=01a26dc2b1034e33af13752c154d24f4, scope.project.id=2ad919f473ed42dba141f5a8838458b9) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:31.365652 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19f83b-4b66-4dce-af33-b0bf42f62bb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:31.365830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd6b0e-cc10-420a-bd31-4499937eae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:31.366433 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd6b0e-cc10-420a-bd31-4499937eae6a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:31.366802 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd6b0e-cc10-420a-bd31-4499937eae6a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:31.367080 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd6b0e-cc10-420a-bd31-4499937eae6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:31.367185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19f83b-4b66-4dce-af33-b0bf42f62bb8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:31.367803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd6b0e-cc10-420a-bd31-4499937eae6a None admin] RBAC: Adding query filter params (group.id=b30ccd35a8404a14943d1403745fd580, role.id=093c83b316db4d0f9dc55ec6e3583ba8, scope.project.id=2ad919f473ed42dba141f5a8838458b9) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:31.368107 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd6b0e-cc10-420a-bd31-4499937eae6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:31.369732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd6b0e-cc10-420a-bd31-4499937eae6a None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:31.374171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 216/432] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Sep 6 22:38:31 2022] GET /identity/v3/role_assignments?group.id=b30ccd35a8404a14943d1403745fd580&scope.project.id=2ad919f473ed42dba141f5a8838458b9&role.id=01a26dc2b1034e33af13752c154d24f4 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:31.377586 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be975c2a-f78f-4ea6-b38b-5299b71b5bdc None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:31.377868 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be975c2a-f78f-4ea6-b38b-5299b71b5bdc None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:31.378141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be975c2a-f78f-4ea6-b38b-5299b71b5bdc None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:31.386139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 217/434] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Sep 6 22:38:31 2022] GET /identity/v3/role_assignments?group.id=b30ccd35a8404a14943d1403745fd580&scope.project.id=2ad919f473ed42dba141f5a8838458b9&role.id=093c83b316db4d0f9dc55ec6e3583ba8 => generated 611 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:31.387302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 217/434] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:31.387534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478873ce-2e5e-46fb-ab79-783ad51baa30 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:31.387818 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478873ce-2e5e-46fb-ab79-783ad51baa30 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:31.388089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478873ce-2e5e-46fb-ab79-783ad51baa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:31.408146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-478873ce-2e5e-46fb-ab79-783ad51baa30 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:31.409431 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-478873ce-2e5e-46fb-ab79-783ad51baa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:31.460782 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be975c2a-f78f-4ea6-b38b-5299b71b5bdc None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:31.486365 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:31.488187 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:31.505594 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 218/435] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:31.623519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be975c2a-f78f-4ea6-b38b-5299b71b5bdc None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:31.671018 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c685ff-675d-4035-9566-be276527b7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:31.672259 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c685ff-675d-4035-9566-be276527b7d6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:31.672584 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c685ff-675d-4035-9566-be276527b7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:31.672861 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c685ff-675d-4035-9566-be276527b7d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:31.687301 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c685ff-675d-4035-9566-be276527b7d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:31.692798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-31c685ff-675d-4035-9566-be276527b7d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:38:31.692798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:31.692798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:31.692798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:31.692798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:31.692798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:31.692798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:31.692798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:31.692798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:31.692798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:31.692798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:31.692798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:31.692798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:31.692798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:31.692798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:31.692798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:31.693763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:31.693763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:31.693763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:31.693763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:31.693763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:31.693763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:31.693763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:31.693763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:31.693763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:31.693763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:31.693763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:31.693763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:31.693763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:31.693763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:31.693763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:31.693763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:31.694566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:31.694566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:31.694566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:31.694566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:31.694566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:31.694566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:31.694566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:31.694566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:31.694566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:31.694566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:31.694566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:38:31.694566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:31.694566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 218/436] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:38:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:38:31.701580 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478873ce-2e5e-46fb-ab79-783ad51baa30 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:31.826579 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478873ce-2e5e-46fb-ab79-783ad51baa30 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:31.830890 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c685ff-675d-4035-9566-be276527b7d6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:31.872836 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe41774-db14-482e-84e4-8ecfbcc80103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:31.873464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe41774-db14-482e-84e4-8ecfbcc80103 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:31.873787 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe41774-db14-482e-84e4-8ecfbcc80103 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:31.874015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe41774-db14-482e-84e4-8ecfbcc80103 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:31.874716 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe41774-db14-482e-84e4-8ecfbcc80103 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:31.875016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe41774-db14-482e-84e4-8ecfbcc80103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:31.876381 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe41774-db14-482e-84e4-8ecfbcc80103 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:31.886259 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 219/437] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:31.894299 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe41774-db14-482e-84e4-8ecfbcc80103 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:31.949959 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:31.973794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:31.981196 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c685ff-675d-4035-9566-be276527b7d6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:32.022490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720c2e3-2843-443c-adf4-ff36f8a4c36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:32.023146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720c2e3-2843-443c-adf4-ff36f8a4c36a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:32.023594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720c2e3-2843-443c-adf4-ff36f8a4c36a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:32.023844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720c2e3-2843-443c-adf4-ff36f8a4c36a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:32.024135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe41774-db14-482e-84e4-8ecfbcc80103 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:32.040091 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720c2e3-2843-443c-adf4-ff36f8a4c36a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:32.046448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-c720c2e3-2843-443c-adf4-ff36f8a4c36a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:32.046448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:32.046448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:32.046448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:32.046448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:32.046448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:32.046448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:32.046448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:32.046448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:32.046448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:32.046448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:32.046448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:32.046448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:32.046448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:32.046448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:32.046448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:32.047349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:32.047349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:32.047349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:32.047349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:32.047349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:32.047349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:32.047349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:32.047349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:32.047349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:32.047349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:32.047349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:32.047349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:32.047349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:32.047349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:32.047349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:32.047349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:32.048189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:32.048189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:32.048189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:32.048189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:32.048189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:32.048189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:32.048189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:32.048189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:32.048189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:32.048189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:32.048189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 22:38:32.048189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:32.048189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 219/438] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:38:32.053398 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720c2e3-2843-443c-adf4-ff36f8a4c36a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:32.085783 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbb419-74a8-4c3e-8895-01fa53349c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:32.085783 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbb419-74a8-4c3e-8895-01fa53349c47 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:32.085783 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbb419-74a8-4c3e-8895-01fa53349c47 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:32.085783 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbb419-74a8-4c3e-8895-01fa53349c47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:32.175438 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbb419-74a8-4c3e-8895-01fa53349c47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:32.176916 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbb419-74a8-4c3e-8895-01fa53349c47 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:32.204239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720c2e3-2843-443c-adf4-ff36f8a4c36a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:32.251822 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:32.258724 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845645d-c4b4-4b97-85d7-a79daea4877b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:32.259259 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845645d-c4b4-4b97-85d7-a79daea4877b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:32.264411 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845645d-c4b4-4b97-85d7-a79daea4877b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:32.264411 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845645d-c4b4-4b97-85d7-a79daea4877b None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:32.264411 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845645d-c4b4-4b97-85d7-a79daea4877b None admin] RBAC: Adding query filter params (name=member) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:32.264411 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845645d-c4b4-4b97-85d7-a79daea4877b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:32.264411 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845645d-c4b4-4b97-85d7-a79daea4877b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:32.273450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 220/439] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:38:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:32.285749 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845645d-c4b4-4b97-85d7-a79daea4877b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:32.287901 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:32.330577 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 220/440] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:32.336845 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbb419-74a8-4c3e-8895-01fa53349c47 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:32.418184 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845645d-c4b4-4b97-85d7-a79daea4877b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:32.457389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6e9f5-d6c6-4e64-8c2f-45ebe77ef287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:32.458343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6e9f5-d6c6-4e64-8c2f-45ebe77ef287 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:32.458834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6e9f5-d6c6-4e64-8c2f-45ebe77ef287 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:32.459367 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6e9f5-d6c6-4e64-8c2f-45ebe77ef287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:32.461760 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbb419-74a8-4c3e-8895-01fa53349c47 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:32.498823 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbedbf-fff3-4bbf-938d-2dcc98ee9464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:32.499972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbedbf-fff3-4bbf-938d-2dcc98ee9464 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:32.500260 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbedbf-fff3-4bbf-938d-2dcc98ee9464 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:32.500563 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbedbf-fff3-4bbf-938d-2dcc98ee9464 None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:32.501713 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbbedbf-fff3-4bbf-938d-2dcc98ee9464 None admin] RBAC: Authorizing `identity:get_project(project_id=b1baa713334143d9b2b624372a19f941)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:32.503483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbbedbf-fff3-4bbf-938d-2dcc98ee9464 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:32.508454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 221/441] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:32 2022] GET /identity/v3/projects/b1baa713334143d9b2b624372a19f941 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:32.510109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbedbf-fff3-4bbf-938d-2dcc98ee9464 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:32.536528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:32.537779 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6e9f5-d6c6-4e64-8c2f-45ebe77ef287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:32.539401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6e9f5-d6c6-4e64-8c2f-45ebe77ef287 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:32.541418 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:32.619768 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbedbf-fff3-4bbf-938d-2dcc98ee9464 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:32.651840 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 221/442] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:32.651840 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c59ec-b9a8-436a-849d-87489ae35607 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:32.651840 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c59ec-b9a8-436a-849d-87489ae35607 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:32.651840 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c59ec-b9a8-436a-849d-87489ae35607 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:32.652559 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 222/443] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:32.653581 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c59ec-b9a8-436a-849d-87489ae35607 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:32.662922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fbd62-e658-417c-a572-b76267b2a307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:32.663590 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fbd62-e658-417c-a572-b76267b2a307 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:32.663865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fbd62-e658-417c-a572-b76267b2a307 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:32.664137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fbd62-e658-417c-a572-b76267b2a307 None admin] PATH_INFO: `/v3/groups/b30ccd35a8404a14943d1403745fd580` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:32.665290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fbd62-e658-417c-a572-b76267b2a307 None admin] RBAC: Authorizing `identity:get_group(group_id=b30ccd35a8404a14943d1403745fd580)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:32.666722 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fbd62-e658-417c-a572-b76267b2a307 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:32.668849 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 222/444] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Sep 6 22:38:32 2022] GET /identity/v3/groups/b30ccd35a8404a14943d1403745fd580 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:32.670019 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157203c-19a6-4cbd-abac-8fd60da4800b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:32.670397 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157203c-19a6-4cbd-abac-8fd60da4800b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:32.670676 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157203c-19a6-4cbd-abac-8fd60da4800b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:32.689849 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-7157203c-19a6-4cbd-abac-8fd60da4800b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:32.691031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7157203c-19a6-4cbd-abac-8fd60da4800b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:32.758553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 223/445] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:32.759393 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157203c-19a6-4cbd-abac-8fd60da4800b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:32.770731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c59ec-b9a8-436a-849d-87489ae35607 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:32.773031 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:32.782086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:32.807604 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d57f2-7840-465f-903c-35ffad5b0b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:32.808239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d57f2-7840-465f-903c-35ffad5b0b0e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:32.808544 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d57f2-7840-465f-903c-35ffad5b0b0e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:32.808821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d57f2-7840-465f-903c-35ffad5b0b0e None admin] PATH_INFO: `/v3/projects/b1baa713334143d9b2b624372a19f941` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:32.809927 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d57f2-7840-465f-903c-35ffad5b0b0e None admin] RBAC: Authorizing `identity:get_project(project_id=b1baa713334143d9b2b624372a19f941)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:32.811364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d57f2-7840-465f-903c-35ffad5b0b0e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:32.813570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 223/446] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:32 2022] GET /identity/v3/projects/b1baa713334143d9b2b624372a19f941 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:32.819047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d57f2-7840-465f-903c-35ffad5b0b0e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:32.867869 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157203c-19a6-4cbd-abac-8fd60da4800b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:32.910699 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83154428-4504-4b81-91a5-2ecc9ef27b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:32.911397 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83154428-4504-4b81-91a5-2ecc9ef27b1d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:32.911679 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83154428-4504-4b81-91a5-2ecc9ef27b1d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:32.911980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83154428-4504-4b81-91a5-2ecc9ef27b1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:32.912705 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83154428-4504-4b81-91a5-2ecc9ef27b1d None admin] RBAC: Adding query filter params (group.id=b30ccd35a8404a14943d1403745fd580, role.id=01a26dc2b1034e33af13752c154d24f4, scope.project.id=b1baa713334143d9b2b624372a19f941) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:32.913014 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83154428-4504-4b81-91a5-2ecc9ef27b1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:32.914558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83154428-4504-4b81-91a5-2ecc9ef27b1d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:32.928457 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 224/447] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Sep 6 22:38:32 2022] GET /identity/v3/role_assignments?group.id=b30ccd35a8404a14943d1403745fd580&scope.project.id=b1baa713334143d9b2b624372a19f941&role.id=01a26dc2b1034e33af13752c154d24f4 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:32.933285 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d57f2-7840-465f-903c-35ffad5b0b0e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:32.972413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32361d8c-1cc9-47b1-ab76-46d26d748632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:32.973192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32361d8c-1cc9-47b1-ab76-46d26d748632 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:32.973384 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32361d8c-1cc9-47b1-ab76-46d26d748632 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:32.973700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32361d8c-1cc9-47b1-ab76-46d26d748632 None admin] PATH_INFO: `/v3/groups/b30ccd35a8404a14943d1403745fd580` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:32.974836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32361d8c-1cc9-47b1-ab76-46d26d748632 None admin] RBAC: Authorizing `identity:get_group(group_id=b30ccd35a8404a14943d1403745fd580)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:32.976406 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32361d8c-1cc9-47b1-ab76-46d26d748632 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:32.978298 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 224/448] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Sep 6 22:38:32 2022] GET /identity/v3/groups/b30ccd35a8404a14943d1403745fd580 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:32.984411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83154428-4504-4b81-91a5-2ecc9ef27b1d None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:33.032312 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32361d8c-1cc9-47b1-ab76-46d26d748632 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:33.085721 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:33.099084 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:33.116503 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83154428-4504-4b81-91a5-2ecc9ef27b1d None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:33.156855 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c94bae-65be-4116-9e13-1f39d34e2c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:33.157474 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c94bae-65be-4116-9e13-1f39d34e2c53 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:33.157752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c94bae-65be-4116-9e13-1f39d34e2c53 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:33.158019 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c94bae-65be-4116-9e13-1f39d34e2c53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:33.158579 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32361d8c-1cc9-47b1-ab76-46d26d748632 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:33.158768 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c94bae-65be-4116-9e13-1f39d34e2c53 None admin] RBAC: Adding query filter params (group.id=b30ccd35a8404a14943d1403745fd580, role.id=093c83b316db4d0f9dc55ec6e3583ba8, scope.project.id=b1baa713334143d9b2b624372a19f941) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:33.159044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c94bae-65be-4116-9e13-1f39d34e2c53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:33.160505 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c94bae-65be-4116-9e13-1f39d34e2c53 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:33.166328 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 225/449] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Sep 6 22:38:32 2022] GET /identity/v3/role_assignments?group.id=b30ccd35a8404a14943d1403745fd580&scope.project.id=b1baa713334143d9b2b624372a19f941&role.id=093c83b316db4d0f9dc55ec6e3583ba8 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:33.199886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e59827-1b2b-4fba-9519-f57cb0dc05dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:33.200600 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e59827-1b2b-4fba-9519-f57cb0dc05dd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:33.200882 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e59827-1b2b-4fba-9519-f57cb0dc05dd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:33.201156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e59827-1b2b-4fba-9519-f57cb0dc05dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:33.213748 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e59827-1b2b-4fba-9519-f57cb0dc05dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:33.219192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-03e59827-1b2b-4fba-9519-f57cb0dc05dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:38:33.219192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:33.219192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:33.219192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:33.219192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:33.219192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:33.219192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:33.219192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:33.219192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:33.219192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:33.219192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:33.219192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:33.219192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:33.219192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:33.219192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:33.219192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:33.220213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:33.220213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:33.220213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:33.220213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:33.220213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:33.220213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:33.220213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:33.220213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:33.220213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:33.220213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:33.220213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:33.220213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:33.220213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:33.220213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:33.220213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:33.220213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:33.221113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:33.221113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:33.221113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:33.221113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:33.221113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:33.221113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:33.221113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:33.221113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:33.221113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:33.221113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:33.221113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:38:33.221113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:33.221113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 225/450] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:38:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:33.226427 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c94bae-65be-4116-9e13-1f39d34e2c53 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:33.333646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c94bae-65be-4116-9e13-1f39d34e2c53 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:33.372267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3b372-697c-4c09-be5c-e4e96543dbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:33.373212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3b372-697c-4c09-be5c-e4e96543dbab None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:33.373671 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3b372-697c-4c09-be5c-e4e96543dbab None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:33.373951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3b372-697c-4c09-be5c-e4e96543dbab None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:33.374670 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3b372-697c-4c09-be5c-e4e96543dbab None admin] RBAC: Adding query filter params (name=admin) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:33.374980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3b372-697c-4c09-be5c-e4e96543dbab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:33.376351 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3b372-697c-4c09-be5c-e4e96543dbab None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:33.385098 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 226/451] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:33.391499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e59827-1b2b-4fba-9519-f57cb0dc05dd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:33.493124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:33.496974 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e59827-1b2b-4fba-9519-f57cb0dc05dd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:33.543745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e7aec-07bd-4164-a7ee-9fdf0b212cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:33.544369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e7aec-07bd-4164-a7ee-9fdf0b212cbf None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:33.545799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e7aec-07bd-4164-a7ee-9fdf0b212cbf None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:33.545799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e7aec-07bd-4164-a7ee-9fdf0b212cbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:33.613099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e7aec-07bd-4164-a7ee-9fdf0b212cbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:33.614491 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e7aec-07bd-4164-a7ee-9fdf0b212cbf None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:33.713682 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:33.718207 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 226/452] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 22:38:33.723893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3b372-697c-4c09-be5c-e4e96543dbab None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:33.739839 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:33.828887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3b372-697c-4c09-be5c-e4e96543dbab None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:33.861520 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce4138-6897-41e2-9531-b03cb03615f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:33.862146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce4138-6897-41e2-9531-b03cb03615f9 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:33.862425 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce4138-6897-41e2-9531-b03cb03615f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:33.862697 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce4138-6897-41e2-9531-b03cb03615f9 None admin] PATH_INFO: `/v3/projects/ff1d6ddadcad498caaf30606299b1515` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:33.863860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce4138-6897-41e2-9531-b03cb03615f9 None admin] RBAC: Authorizing `identity:get_project(project_id=ff1d6ddadcad498caaf30606299b1515)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:33.865267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce4138-6897-41e2-9531-b03cb03615f9 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:33.866876 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 227/453] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:38:33 2022] GET /identity/v3/projects/ff1d6ddadcad498caaf30606299b1515 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:33.872519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e7aec-07bd-4164-a7ee-9fdf0b212cbf None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:33.969655 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e7aec-07bd-4164-a7ee-9fdf0b212cbf None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:34.002241 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3c98b-8421-403e-9d90-4165b33951f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:34.002871 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3c98b-8421-403e-9d90-4165b33951f2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:34.003128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3c98b-8421-403e-9d90-4165b33951f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:34.003401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3c98b-8421-403e-9d90-4165b33951f2 None admin] PATH_INFO: `/v3/groups/be72e47f08d6416e935204bda13434bf` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:34.004534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3c98b-8421-403e-9d90-4165b33951f2 None admin] RBAC: Authorizing `identity:get_group(group_id=be72e47f08d6416e935204bda13434bf)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:34.005980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3c98b-8421-403e-9d90-4165b33951f2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:34.007589 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 227/454] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Sep 6 22:38:33 2022] GET /identity/v3/groups/be72e47f08d6416e935204bda13434bf => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:34.013502 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce4138-6897-41e2-9531-b03cb03615f9 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:34.101457 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:34.120086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce4138-6897-41e2-9531-b03cb03615f9 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:34.159904 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a61933-bf00-4651-9bbf-076a2f800882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:34.160769 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a61933-bf00-4651-9bbf-076a2f800882 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:34.161164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a61933-bf00-4651-9bbf-076a2f800882 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:34.161548 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a61933-bf00-4651-9bbf-076a2f800882 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:34.162640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a61933-bf00-4651-9bbf-076a2f800882 None admin] RBAC: Adding query filter params (group.id=be72e47f08d6416e935204bda13434bf, role.id=aa2332d1bdb74e48a88ed7c2a7ed2990, scope.project.id=ff1d6ddadcad498caaf30606299b1515) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:34.163093 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a61933-bf00-4651-9bbf-076a2f800882 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:34.165040 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a61933-bf00-4651-9bbf-076a2f800882 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:34.172880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 228/455] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Sep 6 22:38:34 2022] GET /identity/v3/role_assignments?group.id=be72e47f08d6416e935204bda13434bf&scope.project.id=ff1d6ddadcad498caaf30606299b1515&role.id=aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:36.820392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e862f-d611-477c-b714-e820f77db26f None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:36.820955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e862f-d611-477c-b714-e820f77db26f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:36.820955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e862f-d611-477c-b714-e820f77db26f None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:36.822567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 228/456] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:36.827878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa359cfa-736b-4ec6-a74d-4292ae411ee5 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:36.828289 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa359cfa-736b-4ec6-a74d-4292ae411ee5 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:36.828497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa359cfa-736b-4ec6-a74d-4292ae411ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:36.847787 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-fa359cfa-736b-4ec6-a74d-4292ae411ee5 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:36.853036 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-fa359cfa-736b-4ec6-a74d-4292ae411ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:36.938972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 229/457] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:37.435929 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d30c0d-f01f-4763-ad10-8ab738ca9e83 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:37.437137 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d30c0d-f01f-4763-ad10-8ab738ca9e83 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:37.437617 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d30c0d-f01f-4763-ad10-8ab738ca9e83 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:37.439429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 229/458] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:37.445018 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03163a94-c520-4032-9a31-3decdf6e403a None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:37.445539 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03163a94-c520-4032-9a31-3decdf6e403a None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:37.446002 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03163a94-c520-4032-9a31-3decdf6e403a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:37.467106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d30c0d-f01f-4763-ad10-8ab738ca9e83 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:37.470900 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-03163a94-c520-4032-9a31-3decdf6e403a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:37.474034 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-03163a94-c520-4032-9a31-3decdf6e403a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:37.555766 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 230/459] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:37.564450 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7abcd-443b-4538-ae72-51d1a9037c0a None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:37.565131 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7abcd-443b-4538-ae72-51d1a9037c0a None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:37.565554 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7abcd-443b-4538-ae72-51d1a9037c0a None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:37.566622 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:37.567368 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 231/460] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:37.573506 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5585eb-bede-4778-bd39-a58f9636f490 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:37.573791 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5585eb-bede-4778-bd39-a58f9636f490 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:37.574258 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5585eb-bede-4778-bd39-a58f9636f490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:37.587319 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:37.606116 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-5c5585eb-bede-4778-bd39-a58f9636f490 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:37.607571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-5c5585eb-bede-4778-bd39-a58f9636f490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:37.645685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d30c0d-f01f-4763-ad10-8ab738ca9e83 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:37.688788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 232/461] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:37.703050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b53b44-16f7-4159-babf-ea4a135941cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:37.703685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b53b44-16f7-4159-babf-ea4a135941cc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:37.703965 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b53b44-16f7-4159-babf-ea4a135941cc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:37.704234 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b53b44-16f7-4159-babf-ea4a135941cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:37.719040 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b53b44-16f7-4159-babf-ea4a135941cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:37.720731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b53b44-16f7-4159-babf-ea4a135941cc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:37.723754 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356eba9f-2099-4539-a48d-39827730ab45 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:37.724335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356eba9f-2099-4539-a48d-39827730ab45 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:37.724834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356eba9f-2099-4539-a48d-39827730ab45 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:37.726575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 233/462] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:38:37.738216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f850e49-f5c9-419c-bbbc-090c552dd8ff None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:37.738748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f850e49-f5c9-419c-bbbc-090c552dd8ff None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:37.739193 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f850e49-f5c9-419c-bbbc-090c552dd8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:37.742050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-03b53b44-16f7-4159-babf-ea4a135941cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:37.742050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:37.742050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:37.742050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:37.742050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:37.742050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:37.742050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:37.742050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:37.742050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:37.742050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:37.742050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:37.742050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:37.742050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:37.742050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:37.742050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:37.742050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:37.743161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:37.743161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:37.743161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:37.743161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:37.743161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:37.743161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:37.743161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:37.743161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:37.743161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:37.743161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:37.743161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:37.743161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:37.743161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:37.743161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:37.743161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:37.743161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:37.743161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:37.744232 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:37.744232 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:37.744232 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:37.746308 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 230/463] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:37.752296 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b53b44-16f7-4159-babf-ea4a135941cc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:37.771362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-8f850e49-f5c9-419c-bbbc-090c552dd8ff None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:37.772938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-8f850e49-f5c9-419c-bbbc-090c552dd8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:37.847770 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 234/464] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 22:38:37.869058 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f850e49-f5c9-419c-bbbc-090c552dd8ff None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:37.884784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b53b44-16f7-4159-babf-ea4a135941cc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:37.917551 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:37.947297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403723d8-ed96-4e89-ad53-2d5054ed3b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:37.947833 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403723d8-ed96-4e89-ad53-2d5054ed3b8a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:37.948110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403723d8-ed96-4e89-ad53-2d5054ed3b8a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:37.948380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403723d8-ed96-4e89-ad53-2d5054ed3b8a None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:37.949055 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403723d8-ed96-4e89-ad53-2d5054ed3b8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:37.949357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403723d8-ed96-4e89-ad53-2d5054ed3b8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:37.950757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403723d8-ed96-4e89-ad53-2d5054ed3b8a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:37.970301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:37.993331 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 231/465] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:37.998815 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403723d8-ed96-4e89-ad53-2d5054ed3b8a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:38.046905 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f850e49-f5c9-419c-bbbc-090c552dd8ff None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:38.110612 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968546c-9677-428f-a268-e158bcedd63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:38.111783 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968546c-9677-428f-a268-e158bcedd63c None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:38.112631 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968546c-9677-428f-a268-e158bcedd63c None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:38.113146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968546c-9677-428f-a268-e158bcedd63c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:38.128049 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968546c-9677-428f-a268-e158bcedd63c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:38.128679 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403723d8-ed96-4e89-ad53-2d5054ed3b8a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:38.129905 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968546c-9677-428f-a268-e158bcedd63c None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:38.149623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-c968546c-9677-428f-a268-e158bcedd63c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:38.149623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:38.149623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:38.149623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:38.149623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:38.149623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:38.149623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:38.149623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:38.149623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:38.149623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:38.149623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:38.149623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:38.149623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:38.149623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:38.149623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:38.149623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:38.150732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:38.150732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:38.150732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:38.150732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:38.150732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:38.150732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:38.150732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:38.150732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:38.150732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:38.150732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:38.150732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:38.150732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:38.150732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:38.150732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:38.150732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:38.150732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:38.150732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:38.151790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:38.151790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:38.151790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:38.157813 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 235/466] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:38:38.158713 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968546c-9677-428f-a268-e158bcedd63c None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:38.168052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b345bb-447d-4535-8b86-7ebc7d4da214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:38.168972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b345bb-447d-4535-8b86-7ebc7d4da214 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:38.169437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b345bb-447d-4535-8b86-7ebc7d4da214 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:38.169847 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b345bb-447d-4535-8b86-7ebc7d4da214 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:38.170672 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b345bb-447d-4535-8b86-7ebc7d4da214 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:38.172943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b345bb-447d-4535-8b86-7ebc7d4da214 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:38.259243 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968546c-9677-428f-a268-e158bcedd63c None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:38.277506 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:38.287898 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 232/467] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Sep 6 22:38:37 2022] POST /identity/v3/users => generated 246 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:38:38.289104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b345bb-447d-4535-8b86-7ebc7d4da214 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:38.308734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86ef38-94b1-4530-b4eb-7573d7a052e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:38.309756 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86ef38-94b1-4530-b4eb-7573d7a052e1 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:38.310039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86ef38-94b1-4530-b4eb-7573d7a052e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:38.310367 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86ef38-94b1-4530-b4eb-7573d7a052e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:38.323161 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86ef38-94b1-4530-b4eb-7573d7a052e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:38.324875 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86ef38-94b1-4530-b4eb-7573d7a052e1 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:38.336325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:38.343409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-5f86ef38-94b1-4530-b4eb-7573d7a052e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:38.343409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:38.343409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:38.343409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:38.343409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:38.343409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:38.343409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:38.343409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:38.343409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:38.343409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:38.343409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:38.343409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:38.343409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:38.343409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:38.343409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:38.343409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:38.344392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:38.344392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:38.344392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:38.344392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:38.344392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:38.344392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:38.344392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:38.344392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:38.344392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:38.344392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:38.344392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:38.344392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:38.344392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:38.344392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:38.344392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:38.344392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:38.344392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:38.345335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:38.345335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:38.345335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:38.345335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 236/468] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:38.346055 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86ef38-94b1-4530-b4eb-7573d7a052e1 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:38.419986 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b345bb-447d-4535-8b86-7ebc7d4da214 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:38.456524 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735a9ec-cfba-4a27-a489-a4b6009eb9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:38.457159 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735a9ec-cfba-4a27-a489-a4b6009eb9a2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:38.457439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735a9ec-cfba-4a27-a489-a4b6009eb9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:38.457710 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735a9ec-cfba-4a27-a489-a4b6009eb9a2 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:38.458370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735a9ec-cfba-4a27-a489-a4b6009eb9a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:38.458675 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735a9ec-cfba-4a27-a489-a4b6009eb9a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:38.460091 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735a9ec-cfba-4a27-a489-a4b6009eb9a2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:38.463531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86ef38-94b1-4530-b4eb-7573d7a052e1 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:38.477691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 233/469] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:38.477691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735a9ec-cfba-4a27-a489-a4b6009eb9a2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:38.509427 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f240c-d1f0-4db2-ae7f-cea31044f8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:38.510090 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f240c-d1f0-4db2-ae7f-cea31044f8fd None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:38.510969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f240c-d1f0-4db2-ae7f-cea31044f8fd None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:38.510969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f240c-d1f0-4db2-ae7f-cea31044f8fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:38.523257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f240c-d1f0-4db2-ae7f-cea31044f8fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:38.524786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f240c-d1f0-4db2-ae7f-cea31044f8fd None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:38.542000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-f37f240c-d1f0-4db2-ae7f-cea31044f8fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:38.542000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:38.542000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:38.542000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:38.542000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:38.542000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:38.542000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:38.542000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:38.542000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:38.542000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:38.542000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:38.542000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:38.542000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:38.542000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:38.542000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:38.542000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:38.542952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:38.542952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:38.542952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:38.542952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:38.542952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:38.542952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:38.542952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:38.542952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:38.542952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:38.542952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:38.542952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:38.542952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:38.542952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:38.542952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:38.542952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:38.542952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:38.542952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:38.543800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:38.543800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:38.543800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:38.543800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 237/470] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:38.544634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d24c85-f8d0-4f8c-935f-26ba0907be92 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:38.544914 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d24c85-f8d0-4f8c-935f-26ba0907be92 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:38.545841 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d24c85-f8d0-4f8c-935f-26ba0907be92 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:38.546448 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 238/471] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:38.547263 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d24c85-f8d0-4f8c-935f-26ba0907be92 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:38.571400 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:38.595343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:38.602798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735a9ec-cfba-4a27-a489-a4b6009eb9a2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:38.645076 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab90e7-2008-4cea-8da0-7a81c1c97c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:38.645692 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab90e7-2008-4cea-8da0-7a81c1c97c6b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:38.645970 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab90e7-2008-4cea-8da0-7a81c1c97c6b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:38.646250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab90e7-2008-4cea-8da0-7a81c1c97c6b None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:38.646920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab90e7-2008-4cea-8da0-7a81c1c97c6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:38.647222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab90e7-2008-4cea-8da0-7a81c1c97c6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:38.648848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab90e7-2008-4cea-8da0-7a81c1c97c6b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:38.657410 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d24c85-f8d0-4f8c-935f-26ba0907be92 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:38.665359 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 234/472] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:38.665359 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab90e7-2008-4cea-8da0-7a81c1c97c6b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:38.694634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095882e-a805-4ee2-86b7-e953bc2ef741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:38.695342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095882e-a805-4ee2-86b7-e953bc2ef741 None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:38.695627 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095882e-a805-4ee2-86b7-e953bc2ef741 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:38.695897 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095882e-a805-4ee2-86b7-e953bc2ef741 None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:38.696568 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095882e-a805-4ee2-86b7-e953bc2ef741 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:38.697998 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095882e-a805-4ee2-86b7-e953bc2ef741 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:38.772555 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 239/473] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Sep 6 22:38:38 2022] POST /identity/v3/users => generated 248 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:38:38.772735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab90e7-2008-4cea-8da0-7a81c1c97c6b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:38.772830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbd8b3-9e6a-49d6-852c-1e9e433a4afc None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:38.772830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbd8b3-9e6a-49d6-852c-1e9e433a4afc None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:38.772830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbd8b3-9e6a-49d6-852c-1e9e433a4afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:38.795376 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-14dbd8b3-9e6a-49d6-852c-1e9e433a4afc None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:38.796826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-14dbd8b3-9e6a-49d6-852c-1e9e433a4afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:38.817972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5ab11-bfb7-4fcf-83f6-ff3ff7abd0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:38.818653 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5ab11-bfb7-4fcf-83f6-ff3ff7abd0ba None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:38.818932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5ab11-bfb7-4fcf-83f6-ff3ff7abd0ba None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:38.819271 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5ab11-bfb7-4fcf-83f6-ff3ff7abd0ba None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:38.820076 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5ab11-bfb7-4fcf-83f6-ff3ff7abd0ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:38.820377 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5ab11-bfb7-4fcf-83f6-ff3ff7abd0ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:38.821946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5ab11-bfb7-4fcf-83f6-ff3ff7abd0ba None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:38.838157 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 235/474] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:38.839029 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5ab11-bfb7-4fcf-83f6-ff3ff7abd0ba None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:38.860757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:38.878848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 240/475] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:38.879699 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbd8b3-9e6a-49d6-852c-1e9e433a4afc None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:38.892069 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:38.975890 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5ab11-bfb7-4fcf-83f6-ff3ff7abd0ba None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:39.004898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbd8b3-9e6a-49d6-852c-1e9e433a4afc None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:39.023956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912c19a-efed-4ce8-9ad2-ec93c78d5f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:39.024784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912c19a-efed-4ce8-9ad2-ec93c78d5f06 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:39.025486 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912c19a-efed-4ce8-9ad2-ec93c78d5f06 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:39.025767 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912c19a-efed-4ce8-9ad2-ec93c78d5f06 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:39.026429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912c19a-efed-4ce8-9ad2-ec93c78d5f06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:39.027877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912c19a-efed-4ce8-9ad2-ec93c78d5f06 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:39.055899 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb073d62-54b4-4f56-896f-231748e799d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:39.056598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb073d62-54b4-4f56-896f-231748e799d7 None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:39.056943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb073d62-54b4-4f56-896f-231748e799d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:39.057221 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb073d62-54b4-4f56-896f-231748e799d7 None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:39.057878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb073d62-54b4-4f56-896f-231748e799d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:39.059614 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb073d62-54b4-4f56-896f-231748e799d7 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:39.116416 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 236/476] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Sep 6 22:38:38 2022] POST /identity/v3/users => generated 248 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:38:39.162369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 241/477] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Sep 6 22:38:38 2022] POST /identity/v3/users => generated 249 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:38:39.254248 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912c19a-efed-4ce8-9ad2-ec93c78d5f06 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:39.341598 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:39.376060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912c19a-efed-4ce8-9ad2-ec93c78d5f06 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:39.416583 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c96b2-614d-4b50-b8c0-35628bc3b0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:39.417209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c96b2-614d-4b50-b8c0-35628bc3b0bc None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:39.417491 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c96b2-614d-4b50-b8c0-35628bc3b0bc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:39.417768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c96b2-614d-4b50-b8c0-35628bc3b0bc None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:39.418445 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c96b2-614d-4b50-b8c0-35628bc3b0bc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:39.419827 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c96b2-614d-4b50-b8c0-35628bc3b0bc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:39.453108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.sql.core [None req-e37c96b2-614d-4b50-b8c0-35628bc3b0bc None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 22:38:39.453108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 06 22:38:39.453108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [parameters: {'id': '40dff18f16b045c68c9ba2a0f1be46b2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 06 22:38:39.453108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88077) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 22:38:39.470380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-e37c96b2-614d-4b50-b8c0-35628bc3b0bc None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 06 22:38:39.470380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:39.470380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 22:38:39.470380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 22:38:39.470380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 22:38:39.470380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 22:38:39.470380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 22:38:39.470380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 22:38:39.470380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 22:38:39.470380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application conn.query(q) Sep 06 22:38:39.470380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 22:38:39.470380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 22:38:39.470380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 22:38:39.470380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result.read() Sep 06 22:38:39.470380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 22:38:39.471322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 22:38:39.471322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 22:38:39.471322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 22:38:39.471322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 22:38:39.471322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 22:38:39.471322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 22:38:39.471322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 22:38:39.471322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 22:38:39.471322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:39.471322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 22:38:39.471322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:39.471322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:39.471322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 22:38:39.471322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 22:38:39.471322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 06 22:38:39.471322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return ref.to_dict() Sep 06 22:38:39.471322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 22:38:39.471322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application next(self.gen) Sep 06 22:38:39.472309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 22:38:39.472309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application yield resource Sep 06 22:38:39.472309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 22:38:39.472309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application next(self.gen) Sep 06 22:38:39.472309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 22:38:39.472309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 22:38:39.472309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 22:38:39.472309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 22:38:39.472309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 22:38:39.472309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise self.value Sep 06 22:38:39.472309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 22:38:39.472309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 22:38:39.472309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 22:38:39.472309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application session.commit() Sep 06 22:38:39.472309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 22:38:39.472309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 22:38:39.472309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 22:38:39.473197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 22:38:39.473197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 22:38:39.473197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.session.flush() Sep 06 22:38:39.473197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 22:38:39.473197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 22:38:39.473197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 22:38:39.473197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 22:38:39.473197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 22:38:39.473197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application compat.raise_( Sep 06 22:38:39.473197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 22:38:39.473197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception Sep 06 22:38:39.473197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 22:38:39.473197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 22:38:39.473197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 22:38:39.473197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 22:38:39.473197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 22:38:39.473197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 22:38:39.474094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 22:38:39.474094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 22:38:39.474094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 06 22:38:39.474094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 06 22:38:39.474094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 22:38:39.474094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 22:38:39.474094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 22:38:39.474094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 22:38:39.474094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 22:38:39.474094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 22:38:39.474094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 22:38:39.474094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 22:38:39.474094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 22:38:39.474094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 22:38:39.474094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 22:38:39.474094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception Sep 06 22:38:39.474924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 22:38:39.474924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 22:38:39.474924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 22:38:39.474924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 22:38:39.474924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 22:38:39.474924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 22:38:39.474924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 22:38:39.474924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application conn.query(q) Sep 06 22:38:39.474924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 22:38:39.474924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 22:38:39.474924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 22:38:39.474924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application result.read() Sep 06 22:38:39.474924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 22:38:39.474924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 22:38:39.474924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 22:38:39.474924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 22:38:39.475714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 22:38:39.475714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 22:38:39.475714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 22:38:39.475714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 22:38:39.475714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 22:38:39.475714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 06 22:38:39.475714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [parameters: {'id': '40dff18f16b045c68c9ba2a0f1be46b2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 06 22:38:39.475714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 22:38:39.475714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:39.475714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:38:39.475714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:39.475714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:39.475714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:39.475714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:39.475714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:39.475714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:39.476645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:39.476645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:39.476645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:39.476645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:39.476645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:39.476645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:39.476645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 06 22:38:39.476645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 06 22:38:39.476645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:39.476645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:39.476645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 06 22:38:39.476645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 06 22:38:39.476645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 22:38:39.476645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 22:38:39.476645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 06 22:38:39.476645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:39.489509 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 237/478] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Sep 6 22:38:39 2022] POST /identity/v3/roles => generated 144 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:39.489610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb073d62-54b4-4f56-896f-231748e799d7 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:39.556585 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:39.614194 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb073d62-54b4-4f56-896f-231748e799d7 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:39.662293 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830bc5d-be67-41a0-9515-f371108e2eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:39.662937 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830bc5d-be67-41a0-9515-f371108e2eb6 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:39.663216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830bc5d-be67-41a0-9515-f371108e2eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:39.663485 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830bc5d-be67-41a0-9515-f371108e2eb6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:39.680165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830bc5d-be67-41a0-9515-f371108e2eb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:39.685493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-e830bc5d-be67-41a0-9515-f371108e2eb6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:38:39.685493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:39.685493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:39.685493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:39.685493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:39.685493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:39.685493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:39.685493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:39.685493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:39.685493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:39.685493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:39.685493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:39.685493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:39.685493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:39.685493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:39.685493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:39.686434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:39.686434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:39.686434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:39.686434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:39.686434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:39.686434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:39.686434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:39.686434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:39.686434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:39.686434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:39.686434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:39.686434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:39.686434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:39.686434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:39.686434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:39.686434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:39.687287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:39.687287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:39.687287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:39.687287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:39.687287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:39.687287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:39.687287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:39.687287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:39.687287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:39.687287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:39.687287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 22:38:39.687287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:39.687287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 242/479] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:38:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:39.694385 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c96b2-614d-4b50-b8c0-35628bc3b0bc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:39.846707 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c96b2-614d-4b50-b8c0-35628bc3b0bc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:39.883340 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa9138-28e8-47f3-849e-e1d2b478c4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:39.883877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa9138-28e8-47f3-849e-e1d2b478c4cf None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:39.884156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa9138-28e8-47f3-849e-e1d2b478c4cf None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:39.884452 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa9138-28e8-47f3-849e-e1d2b478c4cf None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:39.885159 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa9138-28e8-47f3-849e-e1d2b478c4cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:39.885461 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa9138-28e8-47f3-849e-e1d2b478c4cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:39.886846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa9138-28e8-47f3-849e-e1d2b478c4cf None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:39.888228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:39.900232 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 238/480] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:40.988730 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681630d-c83d-43b9-abd0-943567615ad2 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:40.989732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681630d-c83d-43b9-abd0-943567615ad2 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:40.990220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681630d-c83d-43b9-abd0-943567615ad2 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:40.992075 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 243/481] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:41.001297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c357a0-b226-46ea-b7d4-ecef5ad21cb0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:41.001697 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c357a0-b226-46ea-b7d4-ecef5ad21cb0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:41.001838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c357a0-b226-46ea-b7d4-ecef5ad21cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:41.024300 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a2c357a0-b226-46ea-b7d4-ecef5ad21cb0 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:41.025794 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a2c357a0-b226-46ea-b7d4-ecef5ad21cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:41.129189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 239/482] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:41.450368 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681630d-c83d-43b9-abd0-943567615ad2 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:41.601710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681630d-c83d-43b9-abd0-943567615ad2 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:41.627740 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee99c9b-4019-4fd3-933b-6d7ae0d473f1 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:41.628379 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee99c9b-4019-4fd3-933b-6d7ae0d473f1 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:41.628898 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee99c9b-4019-4fd3-933b-6d7ae0d473f1 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:41.630715 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 240/483] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:38:41.633763 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:41.636264 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c35db1-4403-4d00-972c-cb2bc931d7c6 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:41.636613 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c35db1-4403-4d00-972c-cb2bc931d7c6 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:41.636897 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c35db1-4403-4d00-972c-cb2bc931d7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:41.645307 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d190093-cf86-4057-bb0c-494439f39aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:41.649392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d190093-cf86-4057-bb0c-494439f39aaf None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:41.649392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d190093-cf86-4057-bb0c-494439f39aaf None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:41.649392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d190093-cf86-4057-bb0c-494439f39aaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:41.658859 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d190093-cf86-4057-bb0c-494439f39aaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:41.663917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-1d190093-cf86-4057-bb0c-494439f39aaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:41.663917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:41.663917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:41.663917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:41.663917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:41.663917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:41.663917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:41.663917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:41.663917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:41.663917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:41.663917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:41.663917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:41.663917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:41.663917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:41.663917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:41.663917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:41.664912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:41.664912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:41.664912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:41.664912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:41.664912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:41.664912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:41.664912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:41.664912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:41.664912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:41.664912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:41.664912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:41.664912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:41.664912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:41.664912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:41.664912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:41.664912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:41.665715 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:41.665715 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:41.665715 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:41.665715 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:41.665715 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:41.665715 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:41.665715 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:41.665715 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:41.665715 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:41.665715 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:41.665715 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:41.665715 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:41.668897 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 244/484] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:38:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:41.678762 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d190093-cf86-4057-bb0c-494439f39aaf None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:41.678924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-74c35db1-4403-4d00-972c-cb2bc931d7c6 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:41.678924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-74c35db1-4403-4d00-972c-cb2bc931d7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:41.812891 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 241/485] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 22:38:41.832749 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d190093-cf86-4057-bb0c-494439f39aaf None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:41.867760 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56709abb-cda6-4abd-a92d-fd31995edff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:41.868499 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56709abb-cda6-4abd-a92d-fd31995edff9 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:41.869117 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56709abb-cda6-4abd-a92d-fd31995edff9 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:41.869467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56709abb-cda6-4abd-a92d-fd31995edff9 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:41.870214 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56709abb-cda6-4abd-a92d-fd31995edff9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:41.870588 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56709abb-cda6-4abd-a92d-fd31995edff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:41.872027 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56709abb-cda6-4abd-a92d-fd31995edff9 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:41.880688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 245/486] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:38:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:41.890054 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c35db1-4403-4d00-972c-cb2bc931d7c6 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:41.959102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:41.961251 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88619f65-80fd-4f3d-9cde-5cdf8adc1091 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:41.961548 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88619f65-80fd-4f3d-9cde-5cdf8adc1091 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:41.961829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88619f65-80fd-4f3d-9cde-5cdf8adc1091 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:41.963453 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 246/487] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:41.970984 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd236fb-1ef3-4610-af7f-5f9d4613f86c None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:41.971301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd236fb-1ef3-4610-af7f-5f9d4613f86c None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:41.971550 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd236fb-1ef3-4610-af7f-5f9d4613f86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:41.999768 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-efd236fb-1ef3-4610-af7f-5f9d4613f86c None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:42.001109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-efd236fb-1ef3-4610-af7f-5f9d4613f86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:42.038649 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c35db1-4403-4d00-972c-cb2bc931d7c6 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:42.072671 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:42.121086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f065bb-53c5-4ec2-a041-5a6b25d6ee99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:42.121797 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f065bb-53c5-4ec2-a041-5a6b25d6ee99 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:42.122078 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f065bb-53c5-4ec2-a041-5a6b25d6ee99 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:42.122385 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f065bb-53c5-4ec2-a041-5a6b25d6ee99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:42.136775 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 247/488] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:42.141737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f065bb-53c5-4ec2-a041-5a6b25d6ee99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:42.143292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f065bb-53c5-4ec2-a041-5a6b25d6ee99 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:42.159370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-50f065bb-53c5-4ec2-a041-5a6b25d6ee99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:42.159370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:42.159370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:42.159370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:42.159370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:42.159370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:42.159370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:42.159370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:42.159370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:42.159370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:42.159370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:42.159370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:42.159370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:42.159370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:42.159370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:42.159370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:42.160326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:42.160326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:42.160326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:42.160326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:42.160326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:42.160326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:42.160326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:42.160326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:42.160326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:42.160326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:42.160326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:42.160326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:42.160326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:42.160326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:42.160326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:42.160326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:42.160326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:42.161433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:42.161433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:42.161433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:42.161433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 242/489] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:42.169581 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd236fb-1ef3-4610-af7f-5f9d4613f86c None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:42.202272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f065bb-53c5-4ec2-a041-5a6b25d6ee99 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:42.285093 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd236fb-1ef3-4610-af7f-5f9d4613f86c None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:42.310723 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f065bb-53c5-4ec2-a041-5a6b25d6ee99 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:42.321101 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:42.323165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95c5b2-b5b7-4b0a-a819-1c867d5c2f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:42.324028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95c5b2-b5b7-4b0a-a819-1c867d5c2f3a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:42.324582 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95c5b2-b5b7-4b0a-a819-1c867d5c2f3a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:42.325054 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95c5b2-b5b7-4b0a-a819-1c867d5c2f3a None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:42.325911 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95c5b2-b5b7-4b0a-a819-1c867d5c2f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:42.326407 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95c5b2-b5b7-4b0a-a819-1c867d5c2f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:42.328054 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95c5b2-b5b7-4b0a-a819-1c867d5c2f3a None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:42.344533 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 248/490] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:42.346127 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cdb6d-39e2-4444-8bd1-1269f5687cf2 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:42.346656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cdb6d-39e2-4444-8bd1-1269f5687cf2 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:42.347731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568f0c3-800a-455f-b4a1-29c21ebeff17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:42.348095 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cdb6d-39e2-4444-8bd1-1269f5687cf2 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:42.348374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568f0c3-800a-455f-b4a1-29c21ebeff17 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:42.348731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568f0c3-800a-455f-b4a1-29c21ebeff17 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:42.349006 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568f0c3-800a-455f-b4a1-29c21ebeff17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:42.350511 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 249/491] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:42.351474 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cdb6d-39e2-4444-8bd1-1269f5687cf2 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:42.362396 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568f0c3-800a-455f-b4a1-29c21ebeff17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:42.367920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-8568f0c3-800a-455f-b4a1-29c21ebeff17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:42.367920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:42.367920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:42.367920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:42.367920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:42.367920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:42.367920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:42.367920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:42.367920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:42.367920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:42.367920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:42.367920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:42.367920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:42.367920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:42.367920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:42.367920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:42.368941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:42.368941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:42.368941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:42.368941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:42.368941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:42.368941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:42.368941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:42.368941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:42.368941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:42.368941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:42.368941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:42.368941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:42.368941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:42.368941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:42.368941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:42.368941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:42.369768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:42.369768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:42.369768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:42.369768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:42.369768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:42.369768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:42.369768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:42.369768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:42.369768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:42.369768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:42.369768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:42.369768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:42.371022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 243/492] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:38:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:38:42.371981 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32336dfd-bfbf-4898-ba17-aa47f9193905 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:42.372327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32336dfd-bfbf-4898-ba17-aa47f9193905 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:42.372811 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32336dfd-bfbf-4898-ba17-aa47f9193905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:42.393661 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-32336dfd-bfbf-4898-ba17-aa47f9193905 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:42.394903 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-32336dfd-bfbf-4898-ba17-aa47f9193905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:42.399445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:42.470314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 244/493] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:42.471383 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32336dfd-bfbf-4898-ba17-aa47f9193905 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:42.473373 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cdb6d-39e2-4444-8bd1-1269f5687cf2 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:42.522811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335be1c4-466b-482b-a08f-37ce5b10be02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:42.523442 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335be1c4-466b-482b-a08f-37ce5b10be02 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:42.523776 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335be1c4-466b-482b-a08f-37ce5b10be02 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:42.524338 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335be1c4-466b-482b-a08f-37ce5b10be02 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:42.531802 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335be1c4-466b-482b-a08f-37ce5b10be02 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:42.533319 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335be1c4-466b-482b-a08f-37ce5b10be02 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:42.546617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-335be1c4-466b-482b-a08f-37ce5b10be02 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 22:38:42.546617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:42.546617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:42.546617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:42.546617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:42.546617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:42.546617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:42.546617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:42.546617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:42.546617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:42.546617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:42.546617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:42.546617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:38:42.546617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:38:42.546617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:38:42.546617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:38:42.547564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:42.547564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:42.547564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:38:42.547564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:42.547564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:38:42.547564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:42.547564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:42.547564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:42.547564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:42.547564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:42.547564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:42.547564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:42.547564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:42.547564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:42.547564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:42.547564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:42.547564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:42.547564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:42.548525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:42.548525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:42.548525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:38:42.548525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:38:42.548525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:38:42.548525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:38:42.548525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:38:42.548525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:38:42.548525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 22:38:42.548525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:42.548525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 250/494] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Sep 6 22:38:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:42.548525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335be1c4-466b-482b-a08f-37ce5b10be02 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:42.580510 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:42.584474 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32336dfd-bfbf-4898-ba17-aa47f9193905 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:42.621397 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb71fed-2d68-4c53-a0f6-2c5490079221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:42.622012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb71fed-2d68-4c53-a0f6-2c5490079221 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:42.622291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb71fed-2d68-4c53-a0f6-2c5490079221 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:42.622558 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb71fed-2d68-4c53-a0f6-2c5490079221 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:42.623219 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb71fed-2d68-4c53-a0f6-2c5490079221 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:42.623521 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb71fed-2d68-4c53-a0f6-2c5490079221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:42.625548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb71fed-2d68-4c53-a0f6-2c5490079221 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:42.633593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 245/495] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:38:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:42.634816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c806d2-21db-48b3-8f92-3d4e3903121d None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:42.635105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c806d2-21db-48b3-8f92-3d4e3903121d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:42.635380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c806d2-21db-48b3-8f92-3d4e3903121d None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:42.640764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 246/496] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:42.640764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c806d2-21db-48b3-8f92-3d4e3903121d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:42.662538 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:42.671511 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335be1c4-466b-482b-a08f-37ce5b10be02 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:42.705403 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb7f90-ed45-44cf-8399-f70227f18703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:42.706294 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb7f90-ed45-44cf-8399-f70227f18703 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:42.706573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb7f90-ed45-44cf-8399-f70227f18703 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:42.706843 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb7f90-ed45-44cf-8399-f70227f18703 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:42.717208 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb7f90-ed45-44cf-8399-f70227f18703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:42.722461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-24fb7f90-ed45-44cf-8399-f70227f18703 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:42.722461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:42.722461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:42.722461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:42.722461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:42.722461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:42.722461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:42.722461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:42.722461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:42.722461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:42.722461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:42.722461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:42.722461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:42.722461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:42.722461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:42.722461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:42.723347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:42.723347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:42.723347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:42.723347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:42.723347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:42.723347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:42.723347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:42.723347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:42.723347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:42.723347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:42.723347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:42.723347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:42.723347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:42.723347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:42.723347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:42.723347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:42.724174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:42.724174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:42.724174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:42.724174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:42.724174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:42.724174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:42.724174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:42.724174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:42.724174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:42.724174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:42.724174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:42.724174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:42.724174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 251/497] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:38:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:42.724895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb7f90-ed45-44cf-8399-f70227f18703 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:42.751304 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c806d2-21db-48b3-8f92-3d4e3903121d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:42.784193 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08f860-717d-4717-983c-552849b9f5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:42.784827 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08f860-717d-4717-983c-552849b9f5cc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:42.785111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08f860-717d-4717-983c-552849b9f5cc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:42.785381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08f860-717d-4717-983c-552849b9f5cc None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:42.786103 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08f860-717d-4717-983c-552849b9f5cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:42.786402 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08f860-717d-4717-983c-552849b9f5cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:42.787852 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08f860-717d-4717-983c-552849b9f5cc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:42.822034 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb7f90-ed45-44cf-8399-f70227f18703 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:42.823403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 247/498] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Sep 6 22:38:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:42.824416 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f812e7-12e4-4a9a-a680-125603f57bb3 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:42.824730 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f812e7-12e4-4a9a-a680-125603f57bb3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:42.825010 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f812e7-12e4-4a9a-a680-125603f57bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:42.842171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-68f812e7-12e4-4a9a-a680-125603f57bb3 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:42.843831 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-68f812e7-12e4-4a9a-a680-125603f57bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:42.856451 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:42.861409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24bbd7-9078-4a20-9820-d84214b40fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:42.868997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24bbd7-9078-4a20-9820-d84214b40fd7 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:42.868997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24bbd7-9078-4a20-9820-d84214b40fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:42.868997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24bbd7-9078-4a20-9820-d84214b40fd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:42.873577 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24bbd7-9078-4a20-9820-d84214b40fd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:42.875022 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24bbd7-9078-4a20-9820-d84214b40fd7 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:42.889028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-0c24bbd7-9078-4a20-9820-d84214b40fd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:42.889028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:42.889028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:42.889028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:42.889028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:42.889028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:42.889028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:42.889028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:42.889028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:42.889028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:42.889028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:42.889028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:42.889028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:42.889028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:42.889028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:42.889028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:42.889926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:42.889926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:42.889926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:42.889926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:42.889926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:42.889926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:42.889926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:42.889926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:42.889926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:42.889926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:42.889926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:42.889926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:42.889926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:42.889926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:42.889926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:42.889926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:42.889926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:42.890784 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:42.890784 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:42.890784 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:42.890784 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 252/499] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:42.891522 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24bbd7-9078-4a20-9820-d84214b40fd7 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:42.900413 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:42.912748 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 248/500] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:42.913581 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f812e7-12e4-4a9a-a680-125603f57bb3 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:42.994407 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24bbd7-9078-4a20-9820-d84214b40fd7 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:43.018030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f812e7-12e4-4a9a-a680-125603f57bb3 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:43.031280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d86e5e-f457-462e-bce9-193b791ff6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:43.031993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d86e5e-f457-462e-bce9-193b791ff6ba None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:43.032168 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d86e5e-f457-462e-bce9-193b791ff6ba None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:43.032459 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d86e5e-f457-462e-bce9-193b791ff6ba None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:43.033151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d86e5e-f457-462e-bce9-193b791ff6ba None admin] RBAC: Adding query filter params (name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:43.033454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d86e5e-f457-462e-bce9-193b791ff6ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:43.034812 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d86e5e-f457-462e-bce9-193b791ff6ba None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:43.044396 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 253/501] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:38:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:43.045744 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d86e5e-f457-462e-bce9-193b791ff6ba None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:43.053910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac8a3b-113f-4a08-9ab5-995c9a96352c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:43.054571 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac8a3b-113f-4a08-9ab5-995c9a96352c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:43.054837 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac8a3b-113f-4a08-9ab5-995c9a96352c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:43.055110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac8a3b-113f-4a08-9ab5-995c9a96352c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:43.067823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac8a3b-113f-4a08-9ab5-995c9a96352c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:43.072826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-3aac8a3b-113f-4a08-9ab5-995c9a96352c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:43.072826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:43.072826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:43.072826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:43.072826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:43.072826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:43.072826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:43.072826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:43.072826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:43.072826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:43.072826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:43.072826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:43.072826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:43.072826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:43.072826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:43.072826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:43.073706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:43.073706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:43.073706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:43.073706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:43.073706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:43.073706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:43.073706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:43.073706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:43.073706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:43.073706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:43.073706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:43.073706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:43.073706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:43.073706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:43.073706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:43.073706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:43.074525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:43.074525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:43.074525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:43.074525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:43.074525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:43.074525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:43.074525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:43.074525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:43.074525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:43.074525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:43.074525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:43.074525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:43.074525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 249/502] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:38:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:43.075198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac8a3b-113f-4a08-9ab5-995c9a96352c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:43.088195 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:43.123368 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:43.158253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d86e5e-f457-462e-bce9-193b791ff6ba None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:43.187727 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac8a3b-113f-4a08-9ab5-995c9a96352c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:43.193083 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b02f5-2546-48a9-95df-5a6fbac1bf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:43.193813 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b02f5-2546-48a9-95df-5a6fbac1bf29 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:43.194143 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b02f5-2546-48a9-95df-5a6fbac1bf29 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:43.194422 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b02f5-2546-48a9-95df-5a6fbac1bf29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:43.224394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f45a1-efac-4351-9296-149d722ea138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:43.225020 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f45a1-efac-4351-9296-149d722ea138 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:43.225294 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f45a1-efac-4351-9296-149d722ea138 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:43.225561 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f45a1-efac-4351-9296-149d722ea138 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:43.226196 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f45a1-efac-4351-9296-149d722ea138 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:43.226492 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f45a1-efac-4351-9296-149d722ea138 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:43.227873 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f45a1-efac-4351-9296-149d722ea138 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:43.239264 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 250/503] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:43.241542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f45a1-efac-4351-9296-149d722ea138 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:43.262556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b02f5-2546-48a9-95df-5a6fbac1bf29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:43.264679 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b02f5-2546-48a9-95df-5a6fbac1bf29 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:43.310840 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:43.332405 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:43.345363 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f45a1-efac-4351-9296-149d722ea138 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:43.365467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 254/504] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:43.366324 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b02f5-2546-48a9-95df-5a6fbac1bf29 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:43.378423 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca45452-3040-493f-b23f-771377ab1a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:43.378986 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca45452-3040-493f-b23f-771377ab1a4d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:43.379261 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca45452-3040-493f-b23f-771377ab1a4d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:43.379529 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca45452-3040-493f-b23f-771377ab1a4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:43.390291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca45452-3040-493f-b23f-771377ab1a4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:43.391754 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca45452-3040-493f-b23f-771377ab1a4d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:43.405879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-1ca45452-3040-493f-b23f-771377ab1a4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:43.405879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:43.405879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:43.405879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:43.405879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:43.405879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:43.405879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:43.405879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:43.405879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:43.405879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:43.405879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:43.405879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:43.405879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:43.405879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:43.405879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:43.405879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:43.406806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:43.406806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:43.406806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:43.406806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:43.406806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:43.406806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:43.406806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:43.406806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:43.406806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:43.406806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:43.406806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:43.406806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:43.406806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:43.406806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:43.406806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:43.406806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:43.406806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:43.407678 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:43.407678 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:43.407678 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:43.407678 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 251/505] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:43.407678 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca45452-3040-493f-b23f-771377ab1a4d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:43.466239 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b02f5-2546-48a9-95df-5a6fbac1bf29 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:43.498240 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f244e-eef1-459c-b855-cc207f199d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:43.499358 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f244e-eef1-459c-b855-cc207f199d48 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:43.499633 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f244e-eef1-459c-b855-cc207f199d48 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:43.499901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f244e-eef1-459c-b855-cc207f199d48 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:43.500589 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f244e-eef1-459c-b855-cc207f199d48 None admin] RBAC: Adding query filter params (name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:43.500888 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f244e-eef1-459c-b855-cc207f199d48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:43.502234 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f244e-eef1-459c-b855-cc207f199d48 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:43.509416 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca45452-3040-493f-b23f-771377ab1a4d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:43.509859 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 255/506] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:38:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:43.510620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f244e-eef1-459c-b855-cc207f199d48 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:43.531091 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:43.545429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb950e-8b54-4efb-951b-83a323d24cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:43.545901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:43.546035 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb950e-8b54-4efb-951b-83a323d24cfc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:43.546313 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb950e-8b54-4efb-951b-83a323d24cfc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:43.546581 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb950e-8b54-4efb-951b-83a323d24cfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:43.557495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb950e-8b54-4efb-951b-83a323d24cfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:43.558955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb950e-8b54-4efb-951b-83a323d24cfc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:43.573214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-abcb950e-8b54-4efb-951b-83a323d24cfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:43.573214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:43.573214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:43.573214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:43.573214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:43.573214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:43.573214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:43.573214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:43.573214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:43.573214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:43.573214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:43.573214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:43.573214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:43.573214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:43.573214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:43.573214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:43.574197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:43.574197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:43.574197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:43.574197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:43.574197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:43.574197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:43.574197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:43.574197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:43.574197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:43.574197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:43.574197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:43.574197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:43.574197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:43.574197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:43.574197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:43.574197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:43.574197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:43.575062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:43.575062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:43.575062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:43.575062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 252/507] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:43.575062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb950e-8b54-4efb-951b-83a323d24cfc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:43.617830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f244e-eef1-459c-b855-cc207f199d48 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:43.653181 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e0b6b-335b-4a8e-be83-da8e7b502e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:43.653747 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e0b6b-335b-4a8e-be83-da8e7b502e0d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:43.654027 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e0b6b-335b-4a8e-be83-da8e7b502e0d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:43.654302 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e0b6b-335b-4a8e-be83-da8e7b502e0d None admin] PATH_INFO: `/v3/users/glance` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:43.661298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e0b6b-335b-4a8e-be83-da8e7b502e0d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:43.662830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e0b6b-335b-4a8e-be83-da8e7b502e0d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:43.674089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-fe2e0b6b-335b-4a8e-be83-da8e7b502e0d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 22:38:43.674089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:43.674089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:43.674089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:43.674089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:43.674089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:43.674089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:43.674089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:43.674089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:43.674089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:43.674089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:43.674089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:43.674089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:38:43.674089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:38:43.674089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:38:43.674089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:38:43.675185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:43.675185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:43.675185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:38:43.675185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:43.675185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:38:43.675185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:43.675185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:43.675185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:43.675185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:43.675185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:43.675185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:43.675185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:43.675185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:43.675185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:43.675185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:43.675185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:43.675185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:43.675185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:43.676082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:43.676082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:43.676082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:38:43.676082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:38:43.676082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:38:43.676082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:38:43.676082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:38:43.676082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:38:43.676082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 22:38:43.676082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:43.676647 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb950e-8b54-4efb-951b-83a323d24cfc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:43.676731 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 256/508] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:43.676731 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e0b6b-335b-4a8e-be83-da8e7b502e0d None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:43.713026 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec895e-02a2-4d48-b87f-5bf87a7004ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:43.713644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec895e-02a2-4d48-b87f-5bf87a7004ac None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:43.713921 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec895e-02a2-4d48-b87f-5bf87a7004ac None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:43.714187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec895e-02a2-4d48-b87f-5bf87a7004ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:43.724488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec895e-02a2-4d48-b87f-5bf87a7004ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:43.725934 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec895e-02a2-4d48-b87f-5bf87a7004ac None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:43.739548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-1aec895e-02a2-4d48-b87f-5bf87a7004ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:43.739548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:43.739548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:43.739548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:43.739548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:43.739548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:43.739548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:43.739548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:43.739548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:43.739548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:43.739548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:43.739548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:43.739548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:43.739548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:43.739548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:43.739548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:43.740572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:43.740572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:43.740572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:43.740572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:43.740572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:43.740572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:43.740572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:43.740572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:43.740572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:43.740572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:43.740572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:43.740572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:43.740572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:43.740572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:43.740572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:43.740572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:43.740572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:43.741454 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:43.741454 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:43.741454 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:43.741454 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 253/509] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:43.741454 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec895e-02a2-4d48-b87f-5bf87a7004ac None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:43.770332 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:43.770478 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:43.779668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e0b6b-335b-4a8e-be83-da8e7b502e0d None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:43.813740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e3cee-55f9-4cc4-9706-53b97b412c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:43.814259 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e3cee-55f9-4cc4-9706-53b97b412c8c None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:43.814543 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e3cee-55f9-4cc4-9706-53b97b412c8c None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:43.814815 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e3cee-55f9-4cc4-9706-53b97b412c8c None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:43.815451 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e3cee-55f9-4cc4-9706-53b97b412c8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:43.815753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e3cee-55f9-4cc4-9706-53b97b412c8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:43.817124 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e3cee-55f9-4cc4-9706-53b97b412c8c None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:43.828162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 257/510] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:43.828805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e3cee-55f9-4cc4-9706-53b97b412c8c None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:43.847417 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec895e-02a2-4d48-b87f-5bf87a7004ac None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:43.881478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29dd84-dece-46af-aa58-f9d482a1cfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:43.882101 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29dd84-dece-46af-aa58-f9d482a1cfd4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:43.882383 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29dd84-dece-46af-aa58-f9d482a1cfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:43.882662 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29dd84-dece-46af-aa58-f9d482a1cfd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:43.892437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29dd84-dece-46af-aa58-f9d482a1cfd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:43.893915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29dd84-dece-46af-aa58-f9d482a1cfd4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:43.908534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-5d29dd84-dece-46af-aa58-f9d482a1cfd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:43.908534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:43.908534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:43.908534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:43.908534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:43.908534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:43.908534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:43.908534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:43.908534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:43.908534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:43.908534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:43.908534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:43.908534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:43.908534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:43.908534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:43.908534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:43.914265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:43.914265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:43.914265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:43.914265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:43.914265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:43.914265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:43.914265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:43.914265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:43.914265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:43.914265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:43.914265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:43.914265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:43.914265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:43.914265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:43.914265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:43.914265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:43.914265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:43.915389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:43.915389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:43.915389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:43.915389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 254/511] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:43.915389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29dd84-dece-46af-aa58-f9d482a1cfd4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:43.927111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e3cee-55f9-4cc4-9706-53b97b412c8c None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:43.959841 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e5ab4-33a8-47c2-9dd9-f3f4c0cf44ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:43.960469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e5ab4-33a8-47c2-9dd9-f3f4c0cf44ea None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:43.960754 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e5ab4-33a8-47c2-9dd9-f3f4c0cf44ea None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:43.961024 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e5ab4-33a8-47c2-9dd9-f3f4c0cf44ea None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:43.961657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e5ab4-33a8-47c2-9dd9-f3f4c0cf44ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:43.961956 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e5ab4-33a8-47c2-9dd9-f3f4c0cf44ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:43.963304 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e5ab4-33a8-47c2-9dd9-f3f4c0cf44ea None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:43.974562 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 258/512] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:43.975330 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e5ab4-33a8-47c2-9dd9-f3f4c0cf44ea None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:43.987059 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:43.992329 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:44.015082 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29dd84-dece-46af-aa58-f9d482a1cfd4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:44.048200 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adc42a-057f-4f54-a293-00f6a92665c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:44.048832 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adc42a-057f-4f54-a293-00f6a92665c3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:44.049111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adc42a-057f-4f54-a293-00f6a92665c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:44.049385 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adc42a-057f-4f54-a293-00f6a92665c3 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:44.050109 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4adc42a-057f-4f54-a293-00f6a92665c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:44.050413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4adc42a-057f-4f54-a293-00f6a92665c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:44.051863 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4adc42a-057f-4f54-a293-00f6a92665c3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:44.070490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 255/513] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Sep 6 22:38:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:44.071306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adc42a-057f-4f54-a293-00f6a92665c3 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:44.078369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e5ab4-33a8-47c2-9dd9-f3f4c0cf44ea None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:44.113163 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643a2c1-b60b-4a28-8ccb-e397eab5ae77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:44.113777 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643a2c1-b60b-4a28-8ccb-e397eab5ae77 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:44.114059 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643a2c1-b60b-4a28-8ccb-e397eab5ae77 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:44.114332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643a2c1-b60b-4a28-8ccb-e397eab5ae77 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:44.114972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643a2c1-b60b-4a28-8ccb-e397eab5ae77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:44.115275 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643a2c1-b60b-4a28-8ccb-e397eab5ae77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:44.116663 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643a2c1-b60b-4a28-8ccb-e397eab5ae77 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:44.128106 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 259/514] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:44.128909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643a2c1-b60b-4a28-8ccb-e397eab5ae77 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:44.175001 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adc42a-057f-4f54-a293-00f6a92665c3 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:44.201262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:44.209696 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317de94-4b2c-4591-831a-d7843ad1845e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:44.210320 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317de94-4b2c-4591-831a-d7843ad1845e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:44.210594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317de94-4b2c-4591-831a-d7843ad1845e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:44.210863 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317de94-4b2c-4591-831a-d7843ad1845e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:44.214495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:44.218731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317de94-4b2c-4591-831a-d7843ad1845e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:44.220166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317de94-4b2c-4591-831a-d7843ad1845e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:44.232375 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643a2c1-b60b-4a28-8ccb-e397eab5ae77 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:44.232764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-d317de94-4b2c-4591-831a-d7843ad1845e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 22:38:44.232764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:44.232764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:44.232764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:44.232764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:44.232764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:44.232764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:44.232764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:44.232764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:44.232764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:44.232764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:44.232764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:44.232764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:38:44.232764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:38:44.232764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:38:44.232764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:38:44.235846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:44.235846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:44.235846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:38:44.235846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:44.235846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:38:44.235846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:44.235846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:44.235846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:44.235846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:44.235846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:44.235846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:44.235846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:44.235846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:44.235846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:44.235846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:44.235846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:44.235846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:44.235846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:44.236822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:44.236822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:44.236822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:38:44.236822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:38:44.236822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:38:44.236822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:38:44.236822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:38:44.236822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:38:44.236822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 22:38:44.236822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:44.236822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 256/515] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:44.236822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317de94-4b2c-4591-831a-d7843ad1845e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:44.270530 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7e90c-b284-4cf4-a378-920f5706aaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:44.271145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7e90c-b284-4cf4-a378-920f5706aaf5 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:44.271421 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7e90c-b284-4cf4-a378-920f5706aaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:44.271692 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7e90c-b284-4cf4-a378-920f5706aaf5 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:44.272327 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7e90c-b284-4cf4-a378-920f5706aaf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:44.272660 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7e90c-b284-4cf4-a378-920f5706aaf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:44.274025 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7e90c-b284-4cf4-a378-920f5706aaf5 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:44.286640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 260/516] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:44.287410 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7e90c-b284-4cf4-a378-920f5706aaf5 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:44.337367 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317de94-4b2c-4591-831a-d7843ad1845e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:44.371575 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e872d9-0089-454c-88e4-db8b63abe2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:44.372224 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e872d9-0089-454c-88e4-db8b63abe2ef None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:44.372534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e872d9-0089-454c-88e4-db8b63abe2ef None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:44.372808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e872d9-0089-454c-88e4-db8b63abe2ef None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:44.373830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e872d9-0089-454c-88e4-db8b63abe2ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:44.374969 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e872d9-0089-454c-88e4-db8b63abe2ef None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:44.384846 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7e90c-b284-4cf4-a378-920f5706aaf5 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:44.412353 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:44.417862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fcea3-6451-40e5-9c1d-863d3a1af518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:44.418460 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fcea3-6451-40e5-9c1d-863d3a1af518 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:44.418735 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fcea3-6451-40e5-9c1d-863d3a1af518 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:44.419003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fcea3-6451-40e5-9c1d-863d3a1af518 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:44.487343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 257/517] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Sep 6 22:38:44 2022] POST /identity/v3/users => generated 247 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:38:44.488085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e872d9-0089-454c-88e4-db8b63abe2ef None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:44.488909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fcea3-6451-40e5-9c1d-863d3a1af518 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:44.490472 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fcea3-6451-40e5-9c1d-863d3a1af518 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:44.557521 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:44.610356 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 261/518] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:44.611346 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fcea3-6451-40e5-9c1d-863d3a1af518 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:44.614629 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e872d9-0089-454c-88e4-db8b63abe2ef None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:44.645879 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:44.654448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3760d8b-d9d6-4cf3-a96f-854018fa4561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:44.655727 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3760d8b-d9d6-4cf3-a96f-854018fa4561 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:44.661154 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3760d8b-d9d6-4cf3-a96f-854018fa4561 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:44.661154 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3760d8b-d9d6-4cf3-a96f-854018fa4561 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:44.663632 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3760d8b-d9d6-4cf3-a96f-854018fa4561 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:44.665141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3760d8b-d9d6-4cf3-a96f-854018fa4561 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:44.677887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-d3760d8b-d9d6-4cf3-a96f-854018fa4561 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:44.677887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:44.677887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:44.677887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:44.677887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:44.677887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:44.677887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:44.677887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:44.677887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:44.677887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:44.677887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:44.677887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:44.677887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:38:44.677887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:38:44.677887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:38:44.678946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:38:44.678946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:44.678946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:44.678946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:44.678946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:44.678946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:44.678946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:44.678946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:44.678946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:44.678946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:44.678946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:44.678946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:44.678946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:44.678946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:44.678946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:44.678946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:44.678946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:44.680239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:38:44.680239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:38:44.680239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:38:44.680239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:38:44.680239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:38:44.680239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:38:44.680239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:44.680239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:44.680239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 258/519] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:44.680888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3760d8b-d9d6-4cf3-a96f-854018fa4561 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:44.731075 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fcea3-6451-40e5-9c1d-863d3a1af518 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:44.766344 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bae9ee-b0ba-4afc-92af-0c6aa500637c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:44.766962 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bae9ee-b0ba-4afc-92af-0c6aa500637c None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:44.767248 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bae9ee-b0ba-4afc-92af-0c6aa500637c None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:44.767521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bae9ee-b0ba-4afc-92af-0c6aa500637c None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:44.768253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bae9ee-b0ba-4afc-92af-0c6aa500637c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:44.768590 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bae9ee-b0ba-4afc-92af-0c6aa500637c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:44.770025 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bae9ee-b0ba-4afc-92af-0c6aa500637c None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:44.801199 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3760d8b-d9d6-4cf3-a96f-854018fa4561 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:44.807385 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 262/520] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Sep 6 22:38:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:44.808231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bae9ee-b0ba-4afc-92af-0c6aa500637c None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:44.816118 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:44.845742 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b19e2-ef8a-44e1-b006-a0a104d59e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:44.846378 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b19e2-ef8a-44e1-b006-a0a104d59e7f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:44.846760 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b19e2-ef8a-44e1-b006-a0a104d59e7f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:44.846924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b19e2-ef8a-44e1-b006-a0a104d59e7f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:44.855681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b19e2-ef8a-44e1-b006-a0a104d59e7f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:44.857203 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b19e2-ef8a-44e1-b006-a0a104d59e7f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:44.869507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-8d5b19e2-ef8a-44e1-b006-a0a104d59e7f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 22:38:44.869507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:44.869507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:44.869507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:44.869507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:44.869507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:44.869507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:44.869507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:44.869507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:44.869507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:44.869507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:44.869507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:44.869507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:38:44.869507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:38:44.869507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:38:44.869507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:38:44.870624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:44.870624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:44.870624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:38:44.870624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:44.870624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:38:44.870624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:44.870624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:44.870624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:44.870624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:44.870624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:44.870624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:44.870624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:44.870624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:44.870624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:44.870624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:44.870624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:44.870624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:44.870624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:44.871838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:44.871838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:44.871838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:38:44.871838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:38:44.871838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:38:44.871838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:38:44.871838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:38:44.871838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:38:44.871838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 22:38:44.871838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:44.878185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 259/521] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:38:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:44.878185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b19e2-ef8a-44e1-b006-a0a104d59e7f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:44.915892 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:44.928172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bae9ee-b0ba-4afc-92af-0c6aa500637c None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:44.965100 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3fa5f-ae27-4fbc-b92e-1b48bca39e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:44.966027 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3fa5f-ae27-4fbc-b92e-1b48bca39e6b None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:44.966309 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3fa5f-ae27-4fbc-b92e-1b48bca39e6b None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:44.966583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3fa5f-ae27-4fbc-b92e-1b48bca39e6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:44.978118 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3fa5f-ae27-4fbc-b92e-1b48bca39e6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:44.979770 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3fa5f-ae27-4fbc-b92e-1b48bca39e6b None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:44.980445 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b19e2-ef8a-44e1-b006-a0a104d59e7f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:44.996280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-b1f3fa5f-ae27-4fbc-b92e-1b48bca39e6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:44.996280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:44.996280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:44.996280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:44.996280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:44.996280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:44.996280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:44.996280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:44.996280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:44.996280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:44.996280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:44.996280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:44.996280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:44.996280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:44.996280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:44.996280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:44.997317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:44.997317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:44.997317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:44.997317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:44.997317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:44.997317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:44.997317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:44.997317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:44.997317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:44.997317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:44.997317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:44.997317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:44.997317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:44.997317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:44.997317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:44.997317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:44.997317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:44.998219 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:44.998219 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:44.998219 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:44.998219 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 263/522] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:45.000258 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3fa5f-ae27-4fbc-b92e-1b48bca39e6b None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:45.023234 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf83b3b-69ca-49df-83c2-b4c870b28371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:45.023824 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf83b3b-69ca-49df-83c2-b4c870b28371 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:45.024107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf83b3b-69ca-49df-83c2-b4c870b28371 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:45.024378 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf83b3b-69ca-49df-83c2-b4c870b28371 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:45.025183 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf83b3b-69ca-49df-83c2-b4c870b28371 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:45.025539 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf83b3b-69ca-49df-83c2-b4c870b28371 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:45.026975 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf83b3b-69ca-49df-83c2-b4c870b28371 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:45.045463 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 260/523] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:38:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:45.046210 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf83b3b-69ca-49df-83c2-b4c870b28371 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:45.081330 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:45.119263 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3fa5f-ae27-4fbc-b92e-1b48bca39e6b None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:45.157195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e8f9f-7acc-4401-9358-f6e95b9d04ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:45.157821 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e8f9f-7acc-4401-9358-f6e95b9d04ae None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:45.158097 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e8f9f-7acc-4401-9358-f6e95b9d04ae None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:45.158372 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e8f9f-7acc-4401-9358-f6e95b9d04ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:45.164612 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf83b3b-69ca-49df-83c2-b4c870b28371 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:45.169196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:45.206699 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391701c-df3a-4143-8409-8d2f639c4683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:45.207467 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391701c-df3a-4143-8409-8d2f639c4683 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:45.207843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391701c-df3a-4143-8409-8d2f639c4683 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:45.208205 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391701c-df3a-4143-8409-8d2f639c4683 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:45.209059 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391701c-df3a-4143-8409-8d2f639c4683 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:45.209455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391701c-df3a-4143-8409-8d2f639c4683 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:45.211018 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391701c-df3a-4143-8409-8d2f639c4683 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:45.228730 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 261/524] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Sep 6 22:38:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:45.229533 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391701c-df3a-4143-8409-8d2f639c4683 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:45.236444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e8f9f-7acc-4401-9358-f6e95b9d04ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:45.237934 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e8f9f-7acc-4401-9358-f6e95b9d04ae None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:45.330519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:45.342956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391701c-df3a-4143-8409-8d2f639c4683 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:45.357585 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 264/525] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:45.357585 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e8f9f-7acc-4401-9358-f6e95b9d04ae None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:45.383876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e5a58-9248-4e3a-9593-a64409f12684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:45.384750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e5a58-9248-4e3a-9593-a64409f12684 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:45.385032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e5a58-9248-4e3a-9593-a64409f12684 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:45.385311 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e5a58-9248-4e3a-9593-a64409f12684 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:45.385957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e5a58-9248-4e3a-9593-a64409f12684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:45.386258 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e5a58-9248-4e3a-9593-a64409f12684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:45.387650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e5a58-9248-4e3a-9593-a64409f12684 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:45.404620 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 262/526] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:45.404620 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e5a58-9248-4e3a-9593-a64409f12684 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:45.408545 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:45.471201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e8f9f-7acc-4401-9358-f6e95b9d04ae None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:45.502305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e5a58-9248-4e3a-9593-a64409f12684 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:45.507290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd30139-d15e-4e23-9975-f1811703fe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:45.508003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd30139-d15e-4e23-9975-f1811703fe09 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:45.508382 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd30139-d15e-4e23-9975-f1811703fe09 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:45.508781 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd30139-d15e-4e23-9975-f1811703fe09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:45.509684 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd30139-d15e-4e23-9975-f1811703fe09 None admin] RBAC: Adding query filter params (role.id=85bcc17628d742209f79cc936d4290b5, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=b18fd296138349408613004929144e70) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:45.510150 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd30139-d15e-4e23-9975-f1811703fe09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:45.511777 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd30139-d15e-4e23-9975-f1811703fe09 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:45.528460 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 265/527] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:38:45 2022] GET /identity/v3/role_assignments?user.id=b18fd296138349408613004929144e70&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=85bcc17628d742209f79cc936d4290b5 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:45.528460 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd30139-d15e-4e23-9975-f1811703fe09 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:45.550976 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8e6d4-5014-4124-88fc-17a5167770ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:45.551598 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8e6d4-5014-4124-88fc-17a5167770ea None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:45.551878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8e6d4-5014-4124-88fc-17a5167770ea None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:45.552151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8e6d4-5014-4124-88fc-17a5167770ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:45.573891 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:45.633403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8e6d4-5014-4124-88fc-17a5167770ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:45.634935 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8e6d4-5014-4124-88fc-17a5167770ea None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:45.657280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd30139-d15e-4e23-9975-f1811703fe09 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:45.660079 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:45.699150 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dadae0-c6a8-4769-9b19-c417d3fb93a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:45.700296 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dadae0-c6a8-4769-9b19-c417d3fb93a1 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:45.700738 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dadae0-c6a8-4769-9b19-c417d3fb93a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:45.701150 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dadae0-c6a8-4769-9b19-c417d3fb93a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:45.713361 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dadae0-c6a8-4769-9b19-c417d3fb93a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:45.715091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dadae0-c6a8-4769-9b19-c417d3fb93a1 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:45.733470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-14dadae0-c6a8-4769-9b19-c417d3fb93a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:45.733470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:45.733470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:45.733470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:45.733470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:45.733470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:45.733470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:45.733470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:45.733470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:45.733470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:45.733470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:45.733470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:45.733470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:45.733470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:45.733470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:45.733470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:45.734628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:45.734628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:45.734628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:45.734628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:45.734628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:45.734628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:45.734628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:45.734628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:45.734628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:45.734628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:45.734628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:45.734628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:45.734628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:45.734628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:45.734628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:45.734628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:45.734628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:45.735682 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:45.735682 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:45.735682 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:45.737563 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 266/528] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:45.738555 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dadae0-c6a8-4769-9b19-c417d3fb93a1 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:45.755363 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 263/529] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:45.760747 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8e6d4-5014-4124-88fc-17a5167770ea None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:45.817034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:45.854820 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dadae0-c6a8-4769-9b19-c417d3fb93a1 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:45.885565 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8e6d4-5014-4124-88fc-17a5167770ea None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:45.893457 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cc427-0bb8-4beb-9989-fd4ad7872519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:45.894373 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cc427-0bb8-4beb-9989-fd4ad7872519 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:45.894787 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cc427-0bb8-4beb-9989-fd4ad7872519 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:45.895225 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cc427-0bb8-4beb-9989-fd4ad7872519 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:45.902993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cc427-0bb8-4beb-9989-fd4ad7872519 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:45.905173 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cc427-0bb8-4beb-9989-fd4ad7872519 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:45.917993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-421cc427-0bb8-4beb-9989-fd4ad7872519 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:45.917993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:45.917993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:45.917993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:45.917993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:45.917993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:45.917993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:45.917993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:45.917993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:45.917993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:45.917993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:45.917993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:45.917993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:38:45.917993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:38:45.917993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:38:45.919050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:38:45.919050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:45.919050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:45.919050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:45.919050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:45.919050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:45.919050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:45.919050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:45.919050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:45.919050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:45.919050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:45.919050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:45.919050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:45.919050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:45.919050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:45.919050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:45.919050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:45.920167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:38:45.920167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:38:45.920167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:38:45.920167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:38:45.920167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:38:45.920167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:38:45.920167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:45.920167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:45.923216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 267/530] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:45.924261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cc427-0bb8-4beb-9989-fd4ad7872519 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:45.928276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be7444-b153-477d-a0e0-69f9bd83b767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:45.929928 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be7444-b153-477d-a0e0-69f9bd83b767 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:45.930281 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be7444-b153-477d-a0e0-69f9bd83b767 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:45.930628 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be7444-b153-477d-a0e0-69f9bd83b767 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:45.931347 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be7444-b153-477d-a0e0-69f9bd83b767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:45.931717 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be7444-b153-477d-a0e0-69f9bd83b767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:45.933257 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be7444-b153-477d-a0e0-69f9bd83b767 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:45.946046 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:45.949092 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 264/531] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:45.949900 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be7444-b153-477d-a0e0-69f9bd83b767 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:46.053227 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cc427-0bb8-4beb-9989-fd4ad7872519 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:46.088950 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be7444-b153-477d-a0e0-69f9bd83b767 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:46.100731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:46.112560 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ab136-38b9-4fc3-9e63-05656c2b3b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:46.113757 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ab136-38b9-4fc3-9e63-05656c2b3b06 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:46.114275 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ab136-38b9-4fc3-9e63-05656c2b3b06 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:46.114891 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ab136-38b9-4fc3-9e63-05656c2b3b06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:46.126091 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc297077-5005-42b0-9c5b-c452b0963925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:46.127441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc297077-5005-42b0-9c5b-c452b0963925 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:46.128199 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc297077-5005-42b0-9c5b-c452b0963925 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:46.128691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc297077-5005-42b0-9c5b-c452b0963925 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:46.128846 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ab136-38b9-4fc3-9e63-05656c2b3b06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:46.130102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc297077-5005-42b0-9c5b-c452b0963925 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:46.130493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ab136-38b9-4fc3-9e63-05656c2b3b06 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:46.130814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc297077-5005-42b0-9c5b-c452b0963925 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:46.132904 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc297077-5005-42b0-9c5b-c452b0963925 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:46.148603 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 265/532] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:38:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:46.148753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-a20ab136-38b9-4fc3-9e63-05656c2b3b06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:46.148753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:46.148753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:46.148753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:46.148753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:46.148753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:46.148753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:46.148753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:46.148753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:46.148753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:46.148753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:46.148753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:46.148753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:46.148753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:46.148753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:46.148753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:46.149803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:46.149803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:46.149803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:46.149803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:46.149803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:46.149803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:46.149803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:46.149803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:46.149803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:46.149803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:46.149803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:46.149803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:46.149803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:46.149803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:46.149803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:46.149803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:46.149803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:46.150662 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:46.150662 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:46.150662 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:46.150662 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 268/533] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:46.150890 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ab136-38b9-4fc3-9e63-05656c2b3b06 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:46.157707 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc297077-5005-42b0-9c5b-c452b0963925 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:46.244699 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:46.270175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc297077-5005-42b0-9c5b-c452b0963925 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:46.294259 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ab136-38b9-4fc3-9e63-05656c2b3b06 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:46.312927 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d788a-c555-4161-b8a3-0ca6939b6148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:46.314061 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d788a-c555-4161-b8a3-0ca6939b6148 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:46.314513 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d788a-c555-4161-b8a3-0ca6939b6148 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:46.315337 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d788a-c555-4161-b8a3-0ca6939b6148 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:46.316264 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d788a-c555-4161-b8a3-0ca6939b6148 None admin] RBAC: Adding query filter params (role.id=85bcc17628d742209f79cc936d4290b5, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=4a2c1f1668814a5e9e654c6308fa0628) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:46.316818 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d788a-c555-4161-b8a3-0ca6939b6148 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:46.319225 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d788a-c555-4161-b8a3-0ca6939b6148 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:46.332644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 266/534] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:38:46 2022] GET /identity/v3/role_assignments?user.id=4a2c1f1668814a5e9e654c6308fa0628&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=85bcc17628d742209f79cc936d4290b5 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:46.332644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d788a-c555-4161-b8a3-0ca6939b6148 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:46.343792 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26f6ad-b53c-4d34-ba95-54e9f7fa7d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:46.344490 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26f6ad-b53c-4d34-ba95-54e9f7fa7d8f None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:46.344776 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26f6ad-b53c-4d34-ba95-54e9f7fa7d8f None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:46.345047 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26f6ad-b53c-4d34-ba95-54e9f7fa7d8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:46.362341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26f6ad-b53c-4d34-ba95-54e9f7fa7d8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:46.364090 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26f6ad-b53c-4d34-ba95-54e9f7fa7d8f None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:46.382109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-ed26f6ad-b53c-4d34-ba95-54e9f7fa7d8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:46.382109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:46.382109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:46.382109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:46.382109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:46.382109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:46.382109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:46.382109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:46.382109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:46.382109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:46.382109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:46.382109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:46.382109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:38:46.382109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:38:46.382109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:38:46.383062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:38:46.383062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:46.383062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:46.383062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:46.383062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:46.383062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:46.383062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:46.383062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:46.383062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:46.383062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:46.383062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:46.383062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:46.383062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:46.383062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:46.383062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:46.383062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:46.383062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:46.383991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:38:46.383991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:38:46.383991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:38:46.383991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:38:46.383991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:38:46.383991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:38:46.383991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:46.383991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:46.391954 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 269/535] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:46.396361 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26f6ad-b53c-4d34-ba95-54e9f7fa7d8f None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:46.417804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:46.527847 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26f6ad-b53c-4d34-ba95-54e9f7fa7d8f None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:46.566978 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:46.577954 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099910fa-623d-4424-98a3-36d65e9ba38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:46.579077 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099910fa-623d-4424-98a3-36d65e9ba38f None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:46.579571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099910fa-623d-4424-98a3-36d65e9ba38f None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:46.580041 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099910fa-623d-4424-98a3-36d65e9ba38f None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:46.581309 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099910fa-623d-4424-98a3-36d65e9ba38f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:46.587824 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099910fa-623d-4424-98a3-36d65e9ba38f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:46.587824 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099910fa-623d-4424-98a3-36d65e9ba38f None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:46.609583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 270/536] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:38:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:46.615808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099910fa-623d-4424-98a3-36d65e9ba38f None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:46.617685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d788a-c555-4161-b8a3-0ca6939b6148 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:46.656432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db2f76-1b09-4bf1-b6e5-3403878b781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:46.657176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db2f76-1b09-4bf1-b6e5-3403878b781d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:46.657388 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db2f76-1b09-4bf1-b6e5-3403878b781d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:46.658952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db2f76-1b09-4bf1-b6e5-3403878b781d None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:46.659760 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db2f76-1b09-4bf1-b6e5-3403878b781d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:46.660017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db2f76-1b09-4bf1-b6e5-3403878b781d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:46.661652 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db2f76-1b09-4bf1-b6e5-3403878b781d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:46.684944 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 267/537] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:46.691032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ca3e3-9add-48d3-a89c-3ab097f063bf None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:46.691327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ca3e3-9add-48d3-a89c-3ab097f063bf None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:46.691726 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ca3e3-9add-48d3-a89c-3ab097f063bf None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:46.693362 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 268/538] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:38:46.694662 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ca3e3-9add-48d3-a89c-3ab097f063bf None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:46.738952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099910fa-623d-4424-98a3-36d65e9ba38f None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:46.788988 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda01a3f-3517-4ef3-9018-6268e75344df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:46.789969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda01a3f-3517-4ef3-9018-6268e75344df None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:46.790445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda01a3f-3517-4ef3-9018-6268e75344df None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:46.790908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda01a3f-3517-4ef3-9018-6268e75344df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:46.792351 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda01a3f-3517-4ef3-9018-6268e75344df None admin] RBAC: Adding query filter params (role.id=85bcc17628d742209f79cc936d4290b5, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=5ef596f83ce54fab8779e4e0f3899abc) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:46.792993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda01a3f-3517-4ef3-9018-6268e75344df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:46.794946 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda01a3f-3517-4ef3-9018-6268e75344df None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:46.796337 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:46.805163 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 271/539] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:38:46 2022] GET /identity/v3/role_assignments?user.id=5ef596f83ce54fab8779e4e0f3899abc&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=85bcc17628d742209f79cc936d4290b5 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:46.816415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1d16f-d686-41fb-af41-7b00855c3968 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:46.816415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1d16f-d686-41fb-af41-7b00855c3968 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:46.816415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1d16f-d686-41fb-af41-7b00855c3968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:46.816723 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ca3e3-9add-48d3-a89c-3ab097f063bf None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:46.828412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-8bd1d16f-d686-41fb-af41-7b00855c3968 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:46.830061 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-8bd1d16f-d686-41fb-af41-7b00855c3968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:46.891280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff590f6-6e6c-4109-8398-91f58c97d099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:46.891978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff590f6-6e6c-4109-8398-91f58c97d099 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:46.892259 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff590f6-6e6c-4109-8398-91f58c97d099 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:46.892553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff590f6-6e6c-4109-8398-91f58c97d099 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:46.895356 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:46.908495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff590f6-6e6c-4109-8398-91f58c97d099 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:46.909986 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff590f6-6e6c-4109-8398-91f58c97d099 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:46.919159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 272/540] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:46.926626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-1ff590f6-6e6c-4109-8398-91f58c97d099 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:46.926626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:46.926626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:46.926626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:46.926626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:46.926626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:46.926626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:46.926626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:46.926626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:46.926626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:46.926626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:46.926626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:46.926626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:38:46.926626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:38:46.926626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:38:46.927534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:38:46.927534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:46.927534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:46.927534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:46.927534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:46.927534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:46.927534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:46.927534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:46.927534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:46.927534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:46.927534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:46.927534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:46.927534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:46.927534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:46.927534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:46.927534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:46.927534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:46.928834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:38:46.928834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:38:46.928834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:38:46.928834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:38:46.928834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:38:46.928834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:38:46.928834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:46.928834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:46.928834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 269/541] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:38:46.933892 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1d16f-d686-41fb-af41-7b00855c3968 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:47.103665 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1d16f-d686-41fb-af41-7b00855c3968 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:47.147420 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573c4b6-78f9-419f-a4fa-9c251b7233da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:47.148024 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573c4b6-78f9-419f-a4fa-9c251b7233da None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:47.148305 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573c4b6-78f9-419f-a4fa-9c251b7233da None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:47.148612 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573c4b6-78f9-419f-a4fa-9c251b7233da None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:47.149306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573c4b6-78f9-419f-a4fa-9c251b7233da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:47.149616 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573c4b6-78f9-419f-a4fa-9c251b7233da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:47.151040 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573c4b6-78f9-419f-a4fa-9c251b7233da None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:47.166961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 273/542] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:38:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:47.173597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff590f6-6e6c-4109-8398-91f58c97d099 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:47.213828 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573c4b6-78f9-419f-a4fa-9c251b7233da None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:47.300204 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:47.307492 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff590f6-6e6c-4109-8398-91f58c97d099 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:47.350011 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052c811-5089-4c5c-8d35-078f46e963a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:47.350545 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052c811-5089-4c5c-8d35-078f46e963a2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:47.350823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052c811-5089-4c5c-8d35-078f46e963a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:47.351094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052c811-5089-4c5c-8d35-078f46e963a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:47.351833 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052c811-5089-4c5c-8d35-078f46e963a2 None admin] RBAC: Adding query filter params (role.id=85bcc17628d742209f79cc936d4290b5, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=314bb14d5fa1414a832efb6d37c0446d) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:47.352136 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052c811-5089-4c5c-8d35-078f46e963a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:47.353610 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052c811-5089-4c5c-8d35-078f46e963a2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:47.365579 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 270/543] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:38:47 2022] GET /identity/v3/role_assignments?user.id=314bb14d5fa1414a832efb6d37c0446d&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=85bcc17628d742209f79cc936d4290b5 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:47.412537 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573c4b6-78f9-419f-a4fa-9c251b7233da None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:47.468754 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c04d8-428a-419d-8170-320f2f474932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:47.469421 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c04d8-428a-419d-8170-320f2f474932 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:47.469698 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c04d8-428a-419d-8170-320f2f474932 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:47.469971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c04d8-428a-419d-8170-320f2f474932 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:47.481831 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c04d8-428a-419d-8170-320f2f474932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:47.487919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-f28c04d8-428a-419d-8170-320f2f474932 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:47.487919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:47.487919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:47.487919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:47.487919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:47.487919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:47.487919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:47.487919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:47.487919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:47.487919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:47.487919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:47.487919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:47.487919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:47.487919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:47.487919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:47.487919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:47.488972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:47.488972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:47.488972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:47.488972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:47.488972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:47.488972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:47.488972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:47.488972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:47.488972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:47.488972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:47.488972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:47.488972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:47.488972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:47.488972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:47.488972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:47.488972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:47.489771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:47.489771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:47.489771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:47.489771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:47.489771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:47.489771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:47.489771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:47.489771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:47.489771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:47.489771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:47.489771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:47.489771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:47.489771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 274/544] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:38:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:38:47.494936 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052c811-5089-4c5c-8d35-078f46e963a2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:47.527029 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:47.641793 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052c811-5089-4c5c-8d35-078f46e963a2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:47.679455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7010f-f603-4f8d-bb45-467fffa6df04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:47.680413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7010f-f603-4f8d-bb45-467fffa6df04 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:47.680918 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7010f-f603-4f8d-bb45-467fffa6df04 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:47.681413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7010f-f603-4f8d-bb45-467fffa6df04 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:47.682292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7010f-f603-4f8d-bb45-467fffa6df04 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:47.682793 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7010f-f603-4f8d-bb45-467fffa6df04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:47.684452 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7010f-f603-4f8d-bb45-467fffa6df04 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:47.693746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 271/545] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:38:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:47.702634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c04d8-428a-419d-8170-320f2f474932 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:47.817197 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c04d8-428a-419d-8170-320f2f474932 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:47.820829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:47.870003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb86366-ce4f-4b74-a230-ac1e2c227525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:47.870667 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb86366-ce4f-4b74-a230-ac1e2c227525 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:47.870942 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb86366-ce4f-4b74-a230-ac1e2c227525 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:47.871409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb86366-ce4f-4b74-a230-ac1e2c227525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:47.883333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb86366-ce4f-4b74-a230-ac1e2c227525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:47.889515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb86366-ce4f-4b74-a230-ac1e2c227525 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:47.907958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-efb86366-ce4f-4b74-a230-ac1e2c227525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:47.907958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:47.907958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:47.907958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:47.907958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:47.907958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:47.907958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:47.907958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:47.907958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:47.907958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:47.907958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:47.907958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:47.907958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:47.907958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:47.907958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:47.907958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:47.909300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:47.909300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:47.909300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:47.909300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:47.909300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:47.909300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:47.909300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:47.909300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:47.909300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:47.909300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:47.909300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:47.909300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:47.909300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:47.909300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:47.909300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:47.909300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:47.909300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:47.910346 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:47.910346 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:47.910346 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:47.910346 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 275/546] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:38:47.914769 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7010f-f603-4f8d-bb45-467fffa6df04 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:47.966404 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06c61c-980c-411c-8fc7-353491d61d3b None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:47.966721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06c61c-980c-411c-8fc7-353491d61d3b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:47.966984 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06c61c-980c-411c-8fc7-353491d61d3b None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:47.968585 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 276/547] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:47.975557 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75aae7-45ef-4d28-8ef6-15d65ff40358 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:47.975838 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75aae7-45ef-4d28-8ef6-15d65ff40358 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:47.976385 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75aae7-45ef-4d28-8ef6-15d65ff40358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:48.002224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-3e75aae7-45ef-4d28-8ef6-15d65ff40358 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:48.003413 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3e75aae7-45ef-4d28-8ef6-15d65ff40358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:48.080910 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 277/548] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 22:38:48.085278 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:48.137652 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7010f-f603-4f8d-bb45-467fffa6df04 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:48.191059 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc3776-7c47-4ada-aa58-4ffa9c7ff064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:48.191657 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc3776-7c47-4ada-aa58-4ffa9c7ff064 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:48.191877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc3776-7c47-4ada-aa58-4ffa9c7ff064 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:48.192120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc3776-7c47-4ada-aa58-4ffa9c7ff064 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:48.192795 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc3776-7c47-4ada-aa58-4ffa9c7ff064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:48.193095 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc3776-7c47-4ada-aa58-4ffa9c7ff064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:48.194475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc3776-7c47-4ada-aa58-4ffa9c7ff064 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:48.215389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 272/549] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:48.220944 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75aae7-45ef-4d28-8ef6-15d65ff40358 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:48.310377 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:48.326524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75aae7-45ef-4d28-8ef6-15d65ff40358 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:48.361086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa42a5-720f-4253-b7d1-7e015a659830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:48.361721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa42a5-720f-4253-b7d1-7e015a659830 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:48.362000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa42a5-720f-4253-b7d1-7e015a659830 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:48.362273 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa42a5-720f-4253-b7d1-7e015a659830 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:48.369640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa42a5-720f-4253-b7d1-7e015a659830 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:48.371105 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa42a5-720f-4253-b7d1-7e015a659830 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:48.383712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-b5aa42a5-720f-4253-b7d1-7e015a659830 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 22:38:48.383712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:48.383712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:48.383712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:48.383712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:48.383712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:48.383712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:48.383712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:48.383712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:48.383712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:48.383712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:48.383712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:48.383712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:38:48.383712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:38:48.383712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:38:48.383712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:38:48.384742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:48.384742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:48.384742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:38:48.384742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:48.384742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:38:48.384742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:48.384742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:48.384742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:48.384742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:48.384742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:48.384742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:48.384742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:48.384742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:48.384742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:48.384742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:48.384742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:48.384742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:48.384742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:48.385672 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:48.385672 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:48.385672 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:38:48.385672 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:38:48.385672 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:38:48.385672 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:38:48.385672 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:38:48.385672 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:38:48.385672 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 22:38:48.385672 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:48.385672 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 278/550] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:38:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:48.393486 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc3776-7c47-4ada-aa58-4ffa9c7ff064 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:48.472963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa42a5-720f-4253-b7d1-7e015a659830 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:48.583063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc3776-7c47-4ada-aa58-4ffa9c7ff064 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:48.650523 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90da25e-8d1b-4a30-8faa-25d5ab3a4616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:48.651143 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90da25e-8d1b-4a30-8faa-25d5ab3a4616 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:48.651418 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90da25e-8d1b-4a30-8faa-25d5ab3a4616 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:48.651686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90da25e-8d1b-4a30-8faa-25d5ab3a4616 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:48.652157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa42a5-720f-4253-b7d1-7e015a659830 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:48.652409 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90da25e-8d1b-4a30-8faa-25d5ab3a4616 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:48.652736 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90da25e-8d1b-4a30-8faa-25d5ab3a4616 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:48.654167 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90da25e-8d1b-4a30-8faa-25d5ab3a4616 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:48.671203 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:48.688795 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 273/551] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Sep 6 22:38:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:48.700238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad08f69-4139-47c4-9f3a-18299c695b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:48.700238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad08f69-4139-47c4-9f3a-18299c695b4e None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:48.700238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad08f69-4139-47c4-9f3a-18299c695b4e None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:48.700238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad08f69-4139-47c4-9f3a-18299c695b4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:48.702009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90da25e-8d1b-4a30-8faa-25d5ab3a4616 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:48.712206 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad08f69-4139-47c4-9f3a-18299c695b4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:48.718261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-aad08f69-4139-47c4-9f3a-18299c695b4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:48.718261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:48.718261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:48.718261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:48.718261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:48.718261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:48.718261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:48.718261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:48.718261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:48.718261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:48.718261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:48.718261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:48.718261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:48.718261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:48.718261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:48.718261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:48.719321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:48.719321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:48.719321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:48.719321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:48.719321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:48.719321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:48.719321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:48.719321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:48.719321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:48.719321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:48.719321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:48.719321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:48.719321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:48.719321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:48.719321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:48.719321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:48.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:48.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:48.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:48.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:48.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:48.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:48.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:48.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:48.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:48.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:48.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:48.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:48.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 279/552] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:38:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:38:48.729008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad08f69-4139-47c4-9f3a-18299c695b4e None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:48.733232 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:48.884480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad08f69-4139-47c4-9f3a-18299c695b4e None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:48.911995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90da25e-8d1b-4a30-8faa-25d5ab3a4616 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:48.927780 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aa8cd-eb9b-4fcf-875f-c1a25256c059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:48.930315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aa8cd-eb9b-4fcf-875f-c1a25256c059 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:48.930754 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aa8cd-eb9b-4fcf-875f-c1a25256c059 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:48.931200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aa8cd-eb9b-4fcf-875f-c1a25256c059 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:48.932016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aa8cd-eb9b-4fcf-875f-c1a25256c059 None admin] RBAC: Adding query filter params (name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:48.932484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aa8cd-eb9b-4fcf-875f-c1a25256c059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:48.935389 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aa8cd-eb9b-4fcf-875f-c1a25256c059 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:48.950176 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 280/553] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:38:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:48.961407 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aa8cd-eb9b-4fcf-875f-c1a25256c059 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:48.969493 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f014d13-6399-4c86-8a2a-87b81a61ad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:48.970654 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f014d13-6399-4c86-8a2a-87b81a61ad26 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:48.971172 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f014d13-6399-4c86-8a2a-87b81a61ad26 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:48.972323 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f014d13-6399-4c86-8a2a-87b81a61ad26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:49.044758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:49.052376 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f014d13-6399-4c86-8a2a-87b81a61ad26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:49.054241 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f014d13-6399-4c86-8a2a-87b81a61ad26 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:49.100826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:49.131429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aa8cd-eb9b-4fcf-875f-c1a25256c059 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:49.179807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 274/554] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:49.179807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713673c4-10cf-49ed-89e0-d56e142d664b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:49.179807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713673c4-10cf-49ed-89e0-d56e142d664b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:49.179807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713673c4-10cf-49ed-89e0-d56e142d664b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:49.180672 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 275/555] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:49.185837 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713673c4-10cf-49ed-89e0-d56e142d664b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:49.188489 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c79e6d-7bc3-4d90-8e6b-dbf385d3596d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:49.189131 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c79e6d-7bc3-4d90-8e6b-dbf385d3596d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:49.189408 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c79e6d-7bc3-4d90-8e6b-dbf385d3596d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:49.189729 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c79e6d-7bc3-4d90-8e6b-dbf385d3596d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:49.204868 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c79e6d-7bc3-4d90-8e6b-dbf385d3596d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:49.207452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c79e6d-7bc3-4d90-8e6b-dbf385d3596d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:49.227980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-52c79e6d-7bc3-4d90-8e6b-dbf385d3596d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:49.227980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:49.227980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:49.227980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:49.227980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:49.227980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:49.227980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:49.227980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:49.227980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:49.227980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:49.227980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:49.227980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:49.227980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:49.227980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:49.227980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:49.227980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:49.230597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:49.230597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:49.230597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:49.230597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:49.230597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:49.230597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:49.230597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:49.230597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:49.230597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:49.230597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:49.230597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:49.230597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:49.230597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:49.230597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:49.230597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:49.230597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:49.230597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:49.231533 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:49.231533 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:49.231533 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:49.233909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 281/556] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:49.235244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982fa47-9ba1-4f18-8e60-ce5febee41df None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:49.235532 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982fa47-9ba1-4f18-8e60-ce5febee41df None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:49.235809 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982fa47-9ba1-4f18-8e60-ce5febee41df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:49.259981 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-c982fa47-9ba1-4f18-8e60-ce5febee41df None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:49.261204 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c982fa47-9ba1-4f18-8e60-ce5febee41df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:49.315051 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:49.322994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713673c4-10cf-49ed-89e0-d56e142d664b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:49.359999 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 282/557] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:49.360679 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982fa47-9ba1-4f18-8e60-ce5febee41df None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:49.377020 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180ef4a-e4e2-443f-af8b-ad1a8242048a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:49.378009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180ef4a-e4e2-443f-af8b-ad1a8242048a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:49.378510 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180ef4a-e4e2-443f-af8b-ad1a8242048a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:49.378996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180ef4a-e4e2-443f-af8b-ad1a8242048a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:49.403356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180ef4a-e4e2-443f-af8b-ad1a8242048a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:49.407745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180ef4a-e4e2-443f-af8b-ad1a8242048a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:49.429845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-6180ef4a-e4e2-443f-af8b-ad1a8242048a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:49.429845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:49.429845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:49.429845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:49.429845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:49.429845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:49.429845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:49.429845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:49.429845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:49.429845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:49.429845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:49.429845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:49.429845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:49.429845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:49.429845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:49.429845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:49.431297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:49.431297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:49.431297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:49.431297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:49.431297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:49.431297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:49.431297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:49.431297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:49.431297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:49.431297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:49.431297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:49.431297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:49.431297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:49.431297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:49.431297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:49.431297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:49.431297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:49.432208 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:49.432208 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:49.432208 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:49.438978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 276/558] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:49.442101 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180ef4a-e4e2-443f-af8b-ad1a8242048a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:49.471695 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:49.543840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982fa47-9ba1-4f18-8e60-ce5febee41df None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:49.583805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089ef6e-37ac-485d-8d55-4987260aebc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:49.584975 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089ef6e-37ac-485d-8d55-4987260aebc6 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:49.585483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089ef6e-37ac-485d-8d55-4987260aebc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:49.585959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089ef6e-37ac-485d-8d55-4987260aebc6 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:49.587043 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089ef6e-37ac-485d-8d55-4987260aebc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:49.587603 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089ef6e-37ac-485d-8d55-4987260aebc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:49.589242 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089ef6e-37ac-485d-8d55-4987260aebc6 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:49.606348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 283/559] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:49.608123 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089ef6e-37ac-485d-8d55-4987260aebc6 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:49.635170 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180ef4a-e4e2-443f-af8b-ad1a8242048a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:49.669885 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccc63f-7e8d-4cd6-bf39-46e37c3396b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:49.670492 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccc63f-7e8d-4cd6-bf39-46e37c3396b7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:49.670880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccc63f-7e8d-4cd6-bf39-46e37c3396b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:49.671160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccc63f-7e8d-4cd6-bf39-46e37c3396b7 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:49.671903 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccc63f-7e8d-4cd6-bf39-46e37c3396b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:49.672206 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccc63f-7e8d-4cd6-bf39-46e37c3396b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:49.673708 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccc63f-7e8d-4cd6-bf39-46e37c3396b7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:49.687633 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 277/560] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:49.688981 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe996c-b40a-462d-a101-0280f525d618 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:49.689357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe996c-b40a-462d-a101-0280f525d618 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:49.689632 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe996c-b40a-462d-a101-0280f525d618 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:49.691097 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 278/561] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:49.694594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe996c-b40a-462d-a101-0280f525d618 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:49.723446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:49.736818 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089ef6e-37ac-485d-8d55-4987260aebc6 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:49.746009 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:49.773437 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140a7f1-0f95-4059-b612-7de6848b6eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:49.774057 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140a7f1-0f95-4059-b612-7de6848b6eda None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:49.774343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140a7f1-0f95-4059-b612-7de6848b6eda None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:49.774614 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140a7f1-0f95-4059-b612-7de6848b6eda None admin] PATH_INFO: `/v3/users/nova` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:49.782278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140a7f1-0f95-4059-b612-7de6848b6eda None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:49.783788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140a7f1-0f95-4059-b612-7de6848b6eda None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:49.795316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-f140a7f1-0f95-4059-b612-7de6848b6eda None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 22:38:49.795316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:49.795316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:49.795316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:49.795316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:49.795316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:49.795316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:49.795316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:49.795316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:49.795316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:49.795316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:49.795316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:49.795316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:38:49.795316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:38:49.795316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:38:49.795316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:38:49.796480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:49.796480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:49.796480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:38:49.796480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:49.796480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:38:49.796480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:49.796480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:49.796480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:49.796480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:49.796480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:49.796480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:49.796480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:49.796480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:49.796480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:49.796480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:49.796480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:49.796480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:49.796480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:49.797455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:49.797455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:49.797455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:38:49.797455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:38:49.797455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:38:49.797455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:38:49.797455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:38:49.797455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:38:49.797455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 22:38:49.797455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:49.797455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 284/562] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Sep 6 22:38:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:38:49.798132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188f05d-1b68-43ab-8e1a-bc20b1a8031b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:49.798132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188f05d-1b68-43ab-8e1a-bc20b1a8031b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:49.798254 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188f05d-1b68-43ab-8e1a-bc20b1a8031b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:49.812573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe996c-b40a-462d-a101-0280f525d618 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:49.820173 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-e188f05d-1b68-43ab-8e1a-bc20b1a8031b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:49.821455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e188f05d-1b68-43ab-8e1a-bc20b1a8031b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:49.852040 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b02fc-5a3b-4fc6-a0fb-bed6efb00b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:49.852632 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b02fc-5a3b-4fc6-a0fb-bed6efb00b14 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:49.852897 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b02fc-5a3b-4fc6-a0fb-bed6efb00b14 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:49.853164 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b02fc-5a3b-4fc6-a0fb-bed6efb00b14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:49.861447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b02fc-5a3b-4fc6-a0fb-bed6efb00b14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:49.863835 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b02fc-5a3b-4fc6-a0fb-bed6efb00b14 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:49.877017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-1c9b02fc-5a3b-4fc6-a0fb-bed6efb00b14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:49.877017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:49.877017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:49.877017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:49.877017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:49.877017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:49.877017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:49.877017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:49.877017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:49.877017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:49.877017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:49.877017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:49.877017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:38:49.877017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:38:49.877017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:38:49.877919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:38:49.877919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:49.877919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:49.877919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:49.877919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:49.877919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:49.877919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:49.877919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:49.877919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:49.877919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:49.877919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:49.877919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:49.877919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:49.877919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:49.877919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:49.877919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:49.877919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:49.878813 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:38:49.878813 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:38:49.878813 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:38:49.878813 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:38:49.878813 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:38:49.878813 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:38:49.878813 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:49.878813 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:49.882937 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 279/563] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:49.883721 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b02fc-5a3b-4fc6-a0fb-bed6efb00b14 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:49.897393 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 285/564] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:49.905324 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188f05d-1b68-43ab-8e1a-bc20b1a8031b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:49.954626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:49.989605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b02fc-5a3b-4fc6-a0fb-bed6efb00b14 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:50.019101 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:50.022984 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188f05d-1b68-43ab-8e1a-bc20b1a8031b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:50.024717 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965cb95-e021-431f-b00d-84c47cb06d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:50.025397 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965cb95-e021-431f-b00d-84c47cb06d9b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:50.025664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965cb95-e021-431f-b00d-84c47cb06d9b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:50.025943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965cb95-e021-431f-b00d-84c47cb06d9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:50.036473 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965cb95-e021-431f-b00d-84c47cb06d9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:50.041735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-f965cb95-e021-431f-b00d-84c47cb06d9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:50.041735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:50.041735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:50.041735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:50.041735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:50.041735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:50.041735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:50.041735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:50.041735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:50.041735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:50.041735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:50.041735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:50.041735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:50.041735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:50.041735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:50.041735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:50.042669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:50.042669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:50.042669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:50.042669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:50.042669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:50.042669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:50.042669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:50.042669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:50.042669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:50.042669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:50.042669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:50.042669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:50.042669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:50.042669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:50.042669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:50.042669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:50.043506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:50.043506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:50.043506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:50.043506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:50.043506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:50.043506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:50.043506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:50.043506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:50.043506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:50.043506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:50.043506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:50.043506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:50.043506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 280/565] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:38:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:50.044195 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965cb95-e021-431f-b00d-84c47cb06d9b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:50.064087 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a28b4-1760-42eb-bc8b-152e38495033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:50.064733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a28b4-1760-42eb-bc8b-152e38495033 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:50.065012 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a28b4-1760-42eb-bc8b-152e38495033 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:50.065281 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a28b4-1760-42eb-bc8b-152e38495033 None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:50.066018 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a28b4-1760-42eb-bc8b-152e38495033 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:50.066321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a28b4-1760-42eb-bc8b-152e38495033 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:50.067764 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a28b4-1760-42eb-bc8b-152e38495033 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:50.085649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 286/566] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Sep 6 22:38:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:50.085649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e51406-5def-4ea5-9593-b81c8f3bd4c5 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:50.085649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e51406-5def-4ea5-9593-b81c8f3bd4c5 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:50.085649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e51406-5def-4ea5-9593-b81c8f3bd4c5 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:50.085649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 287/567] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:50.085649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e51406-5def-4ea5-9593-b81c8f3bd4c5 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:50.159152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965cb95-e021-431f-b00d-84c47cb06d9b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:50.186494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:50.194393 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9349ed-c6a5-4b5e-af07-4b944a1b782e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:50.195404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9349ed-c6a5-4b5e-af07-4b944a1b782e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:50.195689 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9349ed-c6a5-4b5e-af07-4b944a1b782e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:50.195958 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9349ed-c6a5-4b5e-af07-4b944a1b782e None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:50.202566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9349ed-c6a5-4b5e-af07-4b944a1b782e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:50.202566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9349ed-c6a5-4b5e-af07-4b944a1b782e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:50.202566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9349ed-c6a5-4b5e-af07-4b944a1b782e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:50.207564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e51406-5def-4ea5-9593-b81c8f3bd4c5 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:50.210494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 281/568] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:38:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:50.211328 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9349ed-c6a5-4b5e-af07-4b944a1b782e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:50.242275 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6427daa-3a05-4075-b0bf-ddcefb577ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:50.242885 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6427daa-3a05-4075-b0bf-ddcefb577ebe None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:50.243163 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6427daa-3a05-4075-b0bf-ddcefb577ebe None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:50.243433 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6427daa-3a05-4075-b0bf-ddcefb577ebe None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:50.244087 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6427daa-3a05-4075-b0bf-ddcefb577ebe None admin] RBAC: Adding query filter params (name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:50.244390 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6427daa-3a05-4075-b0bf-ddcefb577ebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:50.245773 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6427daa-3a05-4075-b0bf-ddcefb577ebe None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:50.253570 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 288/569] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:38:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:50.254842 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4370ac8-329c-4f6e-87ff-65b9fcf9c3b0 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:50.255136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4370ac8-329c-4f6e-87ff-65b9fcf9c3b0 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:50.255410 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4370ac8-329c-4f6e-87ff-65b9fcf9c3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:50.272696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-c4370ac8-329c-4f6e-87ff-65b9fcf9c3b0 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:50.273883 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c4370ac8-329c-4f6e-87ff-65b9fcf9c3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:50.287404 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:50.312997 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9349ed-c6a5-4b5e-af07-4b944a1b782e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:50.339998 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 289/570] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:50.340911 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4370ac8-329c-4f6e-87ff-65b9fcf9c3b0 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:50.347374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1157a-d87c-42b2-b869-d90f5d8c4953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:50.348003 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1157a-d87c-42b2-b869-d90f5d8c4953 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:50.348282 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1157a-d87c-42b2-b869-d90f5d8c4953 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:50.348589 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1157a-d87c-42b2-b869-d90f5d8c4953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:50.359107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1157a-d87c-42b2-b869-d90f5d8c4953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:50.360607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1157a-d87c-42b2-b869-d90f5d8c4953 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:50.376488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-7df1157a-d87c-42b2-b869-d90f5d8c4953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:50.376488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:50.376488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:50.376488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:50.376488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:50.376488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:50.376488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:50.376488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:50.376488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:50.376488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:50.376488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:50.376488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:50.376488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:50.376488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:50.376488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:50.376488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:50.377635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:50.377635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:50.377635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:50.377635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:50.377635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:50.377635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:50.377635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:50.377635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:50.377635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:50.377635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:50.377635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:50.377635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:50.377635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:50.377635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:50.377635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:50.377635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:50.377635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:50.378717 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:50.378717 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:50.378717 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:50.378717 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 282/571] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:50.378717 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1157a-d87c-42b2-b869-d90f5d8c4953 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:50.422308 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:50.458110 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4370ac8-329c-4f6e-87ff-65b9fcf9c3b0 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:50.480792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1157a-d87c-42b2-b869-d90f5d8c4953 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:50.494874 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829f0c8-20ec-43ee-867a-0b8a8ce58ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:50.495593 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829f0c8-20ec-43ee-867a-0b8a8ce58ae3 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:50.495966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829f0c8-20ec-43ee-867a-0b8a8ce58ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:50.496242 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829f0c8-20ec-43ee-867a-0b8a8ce58ae3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:50.507129 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829f0c8-20ec-43ee-867a-0b8a8ce58ae3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:50.511893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-4829f0c8-20ec-43ee-867a-0b8a8ce58ae3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:50.511893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:50.511893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:50.511893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:50.511893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:50.511893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:50.511893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:50.511893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:50.511893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:50.511893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:50.511893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:50.511893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:50.511893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:50.511893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:50.511893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:50.511893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:50.512840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:50.512840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:50.512840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:50.512840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:50.512840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:50.512840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:50.512840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:50.512840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:50.512840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:50.512840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:50.512840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:50.512840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:50.512840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:50.512840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:50.512840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:50.512840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:50.514238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:50.514238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:50.514238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:50.514238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:50.514238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:50.514238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:50.514238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:50.514238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:50.514238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:50.514238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:50.514238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:50.514238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:50.514238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 290/572] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:38:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:50.515010 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829f0c8-20ec-43ee-867a-0b8a8ce58ae3 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:50.521878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3a254-be25-4990-b4be-f733b79ff395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:50.522497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3a254-be25-4990-b4be-f733b79ff395 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:50.522780 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3a254-be25-4990-b4be-f733b79ff395 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:50.523054 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3a254-be25-4990-b4be-f733b79ff395 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:50.523785 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3a254-be25-4990-b4be-f733b79ff395 None admin] RBAC: Adding query filter params (role.id=85bcc17628d742209f79cc936d4290b5, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=660248a90f524a43b143bae127e0eaa1) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:50.524099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3a254-be25-4990-b4be-f733b79ff395 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:50.525563 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3a254-be25-4990-b4be-f733b79ff395 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:50.526983 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:50.540697 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 283/573] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:38:50 2022] GET /identity/v3/role_assignments?user.id=660248a90f524a43b143bae127e0eaa1&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=85bcc17628d742209f79cc936d4290b5 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:50.540697 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3a254-be25-4990-b4be-f733b79ff395 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:50.644720 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829f0c8-20ec-43ee-867a-0b8a8ce58ae3 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:50.659366 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3a254-be25-4990-b4be-f733b79ff395 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:50.663059 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:50.690511 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c661bf8-f67b-4ef5-b1dc-a3ad52271d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:50.690511 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c661bf8-f67b-4ef5-b1dc-a3ad52271d6c None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:50.690511 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c661bf8-f67b-4ef5-b1dc-a3ad52271d6c None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:50.690511 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c661bf8-f67b-4ef5-b1dc-a3ad52271d6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:50.698340 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef1621-9062-40e7-abfc-91a391f5fa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:50.698903 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c661bf8-f67b-4ef5-b1dc-a3ad52271d6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:50.699013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef1621-9062-40e7-abfc-91a391f5fa5a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:50.699235 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef1621-9062-40e7-abfc-91a391f5fa5a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:50.699515 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef1621-9062-40e7-abfc-91a391f5fa5a None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:50.700156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef1621-9062-40e7-abfc-91a391f5fa5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:50.700366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c661bf8-f67b-4ef5-b1dc-a3ad52271d6c None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:50.700567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef1621-9062-40e7-abfc-91a391f5fa5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:50.702435 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef1621-9062-40e7-abfc-91a391f5fa5a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:50.716643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 284/574] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:50.719402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-0c661bf8-f67b-4ef5-b1dc-a3ad52271d6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:50.719402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:50.719402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:50.719402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:50.719402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:50.719402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:50.719402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:50.719402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:50.719402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:50.719402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:50.719402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:50.719402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:50.719402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:50.719402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:50.719402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:50.719402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:50.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:50.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:50.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:50.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:50.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:50.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:50.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:50.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:50.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:50.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:50.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:50.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:50.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:50.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:50.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:50.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:50.720337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:50.722534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:50.722534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:50.722534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:50.722708 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef1621-9062-40e7-abfc-91a391f5fa5a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:50.724573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 291/575] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:50.725440 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c661bf8-f67b-4ef5-b1dc-a3ad52271d6c None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:50.787667 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:50.831232 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef1621-9062-40e7-abfc-91a391f5fa5a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:50.831879 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c661bf8-f67b-4ef5-b1dc-a3ad52271d6c None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:50.867234 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062b8cd-93da-4caf-9502-ad5d7f0e59c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:50.867850 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062b8cd-93da-4caf-9502-ad5d7f0e59c4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:50.868167 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062b8cd-93da-4caf-9502-ad5d7f0e59c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:50.868409 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062b8cd-93da-4caf-9502-ad5d7f0e59c4 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:50.869108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062b8cd-93da-4caf-9502-ad5d7f0e59c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:50.869284 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f58bb-8458-49b4-8b99-5f362f11b75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:50.869402 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062b8cd-93da-4caf-9502-ad5d7f0e59c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:50.870206 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f58bb-8458-49b4-8b99-5f362f11b75c None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:50.870628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f58bb-8458-49b4-8b99-5f362f11b75c None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:50.870889 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062b8cd-93da-4caf-9502-ad5d7f0e59c4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:50.871228 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f58bb-8458-49b4-8b99-5f362f11b75c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:50.878940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 285/576] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:38:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:50.879742 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062b8cd-93da-4caf-9502-ad5d7f0e59c4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:50.886875 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f58bb-8458-49b4-8b99-5f362f11b75c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:50.893303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-8e4f58bb-8458-49b4-8b99-5f362f11b75c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:50.893303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:50.893303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:50.893303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:50.893303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:50.893303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:50.893303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:50.893303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:50.893303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:50.893303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:50.893303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:50.893303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:50.893303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:50.893303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:50.893303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:50.893303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:50.894402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:50.894402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:50.894402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:50.894402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:50.894402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:50.894402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:50.894402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:50.894402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:50.894402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:50.894402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:50.894402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:50.894402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:50.894402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:50.894402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:50.894402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:50.894402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:50.895415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:50.895415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:50.895415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:50.895415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:50.895415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:50.895415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:50.895415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:50.895415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:50.895415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:50.895415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:50.895415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:50.895415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:50.897785 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 292/577] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:38:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:50.898870 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f58bb-8458-49b4-8b99-5f362f11b75c None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:50.914828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:50.993113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062b8cd-93da-4caf-9502-ad5d7f0e59c4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:51.003435 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f58bb-8458-49b4-8b99-5f362f11b75c None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:51.025474 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:51.030030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe5116-d19c-499b-b566-00df083f0afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:51.030660 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe5116-d19c-499b-b566-00df083f0afe None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:51.030942 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe5116-d19c-499b-b566-00df083f0afe None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:51.031216 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe5116-d19c-499b-b566-00df083f0afe None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:51.038107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe5116-d19c-499b-b566-00df083f0afe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:51.044699 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe5116-d19c-499b-b566-00df083f0afe None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:51.044819 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0ace4-1fb5-497f-ac14-cf75666d9539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:51.044819 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0ace4-1fb5-497f-ac14-cf75666d9539 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:51.044819 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0ace4-1fb5-497f-ac14-cf75666d9539 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:51.044819 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0ace4-1fb5-497f-ac14-cf75666d9539 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:51.045164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0ace4-1fb5-497f-ac14-cf75666d9539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:51.045164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0ace4-1fb5-497f-ac14-cf75666d9539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:51.045164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0ace4-1fb5-497f-ac14-cf75666d9539 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:51.051057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-7abe5116-d19c-499b-b566-00df083f0afe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:51.051057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:51.051057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:51.051057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:51.051057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:51.051057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:51.051057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:51.051057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:51.051057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:51.051057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:51.051057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:51.051057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:51.051057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:38:51.051057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:38:51.051057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:38:51.051993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:38:51.051993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:51.051993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:51.051993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:51.051993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:51.051993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:51.051993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:51.051993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:51.051993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:51.051993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:51.051993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:51.051993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:51.051993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:51.051993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:51.051993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:51.051993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:51.051993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:51.052978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:38:51.052978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:38:51.052978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:38:51.052978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:38:51.052978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:38:51.052978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:38:51.052978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:51.052978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:51.056577 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 286/578] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:51.057164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 293/579] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:51.057473 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe5116-d19c-499b-b566-00df083f0afe None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:51.058469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0ace4-1fb5-497f-ac14-cf75666d9539 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:51.162621 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:51.174947 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0ace4-1fb5-497f-ac14-cf75666d9539 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:51.177980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe5116-d19c-499b-b566-00df083f0afe None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:51.211421 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc848e0f-b46b-4e6b-ab8a-8162880687f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:51.212064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc848e0f-b46b-4e6b-ab8a-8162880687f0 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:51.212346 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc848e0f-b46b-4e6b-ab8a-8162880687f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:51.212651 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc848e0f-b46b-4e6b-ab8a-8162880687f0 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:51.213321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc848e0f-b46b-4e6b-ab8a-8162880687f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:51.213623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc848e0f-b46b-4e6b-ab8a-8162880687f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:51.214974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc848e0f-b46b-4e6b-ab8a-8162880687f0 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:51.215090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635ab40-6164-4588-8e6f-034dda891a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:51.215626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635ab40-6164-4588-8e6f-034dda891a51 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:51.215905 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635ab40-6164-4588-8e6f-034dda891a51 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:51.216185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635ab40-6164-4588-8e6f-034dda891a51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:51.223352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 294/580] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:38:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:51.224153 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc848e0f-b46b-4e6b-ab8a-8162880687f0 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:51.231921 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635ab40-6164-4588-8e6f-034dda891a51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:51.233472 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635ab40-6164-4588-8e6f-034dda891a51 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:51.249540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-e635ab40-6164-4588-8e6f-034dda891a51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:51.249540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:51.249540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:51.249540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:51.249540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:51.249540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:51.249540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:51.249540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:51.249540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:51.249540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:51.249540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:51.249540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:51.249540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:51.249540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:51.249540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:51.249540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:51.250606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:51.250606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:51.250606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:51.250606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:51.250606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:51.250606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:51.250606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:51.250606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:51.250606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:51.250606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:51.250606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:51.250606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:51.250606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:51.250606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:51.250606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:51.250606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:51.250606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:51.251497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:51.251497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:51.251497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:51.251497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 287/581] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:51.251497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635ab40-6164-4588-8e6f-034dda891a51 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:51.275735 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:51.335126 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc848e0f-b46b-4e6b-ab8a-8162880687f0 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:51.367169 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635ab40-6164-4588-8e6f-034dda891a51 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:51.369777 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5c1f2-1ea2-4c36-85bc-70952f56cc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:51.370395 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5c1f2-1ea2-4c36-85bc-70952f56cc46 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:51.370675 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5c1f2-1ea2-4c36-85bc-70952f56cc46 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:51.370947 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5c1f2-1ea2-4c36-85bc-70952f56cc46 None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:51.371630 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5c1f2-1ea2-4c36-85bc-70952f56cc46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:51.371932 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5c1f2-1ea2-4c36-85bc-70952f56cc46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:51.373947 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5c1f2-1ea2-4c36-85bc-70952f56cc46 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:51.387196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 295/582] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:38:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:51.388019 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5c1f2-1ea2-4c36-85bc-70952f56cc46 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:51.406290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4fe3e-a77d-43f4-9890-7a0bc4f61585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:51.407300 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4fe3e-a77d-43f4-9890-7a0bc4f61585 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:51.407828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4fe3e-a77d-43f4-9890-7a0bc4f61585 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:51.408407 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4fe3e-a77d-43f4-9890-7a0bc4f61585 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:51.422402 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4fe3e-a77d-43f4-9890-7a0bc4f61585 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:51.424306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4fe3e-a77d-43f4-9890-7a0bc4f61585 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:51.426479 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:51.437949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-e6e4fe3e-a77d-43f4-9890-7a0bc4f61585 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 22:38:51.437949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:51.437949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:51.437949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:51.437949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:51.437949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:51.437949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:51.437949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:51.437949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:51.437949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:51.437949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:51.437949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:51.437949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:38:51.437949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:38:51.437949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:38:51.437949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:38:51.445683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:51.445683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:51.445683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:38:51.445683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:51.445683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:38:51.445683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:51.445683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:51.445683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:51.445683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:51.445683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:51.445683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:51.445683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:51.445683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:51.445683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:51.445683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:51.445683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:51.445683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:51.445683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:51.446658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:51.446658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:51.446658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:38:51.446658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:38:51.446658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:38:51.446658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:38:51.446658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:38:51.446658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:38:51.446658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 22:38:51.446658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:51.446658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 288/583] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:51.446658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4fe3e-a77d-43f4-9890-7a0bc4f61585 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:51.510562 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5c1f2-1ea2-4c36-85bc-70952f56cc46 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:51.512009 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:51.550594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4fe3e-a77d-43f4-9890-7a0bc4f61585 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:51.556042 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51452777-ec05-49f3-be4d-d3651ef19406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:51.556927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51452777-ec05-49f3-be4d-d3651ef19406 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:51.557406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51452777-ec05-49f3-be4d-d3651ef19406 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:51.557853 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51452777-ec05-49f3-be4d-d3651ef19406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:51.571962 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51452777-ec05-49f3-be4d-d3651ef19406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:51.573554 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51452777-ec05-49f3-be4d-d3651ef19406 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:51.588573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3553c-e5fe-413f-b828-0beb01e150e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:51.589187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3553c-e5fe-413f-b828-0beb01e150e1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:51.589467 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3553c-e5fe-413f-b828-0beb01e150e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:51.589749 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3553c-e5fe-413f-b828-0beb01e150e1 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:51.590486 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3553c-e5fe-413f-b828-0beb01e150e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:51.590587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-51452777-ec05-49f3-be4d-d3651ef19406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:51.590587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:51.590587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:51.590587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:51.590587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:51.590587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:51.590587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:51.590587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:51.590587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:51.590587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:51.590587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:51.590587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:51.590587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:51.590587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:51.590587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:51.590587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:51.591519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:51.591519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:51.591519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:51.591519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:51.591519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:51.591519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:51.591519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:51.591519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:51.591519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:51.591519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:51.591519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:51.591519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:51.591519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:51.591519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:51.591519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:51.591519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:51.591519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:51.597450 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:51.597450 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:51.597450 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:51.597624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3553c-e5fe-413f-b828-0beb01e150e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:51.597705 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 296/584] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:51.597776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3553c-e5fe-413f-b828-0beb01e150e1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:51.597852 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51452777-ec05-49f3-be4d-d3651ef19406 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:51.609326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 289/585] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:51.610156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3553c-e5fe-413f-b828-0beb01e150e1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:51.672142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:51.702751 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51452777-ec05-49f3-be4d-d3651ef19406 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:51.714109 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3553c-e5fe-413f-b828-0beb01e150e1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:51.737978 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aec21-2d2c-43f1-a88e-ebf743cf4ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:51.738646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aec21-2d2c-43f1-a88e-ebf743cf4ad8 None admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:51.738929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aec21-2d2c-43f1-a88e-ebf743cf4ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:51.739202 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aec21-2d2c-43f1-a88e-ebf743cf4ad8 None admin] PATH_INFO: `/v3/projects/f5e78b142d654280b161a34cec0186cd/users/b18fd296138349408613004929144e70/roles/85bcc17628d742209f79cc936d4290b5` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:51.750505 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471e7d6-014c-4f4a-9a49-1a0c28e607f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:51.751113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471e7d6-014c-4f4a-9a49-1a0c28e607f8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:51.751409 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471e7d6-014c-4f4a-9a49-1a0c28e607f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:51.751654 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471e7d6-014c-4f4a-9a49-1a0c28e607f8 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:51.752376 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471e7d6-014c-4f4a-9a49-1a0c28e607f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:51.752703 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471e7d6-014c-4f4a-9a49-1a0c28e607f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:51.754076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3aec21-2d2c-43f1-a88e-ebf743cf4ad8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5e78b142d654280b161a34cec0186cd, user_id=b18fd296138349408613004929144e70, role_id=85bcc17628d742209f79cc936d4290b5)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:51.754184 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471e7d6-014c-4f4a-9a49-1a0c28e607f8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:51.755504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3aec21-2d2c-43f1-a88e-ebf743cf4ad8 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:51.771611 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 290/586] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Sep 6 22:38:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:51.772271 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471e7d6-014c-4f4a-9a49-1a0c28e607f8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:51.816717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 297/587] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:38:51 2022] PUT /identity/v3/projects/f5e78b142d654280b161a34cec0186cd/users/b18fd296138349408613004929144e70/roles/85bcc17628d742209f79cc936d4290b5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:38:51.817532 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aec21-2d2c-43f1-a88e-ebf743cf4ad8 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:51.821164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:51.892010 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471e7d6-014c-4f4a-9a49-1a0c28e607f8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:51.915168 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:51.932693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aec21-2d2c-43f1-a88e-ebf743cf4ad8 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:51.938587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b509574-b428-4260-a5cc-df891505504f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:51.939557 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b509574-b428-4260-a5cc-df891505504f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:51.940002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b509574-b428-4260-a5cc-df891505504f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:51.940552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b509574-b428-4260-a5cc-df891505504f None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:51.941553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b509574-b428-4260-a5cc-df891505504f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:51.942063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b509574-b428-4260-a5cc-df891505504f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:51.943771 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b509574-b428-4260-a5cc-df891505504f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:51.958654 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 291/588] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:51.960178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b509574-b428-4260-a5cc-df891505504f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:51.972293 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3660ef-aa02-4e67-85e4-8717de6b216c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:51.973345 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3660ef-aa02-4e67-85e4-8717de6b216c None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:51.973820 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3660ef-aa02-4e67-85e4-8717de6b216c None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:51.974264 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3660ef-aa02-4e67-85e4-8717de6b216c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:51.984273 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3660ef-aa02-4e67-85e4-8717de6b216c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:51.986590 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3660ef-aa02-4e67-85e4-8717de6b216c None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:51.999238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-bf3660ef-aa02-4e67-85e4-8717de6b216c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 22:38:51.999238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:51.999238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:51.999238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:51.999238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:51.999238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:51.999238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:51.999238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:51.999238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:51.999238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:51.999238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:51.999238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:51.999238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:38:51.999238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:38:51.999238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:38:51.999238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:38:52.000279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:52.000279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:52.000279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:38:52.000279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:52.000279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:38:52.000279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:52.000279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:52.000279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:52.000279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:52.000279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:52.000279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:52.000279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:52.000279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:52.000279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:52.000279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:52.000279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:52.000279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:52.000279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:52.001479 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:52.001479 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:52.001479 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:38:52.001479 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:38:52.001479 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:38:52.001479 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:38:52.001479 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:38:52.001479 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:38:52.001479 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 22:38:52.001479 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:52.004550 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 298/589] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:52.005599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3660ef-aa02-4e67-85e4-8717de6b216c None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:52.089529 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:52.102018 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b509574-b428-4260-a5cc-df891505504f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:52.136306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3660ef-aa02-4e67-85e4-8717de6b216c None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:52.158374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865d17b-169d-4ec6-b0da-acb776e4a883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:52.159733 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865d17b-169d-4ec6-b0da-acb776e4a883 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:52.160276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865d17b-169d-4ec6-b0da-acb776e4a883 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:52.160983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865d17b-169d-4ec6-b0da-acb776e4a883 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:52.172633 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b18c82-ec50-4eb5-bfc5-6a638c1849bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:52.173272 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b18c82-ec50-4eb5-bfc5-6a638c1849bb None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:52.173553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b18c82-ec50-4eb5-bfc5-6a638c1849bb None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:52.173825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b18c82-ec50-4eb5-bfc5-6a638c1849bb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:52.177472 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865d17b-169d-4ec6-b0da-acb776e4a883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:52.179165 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865d17b-169d-4ec6-b0da-acb776e4a883 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:52.182036 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b18c82-ec50-4eb5-bfc5-6a638c1849bb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:52.183455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b18c82-ec50-4eb5-bfc5-6a638c1849bb None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:52.195718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-87b18c82-ec50-4eb5-bfc5-6a638c1849bb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 22:38:52.195718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:52.195718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:52.195718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:52.195718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:52.195718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:52.195718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:52.195718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:52.195718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:52.195718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:52.195718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:52.195718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:52.195718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:38:52.195718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:38:52.195718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:38:52.195718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:38:52.196734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:52.196734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:52.196734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:38:52.196734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:52.196734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:38:52.196734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:52.196734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:52.196734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:52.196734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:52.196734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:52.196734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:52.196734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:52.196734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:52.196734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:52.196734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:52.196734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:52.196734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:52.196734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:52.197701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:52.197701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:52.197701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:38:52.197701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:38:52.197701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:38:52.197701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:38:52.197701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:38:52.197701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:38:52.197701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 22:38:52.197701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:52.197701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 299/590] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:38:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:52.200275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-5865d17b-169d-4ec6-b0da-acb776e4a883 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:52.200275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:52.200275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:52.200275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:52.200275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:52.200275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:52.200275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:52.200275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:52.200275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:52.200275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:52.200275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:52.200275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:52.200275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:52.200275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:52.200275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:52.200275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:52.201814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:52.201814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:52.201814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:52.201814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:52.201814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:52.201814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:52.201814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:52.201814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:52.201814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:52.201814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:52.201814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:52.201814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:52.201814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:52.201814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:52.201814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:52.201814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:52.201814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:52.202709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:52.202709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:52.202709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:52.203303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b18c82-ec50-4eb5-bfc5-6a638c1849bb None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:52.204837 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 292/591] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:52.206456 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865d17b-169d-4ec6-b0da-acb776e4a883 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:52.244608 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:52.328607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865d17b-169d-4ec6-b0da-acb776e4a883 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:52.336920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b18c82-ec50-4eb5-bfc5-6a638c1849bb None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:52.370213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:52.371628 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670830b8-b9ee-4749-9343-c725d4b9a41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:52.372978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670830b8-b9ee-4749-9343-c725d4b9a41b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:52.373717 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670830b8-b9ee-4749-9343-c725d4b9a41b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:52.374610 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670830b8-b9ee-4749-9343-c725d4b9a41b None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:52.375722 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670830b8-b9ee-4749-9343-c725d4b9a41b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:52.376533 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670830b8-b9ee-4749-9343-c725d4b9a41b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:52.378511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670830b8-b9ee-4749-9343-c725d4b9a41b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:52.380798 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d778709-a947-4b51-9a54-5d9d1fb9f0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:52.381410 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d778709-a947-4b51-9a54-5d9d1fb9f0b5 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:52.381686 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d778709-a947-4b51-9a54-5d9d1fb9f0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:52.381956 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d778709-a947-4b51-9a54-5d9d1fb9f0b5 None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:52.385242 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d778709-a947-4b51-9a54-5d9d1fb9f0b5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:52.385242 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d778709-a947-4b51-9a54-5d9d1fb9f0b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:52.385242 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d778709-a947-4b51-9a54-5d9d1fb9f0b5 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:52.403459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 293/592] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Sep 6 22:38:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:52.403459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670830b8-b9ee-4749-9343-c725d4b9a41b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:52.409310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 300/593] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Sep 6 22:38:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:52.410844 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d778709-a947-4b51-9a54-5d9d1fb9f0b5 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:52.500562 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:52.516717 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670830b8-b9ee-4749-9343-c725d4b9a41b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:52.525130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d778709-a947-4b51-9a54-5d9d1fb9f0b5 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:52.555824 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eba239-3f3d-45c9-8e78-84ddfa6cb488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:52.556666 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eba239-3f3d-45c9-8e78-84ddfa6cb488 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:52.556990 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eba239-3f3d-45c9-8e78-84ddfa6cb488 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:52.557333 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eba239-3f3d-45c9-8e78-84ddfa6cb488 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:52.558135 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eba239-3f3d-45c9-8e78-84ddfa6cb488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:52.558498 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eba239-3f3d-45c9-8e78-84ddfa6cb488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:52.560021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eba239-3f3d-45c9-8e78-84ddfa6cb488 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:52.564043 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24526a-621b-479a-b9ae-a9b893cf85ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:52.564948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24526a-621b-479a-b9ae-a9b893cf85ad None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:52.565429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24526a-621b-479a-b9ae-a9b893cf85ad None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:52.565882 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24526a-621b-479a-b9ae-a9b893cf85ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:52.578666 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 294/594] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:52.578666 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eba239-3f3d-45c9-8e78-84ddfa6cb488 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:52.583851 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24526a-621b-479a-b9ae-a9b893cf85ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:52.586789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24526a-621b-479a-b9ae-a9b893cf85ad None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:52.604452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-5e24526a-621b-479a-b9ae-a9b893cf85ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:52.604452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:52.604452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:52.604452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:52.604452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:52.604452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:52.604452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:52.604452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:52.604452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:52.604452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:52.604452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:52.604452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:52.604452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:52.604452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:52.604452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:52.604452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:52.605469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:52.605469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:52.605469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:52.605469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:52.605469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:52.605469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:52.605469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:52.605469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:52.605469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:52.605469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:52.605469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:52.605469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:52.605469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:52.605469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:52.605469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:52.605469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:52.605469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:52.606365 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:52.606365 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:52.606365 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:52.613259 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 301/595] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:52.614451 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24526a-621b-479a-b9ae-a9b893cf85ad None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:52.652289 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:52.686677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eba239-3f3d-45c9-8e78-84ddfa6cb488 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:52.722805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24526a-621b-479a-b9ae-a9b893cf85ad None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:52.724247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bdd68-e012-4b60-8144-1e38f319c78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:52.724905 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bdd68-e012-4b60-8144-1e38f319c78f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:52.725181 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bdd68-e012-4b60-8144-1e38f319c78f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:52.726118 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bdd68-e012-4b60-8144-1e38f319c78f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:52.736707 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377bdd68-e012-4b60-8144-1e38f319c78f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:52.738712 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377bdd68-e012-4b60-8144-1e38f319c78f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:52.745237 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:52.754945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-377bdd68-e012-4b60-8144-1e38f319c78f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:52.754945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:52.754945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:52.754945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:52.754945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:52.754945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:52.754945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:52.754945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:52.754945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:52.754945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:52.754945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:52.754945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:52.754945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:52.754945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:52.754945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:52.754945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:52.755913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:52.755913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:52.755913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:52.755913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:52.755913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:52.755913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:52.755913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:52.755913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:52.755913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:52.755913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:52.755913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:52.755913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:52.755913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:52.755913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:52.755913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:52.755913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:52.755913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:52.756832 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:52.756832 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:52.756832 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:52.756832 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 295/596] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:52.756832 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bdd68-e012-4b60-8144-1e38f319c78f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:52.766106 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89d440-fbd1-4e7a-b6ad-fccbd2d0d7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:52.766757 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89d440-fbd1-4e7a-b6ad-fccbd2d0d7a8 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:52.767036 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89d440-fbd1-4e7a-b6ad-fccbd2d0d7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:52.767304 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89d440-fbd1-4e7a-b6ad-fccbd2d0d7a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:52.774788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89d440-fbd1-4e7a-b6ad-fccbd2d0d7a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:52.776266 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89d440-fbd1-4e7a-b6ad-fccbd2d0d7a8 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:52.788322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-2b89d440-fbd1-4e7a-b6ad-fccbd2d0d7a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:52.788322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:52.788322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:52.788322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:52.788322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:52.788322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:52.788322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:52.788322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:52.788322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:52.788322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:52.788322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:52.788322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:52.788322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:38:52.788322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:38:52.788322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:38:52.789518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:38:52.789518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:52.789518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:52.789518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:52.789518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:52.789518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:52.789518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:52.789518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:52.789518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:52.789518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:52.789518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:52.789518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:52.789518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:52.789518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:52.789518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:52.789518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:52.789518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:52.790527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:38:52.790527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:38:52.790527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:38:52.790527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:38:52.790527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:38:52.790527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:38:52.790527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:52.790527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:52.790527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 302/597] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:52.791188 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19698056-e9f6-449b-a167-79553d0b860b None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:52.791473 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19698056-e9f6-449b-a167-79553d0b860b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:52.791741 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19698056-e9f6-449b-a167-79553d0b860b None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:52.796558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 303/598] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:52.796558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19698056-e9f6-449b-a167-79553d0b860b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:52.879291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bdd68-e012-4b60-8144-1e38f319c78f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:52.887922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:52.895362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19698056-e9f6-449b-a167-79553d0b860b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:52.916240 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c0c5e-a8b5-4965-9f18-8c93a4c50b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:52.916823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c0c5e-a8b5-4965-9f18-8c93a4c50b56 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:52.917150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c0c5e-a8b5-4965-9f18-8c93a4c50b56 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:52.917423 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c0c5e-a8b5-4965-9f18-8c93a4c50b56 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:52.918061 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c0c5e-a8b5-4965-9f18-8c93a4c50b56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:52.918364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c0c5e-a8b5-4965-9f18-8c93a4c50b56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:52.920392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c0c5e-a8b5-4965-9f18-8c93a4c50b56 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:52.931708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bee17d-115f-4043-87a3-560fb9c38abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:52.932307 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee17d-115f-4043-87a3-560fb9c38abe None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:52.932613 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee17d-115f-4043-87a3-560fb9c38abe None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:52.937761 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee17d-115f-4043-87a3-560fb9c38abe None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:52.937897 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 296/599] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:52.938003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bee17d-115f-4043-87a3-560fb9c38abe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:52.938003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bee17d-115f-4043-87a3-560fb9c38abe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:52.938173 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c0c5e-a8b5-4965-9f18-8c93a4c50b56 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:52.938256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bee17d-115f-4043-87a3-560fb9c38abe None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:52.953765 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 304/600] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:52.953765 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546baf5c-32b6-4187-8de2-5e6d31e8ccfb None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:52.953765 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546baf5c-32b6-4187-8de2-5e6d31e8ccfb None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:52.953765 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546baf5c-32b6-4187-8de2-5e6d31e8ccfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:52.968886 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-546baf5c-32b6-4187-8de2-5e6d31e8ccfb None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:52.970070 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-546baf5c-32b6-4187-8de2-5e6d31e8ccfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:53.002236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:53.037027 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 305/601] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:53.038101 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546baf5c-32b6-4187-8de2-5e6d31e8ccfb None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:53.051859 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c0c5e-a8b5-4965-9f18-8c93a4c50b56 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:53.088325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09917fd-2557-446f-908e-dcedcdfc8f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:53.088964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09917fd-2557-446f-908e-dcedcdfc8f81 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:53.089626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09917fd-2557-446f-908e-dcedcdfc8f81 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:53.089626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09917fd-2557-446f-908e-dcedcdfc8f81 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:53.090177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09917fd-2557-446f-908e-dcedcdfc8f81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:53.090477 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09917fd-2557-446f-908e-dcedcdfc8f81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:53.092056 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09917fd-2557-446f-908e-dcedcdfc8f81 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:53.114170 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 297/602] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:38:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:53.115379 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09917fd-2557-446f-908e-dcedcdfc8f81 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:53.171195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:53.189622 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546baf5c-32b6-4187-8de2-5e6d31e8ccfb None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:53.227597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee771d24-5aff-4537-9fe1-7fc025e8a19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:53.228642 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee771d24-5aff-4537-9fe1-7fc025e8a19f None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:53.229125 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee771d24-5aff-4537-9fe1-7fc025e8a19f None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:53.229594 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee771d24-5aff-4537-9fe1-7fc025e8a19f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:53.234559 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09917fd-2557-446f-908e-dcedcdfc8f81 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:53.236846 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee771d24-5aff-4537-9fe1-7fc025e8a19f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:53.238517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee771d24-5aff-4537-9fe1-7fc025e8a19f None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:53.250732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-ee771d24-5aff-4537-9fe1-7fc025e8a19f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:53.250732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:53.250732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:53.250732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:53.250732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:53.250732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:53.250732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:53.250732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:53.250732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:53.250732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:53.250732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:53.250732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:53.250732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:38:53.250732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:38:53.250732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:38:53.251621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:38:53.251621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:53.251621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:53.251621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:53.251621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:53.251621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:53.251621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:53.251621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:53.251621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:53.251621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:53.251621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:53.251621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:53.251621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:53.251621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:53.251621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:53.251621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:53.251621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:53.252559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:38:53.252559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:38:53.252559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:38:53.252559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:38:53.252559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:38:53.252559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:38:53.252559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:53.252559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:53.253370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:53.259501 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 306/603] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:53.260445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee771d24-5aff-4537-9fe1-7fc025e8a19f None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:53.273250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635c27c-4d70-4cc9-a812-19fc4997bfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:53.274075 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635c27c-4d70-4cc9-a812-19fc4997bfdd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:53.274526 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635c27c-4d70-4cc9-a812-19fc4997bfdd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:53.274951 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635c27c-4d70-4cc9-a812-19fc4997bfdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:53.283234 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635c27c-4d70-4cc9-a812-19fc4997bfdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:53.284914 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635c27c-4d70-4cc9-a812-19fc4997bfdd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:53.296685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-1635c27c-4d70-4cc9-a812-19fc4997bfdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:53.296685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:53.296685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:53.296685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:53.296685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:53.296685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:53.296685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:53.296685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:53.296685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:53.296685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:53.296685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:53.296685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:53.296685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:38:53.296685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:38:53.296685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:38:53.297746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:38:53.297746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:53.297746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:53.297746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:53.297746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:53.297746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:53.297746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:53.297746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:53.297746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:53.297746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:53.297746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:53.297746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:53.297746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:53.297746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:53.297746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:53.297746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:53.297746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:53.298647 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:38:53.298647 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:38:53.298647 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:38:53.298647 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:38:53.298647 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:38:53.298647 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:38:53.298647 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:53.298647 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:53.301329 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 298/604] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:53.302414 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635c27c-4d70-4cc9-a812-19fc4997bfdd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:53.380961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee771d24-5aff-4537-9fe1-7fc025e8a19f None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:53.413874 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635c27c-4d70-4cc9-a812-19fc4997bfdd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:53.418250 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb33c5d-8161-41b3-9c48-dd5b3d7eda66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:53.418910 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb33c5d-8161-41b3-9c48-dd5b3d7eda66 None admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:53.419186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb33c5d-8161-41b3-9c48-dd5b3d7eda66 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:53.419476 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb33c5d-8161-41b3-9c48-dd5b3d7eda66 None admin] PATH_INFO: `/v3/projects/f5e78b142d654280b161a34cec0186cd/users/4a2c1f1668814a5e9e654c6308fa0628/roles/85bcc17628d742209f79cc936d4290b5` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:53.434367 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb33c5d-8161-41b3-9c48-dd5b3d7eda66 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5e78b142d654280b161a34cec0186cd, user_id=4a2c1f1668814a5e9e654c6308fa0628, role_id=85bcc17628d742209f79cc936d4290b5)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:53.436284 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb33c5d-8161-41b3-9c48-dd5b3d7eda66 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:53.438671 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:53.450521 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cdcc6-d697-4486-bfd7-7543ec2e11bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:53.451704 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cdcc6-d697-4486-bfd7-7543ec2e11bc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:53.451968 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cdcc6-d697-4486-bfd7-7543ec2e11bc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:53.452234 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cdcc6-d697-4486-bfd7-7543ec2e11bc None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:53.453053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cdcc6-d697-4486-bfd7-7543ec2e11bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:53.453357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cdcc6-d697-4486-bfd7-7543ec2e11bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:53.454783 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cdcc6-d697-4486-bfd7-7543ec2e11bc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:53.467634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 299/605] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:38:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:53.468446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cdcc6-d697-4486-bfd7-7543ec2e11bc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:53.508367 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:53.517548 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 307/606] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:38:53 2022] PUT /identity/v3/projects/f5e78b142d654280b161a34cec0186cd/users/4a2c1f1668814a5e9e654c6308fa0628/roles/85bcc17628d742209f79cc936d4290b5 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:38:53.518504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb33c5d-8161-41b3-9c48-dd5b3d7eda66 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:53.588987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cdcc6-d697-4486-bfd7-7543ec2e11bc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:53.639703 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150a166-9c98-4a79-a0b5-7472fdadf992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:53.640648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150a166-9c98-4a79-a0b5-7472fdadf992 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:53.641090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150a166-9c98-4a79-a0b5-7472fdadf992 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:53.641650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150a166-9c98-4a79-a0b5-7472fdadf992 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:53.642886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150a166-9c98-4a79-a0b5-7472fdadf992 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:53.643349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150a166-9c98-4a79-a0b5-7472fdadf992 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:53.645438 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150a166-9c98-4a79-a0b5-7472fdadf992 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:53.652326 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb33c5d-8161-41b3-9c48-dd5b3d7eda66 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:53.662293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 300/607] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:38:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:53.663852 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150a166-9c98-4a79-a0b5-7472fdadf992 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:53.693006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f494cf-e425-4830-82a1-2059a1846994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:53.693793 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f494cf-e425-4830-82a1-2059a1846994 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:53.694630 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f494cf-e425-4830-82a1-2059a1846994 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:53.694630 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f494cf-e425-4830-82a1-2059a1846994 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:53.711489 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f494cf-e425-4830-82a1-2059a1846994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:53.717164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-56f494cf-e425-4830-82a1-2059a1846994 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:53.717164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:53.717164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:53.717164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:53.717164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:53.717164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:53.717164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:53.717164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:53.717164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:53.717164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:53.717164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:53.717164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:53.717164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:53.717164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:53.717164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:53.717164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:53.718301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:53.718301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:53.718301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:53.718301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:53.718301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:53.718301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:53.718301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:53.718301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:53.718301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:53.718301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:53.718301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:53.718301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:53.718301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:53.718301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:53.718301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:53.718301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:53.719401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:53.719401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:53.719401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:53.719401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:53.719401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:53.719401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:53.719401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:53.719401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:53.719401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:53.719401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:53.719401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:53.719401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:53.721340 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 308/608] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:38:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:53.722215 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f494cf-e425-4830-82a1-2059a1846994 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:53.789020 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:53.792943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150a166-9c98-4a79-a0b5-7472fdadf992 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:53.795769 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:53.839033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b95667-acc7-4b51-8100-0635781e15c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:53.840054 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b95667-acc7-4b51-8100-0635781e15c0 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:53.840490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b95667-acc7-4b51-8100-0635781e15c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:53.840893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b95667-acc7-4b51-8100-0635781e15c0 None admin] PATH_INFO: `/v3/projects/f5e78b142d654280b161a34cec0186cd/users/314bb14d5fa1414a832efb6d37c0446d/roles/85bcc17628d742209f79cc936d4290b5` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:53.849670 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f494cf-e425-4830-82a1-2059a1846994 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:53.864096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b95667-acc7-4b51-8100-0635781e15c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5e78b142d654280b161a34cec0186cd, user_id=314bb14d5fa1414a832efb6d37c0446d, role_id=85bcc17628d742209f79cc936d4290b5)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:53.866156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b95667-acc7-4b51-8100-0635781e15c0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:53.888436 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14438a31-f916-41c8-aba5-562b64f60567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:53.889316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14438a31-f916-41c8-aba5-562b64f60567 None admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:53.889720 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14438a31-f916-41c8-aba5-562b64f60567 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:53.890086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14438a31-f916-41c8-aba5-562b64f60567 None admin] PATH_INFO: `/v3/projects/f5e78b142d654280b161a34cec0186cd/users/5ef596f83ce54fab8779e4e0f3899abc/roles/85bcc17628d742209f79cc936d4290b5` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:53.906188 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14438a31-f916-41c8-aba5-562b64f60567 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5e78b142d654280b161a34cec0186cd, user_id=5ef596f83ce54fab8779e4e0f3899abc, role_id=85bcc17628d742209f79cc936d4290b5)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:53.907867 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14438a31-f916-41c8-aba5-562b64f60567 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:53.961996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 301/609] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:38:53 2022] PUT /identity/v3/projects/f5e78b142d654280b161a34cec0186cd/users/314bb14d5fa1414a832efb6d37c0446d/roles/85bcc17628d742209f79cc936d4290b5 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:38:53.963075 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b95667-acc7-4b51-8100-0635781e15c0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:53.996197 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 309/610] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:38:53 2022] PUT /identity/v3/projects/f5e78b142d654280b161a34cec0186cd/users/5ef596f83ce54fab8779e4e0f3899abc/roles/85bcc17628d742209f79cc936d4290b5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:38:54.067441 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741760b-76cc-4dbc-9d9b-4cec2384c0af None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:54.067735 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741760b-76cc-4dbc-9d9b-4cec2384c0af None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:54.067997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741760b-76cc-4dbc-9d9b-4cec2384c0af None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:54.069596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 310/611] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:54.075266 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11e54a-a249-47bd-a141-cd8eb14a2175 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:54.075546 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11e54a-a249-47bd-a141-cd8eb14a2175 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:54.075870 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11e54a-a249-47bd-a141-cd8eb14a2175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:54.110178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b95667-acc7-4b51-8100-0635781e15c0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:54.121997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-1a11e54a-a249-47bd-a141-cd8eb14a2175 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:54.122932 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1a11e54a-a249-47bd-a141-cd8eb14a2175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:54.162158 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697edd6-d87f-4458-8c60-f29c025daeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:54.163053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697edd6-d87f-4458-8c60-f29c025daeff None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:54.163503 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697edd6-d87f-4458-8c60-f29c025daeff None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:54.163943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697edd6-d87f-4458-8c60-f29c025daeff None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:54.164811 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697edd6-d87f-4458-8c60-f29c025daeff None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:54.165262 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697edd6-d87f-4458-8c60-f29c025daeff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:54.166821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697edd6-d87f-4458-8c60-f29c025daeff None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:54.184305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 302/612] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:38:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:54.190231 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697edd6-d87f-4458-8c60-f29c025daeff None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:54.199582 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 311/613] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 22:38:54.228940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:54.326539 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697edd6-d87f-4458-8c60-f29c025daeff None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:54.369153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67262fbe-efc0-4290-bf67-7c300dde8fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:54.369804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67262fbe-efc0-4290-bf67-7c300dde8fff None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:54.370094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67262fbe-efc0-4290-bf67-7c300dde8fff None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:54.370374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67262fbe-efc0-4290-bf67-7c300dde8fff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:54.384647 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67262fbe-efc0-4290-bf67-7c300dde8fff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:54.386188 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67262fbe-efc0-4290-bf67-7c300dde8fff None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:54.405238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-67262fbe-efc0-4290-bf67-7c300dde8fff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:54.405238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:54.405238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:54.405238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:54.405238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:54.405238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:54.405238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:54.405238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:54.405238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:54.405238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:54.405238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:54.405238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:54.405238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:54.405238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:54.405238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:54.405238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:54.406413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:54.406413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:54.406413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:54.406413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:54.406413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:54.406413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:54.406413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:54.406413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:54.406413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:54.406413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:54.406413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:54.406413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:54.406413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:54.406413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:54.406413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:54.406413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:54.406413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:54.407679 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:54.407679 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:54.407679 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:54.407679 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 303/614] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:38:54.411939 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11e54a-a249-47bd-a141-cd8eb14a2175 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:54.470769 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:54.511790 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67262fbe-efc0-4290-bf67-7c300dde8fff None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:54.566999 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11e54a-a249-47bd-a141-cd8eb14a2175 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:54.636046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:54.638804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce154ff8-f0da-431a-bd59-4a5bf62c0300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:54.640023 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce154ff8-f0da-431a-bd59-4a5bf62c0300 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:54.640306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce154ff8-f0da-431a-bd59-4a5bf62c0300 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:54.640602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce154ff8-f0da-431a-bd59-4a5bf62c0300 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:54.641268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce154ff8-f0da-431a-bd59-4a5bf62c0300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:54.641570 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce154ff8-f0da-431a-bd59-4a5bf62c0300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:54.642945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce154ff8-f0da-431a-bd59-4a5bf62c0300 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:54.664723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 312/615] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:54.666298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce154ff8-f0da-431a-bd59-4a5bf62c0300 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:54.717332 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67262fbe-efc0-4290-bf67-7c300dde8fff None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:54.773860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce154ff8-f0da-431a-bd59-4a5bf62c0300 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:54.776867 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:54.797090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a52f0-d043-4ba2-85aa-20cfd4b5c12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:54.797878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a52f0-d043-4ba2-85aa-20cfd4b5c12f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:54.798257 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a52f0-d043-4ba2-85aa-20cfd4b5c12f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:54.798632 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a52f0-d043-4ba2-85aa-20cfd4b5c12f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:54.808444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4997f71-9e59-410f-a764-99ac4c74a482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:54.810632 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4997f71-9e59-410f-a764-99ac4c74a482 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:54.810632 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4997f71-9e59-410f-a764-99ac4c74a482 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:54.810632 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4997f71-9e59-410f-a764-99ac4c74a482 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:54.818217 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4997f71-9e59-410f-a764-99ac4c74a482 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:54.819837 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4997f71-9e59-410f-a764-99ac4c74a482 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:54.822306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a52f0-d043-4ba2-85aa-20cfd4b5c12f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:54.832314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-d4997f71-9e59-410f-a764-99ac4c74a482 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 22:38:54.832314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:54.832314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:54.832314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:54.832314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:54.832314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:54.832314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:54.832314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:54.832314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:54.832314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:54.832314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:54.832314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:54.832314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:38:54.832314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:38:54.832314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:38:54.832314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:38:54.833268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:54.833268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:54.833268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:38:54.833268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:54.833268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:38:54.833268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:54.833268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:54.833268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:54.833268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:54.833268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:54.833268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:54.833268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:54.833268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:54.833268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:54.833268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:54.833268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:54.833268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:54.833268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:54.834247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:54.834247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:54.834247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:38:54.834247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:38:54.834247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:38:54.834247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:38:54.834247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:38:54.834247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:38:54.834247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 22:38:54.834247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:54.834247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 313/616] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:38:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:38:54.834836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-234a52f0-d043-4ba2-85aa-20cfd4b5c12f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:54.834836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:54.834836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:54.834836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:54.834836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:54.834836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:54.834836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:54.834836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:54.834836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:54.834836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:54.834836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:54.834836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:54.834836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:54.834836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:54.834836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:54.834836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:54.835687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:54.835687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:54.835687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:54.835687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:54.835687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:54.835687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:54.835687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:54.835687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:54.835687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:54.835687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:54.835687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:54.835687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:54.835687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:54.835687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:54.835687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:54.835687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:54.836548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:54.836548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:54.836548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:54.836548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:54.836548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:54.836548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:54.836548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:54.836548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:54.836548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:54.836548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:54.836548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:54.836548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:54.836548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 304/617] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:38:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:54.844445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4997f71-9e59-410f-a764-99ac4c74a482 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:54.844676 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a52f0-d043-4ba2-85aa-20cfd4b5c12f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:54.970213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4997f71-9e59-410f-a764-99ac4c74a482 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:55.035891 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aed0b4-f96c-4f8c-9108-73c69ad93973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:55.036456 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aed0b4-f96c-4f8c-9108-73c69ad93973 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:55.036740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aed0b4-f96c-4f8c-9108-73c69ad93973 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:55.037014 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aed0b4-f96c-4f8c-9108-73c69ad93973 None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:55.037749 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aed0b4-f96c-4f8c-9108-73c69ad93973 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:55.038052 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aed0b4-f96c-4f8c-9108-73c69ad93973 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:55.039497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aed0b4-f96c-4f8c-9108-73c69ad93973 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:55.081521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 314/618] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Sep 6 22:38:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:38:55.084098 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aed0b4-f96c-4f8c-9108-73c69ad93973 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:55.088075 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a52f0-d043-4ba2-85aa-20cfd4b5c12f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:55.116802 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:55.147977 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:55.171169 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3bcdf-8105-42c0-b7f6-a54c135d7902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:55.171791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3bcdf-8105-42c0-b7f6-a54c135d7902 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:55.172112 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3bcdf-8105-42c0-b7f6-a54c135d7902 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:55.172391 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3bcdf-8105-42c0-b7f6-a54c135d7902 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:55.173090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3bcdf-8105-42c0-b7f6-a54c135d7902 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:55.173396 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3bcdf-8105-42c0-b7f6-a54c135d7902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:55.174779 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3bcdf-8105-42c0-b7f6-a54c135d7902 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:55.192028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 305/619] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:38:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:55.197502 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3bcdf-8105-42c0-b7f6-a54c135d7902 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:55.229496 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aed0b4-f96c-4f8c-9108-73c69ad93973 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:55.264833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e202201-a31e-4d5d-b47a-57d8cb54d0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:55.265819 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e202201-a31e-4d5d-b47a-57d8cb54d0b7 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:55.266246 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e202201-a31e-4d5d-b47a-57d8cb54d0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:55.266664 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e202201-a31e-4d5d-b47a-57d8cb54d0b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:55.276929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e202201-a31e-4d5d-b47a-57d8cb54d0b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:55.278530 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e202201-a31e-4d5d-b47a-57d8cb54d0b7 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:55.293571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-5e202201-a31e-4d5d-b47a-57d8cb54d0b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:55.293571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:55.293571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:55.293571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:55.293571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:55.293571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:55.293571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:55.293571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:55.293571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:55.293571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:55.293571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:55.293571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:55.293571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:55.293571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:55.293571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:55.293571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:55.295155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:55.295155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:55.295155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:55.295155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:55.295155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:55.295155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:55.295155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:55.295155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:55.295155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:55.295155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:55.295155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:55.295155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:55.295155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:55.295155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:55.295155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:55.295155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:55.295155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:55.296070 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:55.296070 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:55.296070 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:55.298066 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 315/620] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:55.303605 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e202201-a31e-4d5d-b47a-57d8cb54d0b7 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:55.384812 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:55.407415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e202201-a31e-4d5d-b47a-57d8cb54d0b7 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:55.443796 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456ec0b-ea04-42be-a255-d7c8f6563e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:55.445657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456ec0b-ea04-42be-a255-d7c8f6563e5c None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:55.446138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456ec0b-ea04-42be-a255-d7c8f6563e5c None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:55.446585 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456ec0b-ea04-42be-a255-d7c8f6563e5c None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:55.447409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456ec0b-ea04-42be-a255-d7c8f6563e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:55.447888 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456ec0b-ea04-42be-a255-d7c8f6563e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:55.449472 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456ec0b-ea04-42be-a255-d7c8f6563e5c None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:55.462866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 316/621] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:55.469097 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456ec0b-ea04-42be-a255-d7c8f6563e5c None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:55.482954 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3bcdf-8105-42c0-b7f6-a54c135d7902 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:55.567072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7665c1-c90c-437e-95cc-c616431bb28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:55.567689 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7665c1-c90c-437e-95cc-c616431bb28b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:55.567895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7665c1-c90c-437e-95cc-c616431bb28b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:55.568221 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7665c1-c90c-437e-95cc-c616431bb28b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:55.588867 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456ec0b-ea04-42be-a255-d7c8f6563e5c None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:55.594821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7665c1-c90c-437e-95cc-c616431bb28b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:55.596347 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7665c1-c90c-437e-95cc-c616431bb28b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:55.616581 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:55.622841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-db7665c1-c90c-437e-95cc-c616431bb28b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:55.622841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:55.622841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:55.622841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:55.622841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:55.622841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:55.622841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:55.622841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:55.622841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:55.622841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:55.622841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:55.622841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:55.622841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:55.622841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:55.622841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:55.622841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:55.623792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:55.623792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:55.623792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:55.623792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:55.623792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:55.623792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:55.623792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:55.623792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:55.623792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:55.623792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:55.623792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:55.623792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:55.623792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:55.623792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:55.623792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:55.623792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:55.623792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:55.624712 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:55.624712 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:55.624712 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:55.624712 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 306/622] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:38:55.632048 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7665c1-c90c-437e-95cc-c616431bb28b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:55.632156 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b811d-8fd4-4b73-b127-5f32f7f1ab05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:55.632579 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b811d-8fd4-4b73-b127-5f32f7f1ab05 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:55.633226 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b811d-8fd4-4b73-b127-5f32f7f1ab05 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:55.633678 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b811d-8fd4-4b73-b127-5f32f7f1ab05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:55.641076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b811d-8fd4-4b73-b127-5f32f7f1ab05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:55.642743 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b811d-8fd4-4b73-b127-5f32f7f1ab05 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:55.665925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-545b811d-8fd4-4b73-b127-5f32f7f1ab05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:55.665925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:55.665925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:55.665925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:55.665925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:55.665925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:55.665925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:55.665925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:55.665925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:55.665925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:55.665925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:55.665925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:55.665925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:38:55.665925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:38:55.665925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:38:55.666895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:38:55.666895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:55.666895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:55.666895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:55.666895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:55.666895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:55.666895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:55.666895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:55.666895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:55.666895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:55.666895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:55.666895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:55.666895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:55.666895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:55.666895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:55.666895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:55.666895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:55.667789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:38:55.667789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:38:55.667789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:38:55.667789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:38:55.667789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:38:55.667789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:38:55.667789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:55.667789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:55.667789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 317/623] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:38:55.677356 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b811d-8fd4-4b73-b127-5f32f7f1ab05 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:55.717076 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:55.762042 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7665c1-c90c-437e-95cc-c616431bb28b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:55.800016 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f9fce-11e0-4104-a8f0-ae118732182a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:55.801132 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f9fce-11e0-4104-a8f0-ae118732182a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:55.801618 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f9fce-11e0-4104-a8f0-ae118732182a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:55.802128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f9fce-11e0-4104-a8f0-ae118732182a None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:55.803293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f9fce-11e0-4104-a8f0-ae118732182a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:55.803820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f9fce-11e0-4104-a8f0-ae118732182a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:55.805457 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f9fce-11e0-4104-a8f0-ae118732182a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:55.829207 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 307/624] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:55.833367 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f9fce-11e0-4104-a8f0-ae118732182a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:55.928866 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:55.933680 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f9fce-11e0-4104-a8f0-ae118732182a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:55.976232 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952becb4-eb8b-46fc-8c15-071913a184ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:55.977141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952becb4-eb8b-46fc-8c15-071913a184ec None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:55.977573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952becb4-eb8b-46fc-8c15-071913a184ec None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:55.978240 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952becb4-eb8b-46fc-8c15-071913a184ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:55.988071 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952becb4-eb8b-46fc-8c15-071913a184ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:55.990670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952becb4-eb8b-46fc-8c15-071913a184ec None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:56.006068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-952becb4-eb8b-46fc-8c15-071913a184ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 22:38:56.006068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:56.006068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:56.006068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:56.006068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:56.006068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:56.006068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:56.006068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:56.006068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:56.006068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:56.006068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:56.006068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:56.006068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:38:56.006068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:38:56.006068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:38:56.006068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:38:56.007314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:56.007314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:56.007314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:38:56.007314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:56.007314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:38:56.007314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:56.007314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:56.007314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:56.007314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:56.007314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:56.007314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:56.007314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:56.007314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:56.007314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:56.007314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:56.007314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:56.007314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:56.007314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:56.008525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:56.008525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:56.008525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:38:56.008525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:38:56.008525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:38:56.008525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:38:56.008525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:38:56.008525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:38:56.008525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 22:38:56.008525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:56.011120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 308/625] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Sep 6 22:38:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:56.016493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b811d-8fd4-4b73-b127-5f32f7f1ab05 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:56.017692 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952becb4-eb8b-46fc-8c15-071913a184ec None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:56.081644 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd882503-61df-41f9-ae50-438a89e821fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:56.082499 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd882503-61df-41f9-ae50-438a89e821fa None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:56.082955 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd882503-61df-41f9-ae50-438a89e821fa None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:56.083933 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd882503-61df-41f9-ae50-438a89e821fa None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:56.085040 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd882503-61df-41f9-ae50-438a89e821fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:56.087555 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd882503-61df-41f9-ae50-438a89e821fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:56.089243 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd882503-61df-41f9-ae50-438a89e821fa None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:56.117817 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 318/626] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:38:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:56.125893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483a995-e7e9-41df-8ef3-25b59b069493 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:56.126183 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483a995-e7e9-41df-8ef3-25b59b069493 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:56.126463 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483a995-e7e9-41df-8ef3-25b59b069493 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:56.127779 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 319/627] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:56.128481 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483a995-e7e9-41df-8ef3-25b59b069493 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:56.181417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:56.184550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952becb4-eb8b-46fc-8c15-071913a184ec None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:56.228590 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7341781-3659-4501-8859-24670541c236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:56.229500 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7341781-3659-4501-8859-24670541c236 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:56.229845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7341781-3659-4501-8859-24670541c236 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:56.230122 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7341781-3659-4501-8859-24670541c236 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:56.230915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7341781-3659-4501-8859-24670541c236 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:56.231391 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7341781-3659-4501-8859-24670541c236 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:56.233499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7341781-3659-4501-8859-24670541c236 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:56.243295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483a995-e7e9-41df-8ef3-25b59b069493 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:56.256612 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 309/628] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Sep 6 22:38:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:56.258158 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabf34d-4e92-43f6-b7a8-4aa3af821310 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:56.258448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabf34d-4e92-43f6-b7a8-4aa3af821310 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:56.258725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabf34d-4e92-43f6-b7a8-4aa3af821310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:56.282439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a142cf2-b6b8-475c-856d-b79fc109eb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:56.282668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-dcabf34d-4e92-43f6-b7a8-4aa3af821310 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:56.283525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a142cf2-b6b8-475c-856d-b79fc109eb84 None admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:56.283860 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-dcabf34d-4e92-43f6-b7a8-4aa3af821310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:56.284173 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a142cf2-b6b8-475c-856d-b79fc109eb84 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:56.284667 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a142cf2-b6b8-475c-856d-b79fc109eb84 None admin] PATH_INFO: `/v3/projects/f5e78b142d654280b161a34cec0186cd/users/660248a90f524a43b143bae127e0eaa1/roles/85bcc17628d742209f79cc936d4290b5` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:56.296072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:56.301982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a142cf2-b6b8-475c-856d-b79fc109eb84 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5e78b142d654280b161a34cec0186cd, user_id=660248a90f524a43b143bae127e0eaa1, role_id=85bcc17628d742209f79cc936d4290b5)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:56.303595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a142cf2-b6b8-475c-856d-b79fc109eb84 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:56.364659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 310/629] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:56.364659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabf34d-4e92-43f6-b7a8-4aa3af821310 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:56.401629 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 320/630] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:38:56 2022] PUT /identity/v3/projects/f5e78b142d654280b161a34cec0186cd/users/660248a90f524a43b143bae127e0eaa1/roles/85bcc17628d742209f79cc936d4290b5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:38:56.501026 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabf34d-4e92-43f6-b7a8-4aa3af821310 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:56.553055 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b7167-d15f-45c1-82a7-e4b5c45a2c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:56.554002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b7167-d15f-45c1-82a7-e4b5c45a2c75 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:56.554526 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b7167-d15f-45c1-82a7-e4b5c45a2c75 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:56.554982 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b7167-d15f-45c1-82a7-e4b5c45a2c75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:56.578252 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:56.603838 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dad5ec-5465-479e-bc72-45569b1f159a None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:56.604380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dad5ec-5465-479e-bc72-45569b1f159a None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:56.604380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dad5ec-5465-479e-bc72-45569b1f159a None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:56.605973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 321/631] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:56.618050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f38448-6c7e-4d0b-82a0-2dadb8c4e685 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:56.618244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f38448-6c7e-4d0b-82a0-2dadb8c4e685 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:56.618507 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f38448-6c7e-4d0b-82a0-2dadb8c4e685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:56.651820 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-e2f38448-6c7e-4d0b-82a0-2dadb8c4e685 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:56.653625 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e2f38448-6c7e-4d0b-82a0-2dadb8c4e685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:56.669808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b7167-d15f-45c1-82a7-e4b5c45a2c75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:56.671280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b7167-d15f-45c1-82a7-e4b5c45a2c75 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:56.741649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 322/632] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 22:38:56.741649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f38448-6c7e-4d0b-82a0-2dadb8c4e685 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:56.768844 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:56.818698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 311/633] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:56.821816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0656c-5591-44fb-b4f4-e8580c08729b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:56.822317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0656c-5591-44fb-b4f4-e8580c08729b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:56.823065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0656c-5591-44fb-b4f4-e8580c08729b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:56.825992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 312/634] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:56.826936 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0656c-5591-44fb-b4f4-e8580c08729b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:56.862853 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f38448-6c7e-4d0b-82a0-2dadb8c4e685 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:56.889856 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:56.907753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9461ea-9328-40d8-9efe-dfc092585990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:56.908904 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9461ea-9328-40d8-9efe-dfc092585990 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:56.909204 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9461ea-9328-40d8-9efe-dfc092585990 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:56.909479 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9461ea-9328-40d8-9efe-dfc092585990 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:56.926142 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9461ea-9328-40d8-9efe-dfc092585990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:56.931918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-0b9461ea-9328-40d8-9efe-dfc092585990 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:56.931918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:56.931918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:56.931918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:56.931918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:56.931918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:56.931918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:56.931918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:56.931918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:56.931918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:56.931918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:56.931918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:56.931918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:56.931918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:56.931918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:56.931918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:56.939283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:56.939283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:56.939283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:56.939283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:56.939283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:56.939283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:56.939283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:56.939283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:56.939283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:56.939283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:56.939283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:56.939283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:56.939283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:56.939283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:56.939283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:56.939283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:56.940169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:56.940169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:56.940169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:56.940169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:56.940169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:56.940169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:56.940169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:56.940169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:56.940169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:56.940169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:56.940169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:56.940169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:56.940169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 323/635] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:38:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:56.940169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec109d-75f2-457a-8c64-4bcbc93ca82d None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:56.940978 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec109d-75f2-457a-8c64-4bcbc93ca82d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:56.940978 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec109d-75f2-457a-8c64-4bcbc93ca82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:56.962369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-8eec109d-75f2-457a-8c64-4bcbc93ca82d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:56.964035 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-8eec109d-75f2-457a-8c64-4bcbc93ca82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:56.972374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0656c-5591-44fb-b4f4-e8580c08729b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:57.019354 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cf62b-3622-417f-91cc-96c4e3dc4706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:57.020155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cf62b-3622-417f-91cc-96c4e3dc4706 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:57.020455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cf62b-3622-417f-91cc-96c4e3dc4706 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:57.020742 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cf62b-3622-417f-91cc-96c4e3dc4706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:57.031811 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cf62b-3622-417f-91cc-96c4e3dc4706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:57.033361 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cf62b-3622-417f-91cc-96c4e3dc4706 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:57.043571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 324/636] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:57.045279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec109d-75f2-457a-8c64-4bcbc93ca82d None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:57.048878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-648cf62b-3622-417f-91cc-96c4e3dc4706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:57.048878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:57.048878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:57.048878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:57.048878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:57.048878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:57.048878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:57.048878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:57.048878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:57.048878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:57.048878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:57.048878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:57.048878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:57.048878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:57.048878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:57.048878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:57.049822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:57.049822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:57.049822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:57.049822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:57.049822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:57.049822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:57.049822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:57.049822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:57.049822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:57.049822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:57.049822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:57.049822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:57.049822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:57.049822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:57.049822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:57.049822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:57.049822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:57.051221 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:57.051221 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:57.051221 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:57.054569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 313/637] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:57.055414 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cf62b-3622-417f-91cc-96c4e3dc4706 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:57.072361 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:57.168911 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec109d-75f2-457a-8c64-4bcbc93ca82d None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:57.185368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:57.192810 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cf62b-3622-417f-91cc-96c4e3dc4706 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:57.212398 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a15c94-25b8-4a06-92d4-87d3d0f8a862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:57.213507 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a15c94-25b8-4a06-92d4-87d3d0f8a862 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:57.213990 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a15c94-25b8-4a06-92d4-87d3d0f8a862 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:57.214552 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a15c94-25b8-4a06-92d4-87d3d0f8a862 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:57.215417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a15c94-25b8-4a06-92d4-87d3d0f8a862 None admin] RBAC: Adding query filter params (name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:57.215934 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a15c94-25b8-4a06-92d4-87d3d0f8a862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:57.218145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a15c94-25b8-4a06-92d4-87d3d0f8a862 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:57.234342 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bf583-732d-4fcc-8b4d-95fc75aa5e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:57.234976 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bf583-732d-4fcc-8b4d-95fc75aa5e2e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:57.235188 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bf583-732d-4fcc-8b4d-95fc75aa5e2e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:57.235393 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 325/638] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:38:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:57.235515 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bf583-732d-4fcc-8b4d-95fc75aa5e2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:57.236608 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a15c94-25b8-4a06-92d4-87d3d0f8a862 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:57.248491 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704bf583-732d-4fcc-8b4d-95fc75aa5e2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:57.256111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-704bf583-732d-4fcc-8b4d-95fc75aa5e2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:57.256111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:57.256111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:57.256111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:57.256111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:57.256111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:57.256111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:57.256111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:57.256111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:57.256111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:57.256111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:57.256111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:57.256111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:57.256111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:57.256111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:57.256111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:57.257131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:57.257131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:57.257131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:57.257131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:57.257131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:57.257131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:57.257131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:57.257131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:57.257131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:57.257131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:57.257131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:57.257131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:57.257131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:57.257131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:57.257131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:57.257131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:57.258592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:57.258592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:57.258592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:57.258592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:57.258592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:57.258592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:57.258592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:57.258592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:57.258592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:57.258592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:57.258592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:57.258592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:57.258592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 314/639] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:38:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:57.258592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bf583-732d-4fcc-8b4d-95fc75aa5e2e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:57.340349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:57.364782 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a15c94-25b8-4a06-92d4-87d3d0f8a862 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:57.379343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bf583-732d-4fcc-8b4d-95fc75aa5e2e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:57.400380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007bbfe-e592-492d-bf7c-c868a679d23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:57.401151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007bbfe-e592-492d-bf7c-c868a679d23a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:57.401499 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007bbfe-e592-492d-bf7c-c868a679d23a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:57.401835 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007bbfe-e592-492d-bf7c-c868a679d23a None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:57.402571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007bbfe-e592-492d-bf7c-c868a679d23a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:57.402941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007bbfe-e592-492d-bf7c-c868a679d23a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:57.405016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007bbfe-e592-492d-bf7c-c868a679d23a None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:57.419444 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce436785-66bc-405b-b0ab-97a1c6e00e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:57.420325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce436785-66bc-405b-b0ab-97a1c6e00e61 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:57.420768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce436785-66bc-405b-b0ab-97a1c6e00e61 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:57.421204 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce436785-66bc-405b-b0ab-97a1c6e00e61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:57.424268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 326/640] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:57.425375 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007bbfe-e592-492d-bf7c-c868a679d23a None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:57.433073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce436785-66bc-405b-b0ab-97a1c6e00e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:57.434532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce436785-66bc-405b-b0ab-97a1c6e00e61 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:57.448909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ce436785-66bc-405b-b0ab-97a1c6e00e61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:57.448909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:57.448909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:57.448909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:57.448909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:57.448909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:57.448909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:57.448909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:57.448909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:57.448909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:57.448909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:57.448909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:57.448909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:57.448909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:57.448909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:57.448909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:57.449865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:57.449865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:57.449865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:57.449865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:57.449865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:57.449865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:57.449865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:57.449865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:57.449865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:57.449865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:57.449865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:57.449865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:57.449865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:57.449865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:57.449865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:57.449865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:57.449865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:57.451292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:57.451292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:57.451292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:57.451292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 315/641] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:57.453412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce436785-66bc-405b-b0ab-97a1c6e00e61 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:57.470504 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:57.537848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007bbfe-e592-492d-bf7c-c868a679d23a None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:57.562592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce436785-66bc-405b-b0ab-97a1c6e00e61 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:57.573133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fdcd59-a44f-4be3-9842-08805b32df42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:57.573601 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdcd59-a44f-4be3-9842-08805b32df42 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:57.573879 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdcd59-a44f-4be3-9842-08805b32df42 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:57.574162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdcd59-a44f-4be3-9842-08805b32df42 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:57.574805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fdcd59-a44f-4be3-9842-08805b32df42 None admin] RBAC: Adding query filter params (name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:57.575105 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fdcd59-a44f-4be3-9842-08805b32df42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:57.577038 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fdcd59-a44f-4be3-9842-08805b32df42 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:57.579502 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:57.590511 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 327/642] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:38:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:57.590511 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fdcd59-a44f-4be3-9842-08805b32df42 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:57.604170 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4202e-d717-4ac6-8b33-489ff70e64db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:57.604864 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4202e-d717-4ac6-8b33-489ff70e64db None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:57.605107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4202e-d717-4ac6-8b33-489ff70e64db None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:57.605376 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4202e-d717-4ac6-8b33-489ff70e64db None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:57.615870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4202e-d717-4ac6-8b33-489ff70e64db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:57.621150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-14b4202e-d717-4ac6-8b33-489ff70e64db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:57.621150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:57.621150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:57.621150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:57.621150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:57.621150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:57.621150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:57.621150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:57.621150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:57.621150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:57.621150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:57.621150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:57.621150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:57.621150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:57.621150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:57.621150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:57.622166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:57.622166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:57.622166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:57.622166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:57.622166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:57.622166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:57.622166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:57.622166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:57.622166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:57.622166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:57.622166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:57.622166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:57.622166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:57.622166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:57.622166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:57.622166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:57.623066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:57.623066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:57.623066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:57.623066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:57.623066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:57.623066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:57.623066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:57.623066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:57.623066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:57.623066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:57.623066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:57.623066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:57.623066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 316/643] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:38:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:57.623801 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4202e-d717-4ac6-8b33-489ff70e64db None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:57.690919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:57.698376 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fdcd59-a44f-4be3-9842-08805b32df42 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:57.725525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4202e-d717-4ac6-8b33-489ff70e64db None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:57.734364 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afe1cd-208a-4030-8ac1-107753601715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:57.735012 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afe1cd-208a-4030-8ac1-107753601715 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:57.735293 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afe1cd-208a-4030-8ac1-107753601715 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:57.735567 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afe1cd-208a-4030-8ac1-107753601715 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:57.742614 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afe1cd-208a-4030-8ac1-107753601715 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:57.744057 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afe1cd-208a-4030-8ac1-107753601715 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:57.756159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-50afe1cd-208a-4030-8ac1-107753601715 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:57.756159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:57.756159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:57.756159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:57.756159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:57.756159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:57.756159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:57.756159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:57.756159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:57.756159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:57.756159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:57.756159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:57.756159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:38:57.756159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:38:57.756159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:38:57.757220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:38:57.757220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:57.757220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:57.757220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:57.757220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:57.757220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:57.757220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:57.757220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:57.757220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:57.757220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:57.757220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:57.757220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:57.757220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:57.757220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:57.757220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:57.757220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:57.757220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:57.758267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:38:57.758267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:38:57.758267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:38:57.758267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:38:57.758267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:38:57.758267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:38:57.758267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:57.758267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:57.758267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 328/644] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:57.758267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afe1cd-208a-4030-8ac1-107753601715 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:57.766379 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d3062-e5e6-4c95-a1dc-dbc2cbd88c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:57.766999 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d3062-e5e6-4c95-a1dc-dbc2cbd88c50 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:57.767280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d3062-e5e6-4c95-a1dc-dbc2cbd88c50 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:57.767551 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d3062-e5e6-4c95-a1dc-dbc2cbd88c50 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:57.768194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d3062-e5e6-4c95-a1dc-dbc2cbd88c50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:57.768525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d3062-e5e6-4c95-a1dc-dbc2cbd88c50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:57.769892 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d3062-e5e6-4c95-a1dc-dbc2cbd88c50 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:57.782748 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 317/645] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:57.783425 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d3062-e5e6-4c95-a1dc-dbc2cbd88c50 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:57.826666 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:57.869503 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afe1cd-208a-4030-8ac1-107753601715 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:57.892907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d3062-e5e6-4c95-a1dc-dbc2cbd88c50 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:57.904608 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46267eed-11a2-4e24-aa66-e6442c29172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:57.905249 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46267eed-11a2-4e24-aa66-e6442c29172f None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:57.905529 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46267eed-11a2-4e24-aa66-e6442c29172f None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:57.905803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46267eed-11a2-4e24-aa66-e6442c29172f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:57.916171 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46267eed-11a2-4e24-aa66-e6442c29172f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:57.917676 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46267eed-11a2-4e24-aa66-e6442c29172f None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:57.921881 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:57.930336 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d79fde-d8f6-41ca-9846-7a81639fc2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:57.937944 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d79fde-d8f6-41ca-9846-7a81639fc2b8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:57.937944 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d79fde-d8f6-41ca-9846-7a81639fc2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:57.938130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-46267eed-11a2-4e24-aa66-e6442c29172f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:57.938130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:57.938130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:57.938130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:57.938130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:57.938130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:57.938130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:57.938130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:57.938130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:57.938130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:57.938130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:57.938130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:57.938130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:57.938130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:57.938130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:57.938130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:57.939020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:57.939020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:57.939020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:57.939020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:57.939020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:57.939020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:57.939020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:57.939020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:57.939020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:57.939020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:57.939020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:57.939020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:57.939020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:57.939020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:57.939020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:57.939020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:57.939020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:57.939922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:57.939922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:57.939922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:57.940103 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d79fde-d8f6-41ca-9846-7a81639fc2b8 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:57.940103 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d79fde-d8f6-41ca-9846-7a81639fc2b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:57.940103 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d79fde-d8f6-41ca-9846-7a81639fc2b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:57.940280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 329/646] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:57.940280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46267eed-11a2-4e24-aa66-e6442c29172f None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:57.940410 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d79fde-d8f6-41ca-9846-7a81639fc2b8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:57.942315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 318/647] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:38:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:57.946887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d79fde-d8f6-41ca-9846-7a81639fc2b8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:58.045446 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46267eed-11a2-4e24-aa66-e6442c29172f None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:58.045972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d79fde-d8f6-41ca-9846-7a81639fc2b8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:58.055607 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:58.082827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3af31-28a6-49b1-95e1-230dda005553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:58.083492 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3af31-28a6-49b1-95e1-230dda005553 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:58.083772 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3af31-28a6-49b1-95e1-230dda005553 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:58.084044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3af31-28a6-49b1-95e1-230dda005553 None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:58.084765 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3af31-28a6-49b1-95e1-230dda005553 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:58.085070 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3af31-28a6-49b1-95e1-230dda005553 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:58.086523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3af31-28a6-49b1-95e1-230dda005553 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:58.090945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefec8c-227c-4fca-adbd-79f13786d667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:58.091805 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefec8c-227c-4fca-adbd-79f13786d667 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:58.092259 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefec8c-227c-4fca-adbd-79f13786d667 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:58.092745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefec8c-227c-4fca-adbd-79f13786d667 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:58.099506 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 330/648] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:38:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:58.100320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3af31-28a6-49b1-95e1-230dda005553 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:58.102206 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefec8c-227c-4fca-adbd-79f13786d667 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:58.103647 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefec8c-227c-4fca-adbd-79f13786d667 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:58.116160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-6aefec8c-227c-4fca-adbd-79f13786d667 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 22:38:58.116160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:58.116160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:58.116160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:58.116160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:58.116160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:58.116160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:58.116160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:58.116160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:58.116160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:58.116160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:58.116160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:58.116160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:38:58.116160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:38:58.116160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:38:58.116160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:38:58.117389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:58.117389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:58.117389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:38:58.117389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:58.117389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:38:58.117389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:58.117389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:58.117389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:58.117389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:58.117389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:58.117389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:58.117389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:58.117389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:58.117389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:58.117389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:58.117389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:58.117389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:58.117389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:58.118343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:58.118343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:58.118343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:38:58.118343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:38:58.118343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:38:58.118343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:38:58.118343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:38:58.118343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:38:58.118343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 22:38:58.118343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:58.121952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 319/649] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:58.123240 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefec8c-227c-4fca-adbd-79f13786d667 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:58.174863 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:58.210300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3af31-28a6-49b1-95e1-230dda005553 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:58.226457 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefec8c-227c-4fca-adbd-79f13786d667 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:58.246286 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c05cfa-a5d9-4767-ac9b-e48ad4b36ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:58.247267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c05cfa-a5d9-4767-ac9b-e48ad4b36ca6 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:58.248285 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c05cfa-a5d9-4767-ac9b-e48ad4b36ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:58.248737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c05cfa-a5d9-4767-ac9b-e48ad4b36ca6 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:58.249380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c05cfa-a5d9-4767-ac9b-e48ad4b36ca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:58.249679 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c05cfa-a5d9-4767-ac9b-e48ad4b36ca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:58.251032 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c05cfa-a5d9-4767-ac9b-e48ad4b36ca6 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:58.262908 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52c2bd-6796-4fbe-b504-fc58a77a4b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:58.267546 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 331/650] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:58.267658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52c2bd-6796-4fbe-b504-fc58a77a4b2c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:58.267658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52c2bd-6796-4fbe-b504-fc58a77a4b2c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:58.267794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c05cfa-a5d9-4767-ac9b-e48ad4b36ca6 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:58.267885 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52c2bd-6796-4fbe-b504-fc58a77a4b2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:58.279537 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52c2bd-6796-4fbe-b504-fc58a77a4b2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:58.281042 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52c2bd-6796-4fbe-b504-fc58a77a4b2c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:58.295851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-5e52c2bd-6796-4fbe-b504-fc58a77a4b2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:58.295851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:58.295851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:58.295851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:58.295851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:58.295851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:58.295851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:58.295851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:58.295851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:58.295851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:58.295851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:58.295851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:58.295851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:58.295851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:58.295851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:58.295851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:58.296886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:58.296886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:58.296886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:58.296886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:58.296886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:58.296886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:58.296886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:58.296886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:58.296886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:58.296886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:58.296886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:58.296886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:58.296886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:58.296886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:58.296886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:58.296886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:58.296886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:58.297818 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:58.297818 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:58.297818 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:58.297818 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 320/651] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:58.297818 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52c2bd-6796-4fbe-b504-fc58a77a4b2c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:58.304108 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:58.381150 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c05cfa-a5d9-4767-ac9b-e48ad4b36ca6 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:58.407450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52c2bd-6796-4fbe-b504-fc58a77a4b2c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:58.409372 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:58.418403 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7d403-f793-4d8f-82d0-cb608f058bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:58.419075 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7d403-f793-4d8f-82d0-cb608f058bc0 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:58.419861 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7d403-f793-4d8f-82d0-cb608f058bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:58.420131 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7d403-f793-4d8f-82d0-cb608f058bc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:58.420891 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7d403-f793-4d8f-82d0-cb608f058bc0 None admin] RBAC: Adding query filter params (role.id=85bcc17628d742209f79cc936d4290b5, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=b18fd296138349408613004929144e70) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:58.421199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7d403-f793-4d8f-82d0-cb608f058bc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:58.422625 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7d403-f793-4d8f-82d0-cb608f058bc0 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:58.436867 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 332/652] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:38:58 2022] GET /identity/v3/role_assignments?user.id=b18fd296138349408613004929144e70&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=85bcc17628d742209f79cc936d4290b5 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:58.436867 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7d403-f793-4d8f-82d0-cb608f058bc0 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:58.453102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fd196-91fb-47a8-8ad2-cb26552c8e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:58.453778 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fd196-91fb-47a8-8ad2-cb26552c8e8d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:58.454060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fd196-91fb-47a8-8ad2-cb26552c8e8d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:58.454331 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fd196-91fb-47a8-8ad2-cb26552c8e8d None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:58.455394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fd196-91fb-47a8-8ad2-cb26552c8e8d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:58.455743 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fd196-91fb-47a8-8ad2-cb26552c8e8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:58.457283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fd196-91fb-47a8-8ad2-cb26552c8e8d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:58.479772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 321/653] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Sep 6 22:38:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:58.480926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fd196-91fb-47a8-8ad2-cb26552c8e8d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:58.566035 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:58.576827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7d403-f793-4d8f-82d0-cb608f058bc0 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:58.596959 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fd196-91fb-47a8-8ad2-cb26552c8e8d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:58.625626 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472c8d3-669c-479c-8042-7744be20c314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:58.627130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472c8d3-669c-479c-8042-7744be20c314 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:58.627836 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472c8d3-669c-479c-8042-7744be20c314 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:58.628322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472c8d3-669c-479c-8042-7744be20c314 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:58.638508 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9731a-d588-4fb1-9660-f05dac8fc33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:58.639132 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9731a-d588-4fb1-9660-f05dac8fc33e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:58.639498 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472c8d3-669c-479c-8042-7744be20c314 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:58.639605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9731a-d588-4fb1-9660-f05dac8fc33e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:58.639914 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9731a-d588-4fb1-9660-f05dac8fc33e None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:58.640682 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9731a-d588-4fb1-9660-f05dac8fc33e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:58.641059 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9731a-d588-4fb1-9660-f05dac8fc33e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:58.641860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472c8d3-669c-479c-8042-7744be20c314 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:58.642617 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9731a-d588-4fb1-9660-f05dac8fc33e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:58.657287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-8472c8d3-669c-479c-8042-7744be20c314 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 22:38:58.657287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:58.657287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:58.657287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:58.657287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:58.657287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:58.657287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:58.657287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:58.657287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:58.657287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:58.657287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:58.657287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:58.657287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:38:58.657287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:38:58.657287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:38:58.657287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:38:58.658315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:58.658315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:58.658315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:38:58.658315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:58.658315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:38:58.658315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:58.658315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:58.658315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:58.658315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:58.658315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:58.658315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:58.658315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:58.658315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:58.658315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:58.658315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:58.658315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:58.658315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:58.658315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:58.659252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:58.659252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:58.659252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:38:58.659252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:38:58.659252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:38:58.659252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:38:58.659252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:38:58.659252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:38:58.659252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 22:38:58.659252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:58.663204 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 322/654] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:58.663330 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 333/655] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:38:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:58.664348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472c8d3-669c-479c-8042-7744be20c314 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:58.664758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9731a-d588-4fb1-9660-f05dac8fc33e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:58.692822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:58.779333 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9731a-d588-4fb1-9660-f05dac8fc33e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:58.780314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472c8d3-669c-479c-8042-7744be20c314 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:58.812317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc77e4-056c-4af6-ba8b-5572d355919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:58.812952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc77e4-056c-4af6-ba8b-5572d355919e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:58.813230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc77e4-056c-4af6-ba8b-5572d355919e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:58.813501 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc77e4-056c-4af6-ba8b-5572d355919e None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:58.814228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc77e4-056c-4af6-ba8b-5572d355919e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:58.814529 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc77e4-056c-4af6-ba8b-5572d355919e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:58.815972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc77e4-056c-4af6-ba8b-5572d355919e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:58.816875 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cc08c-ba5e-4361-bbcb-484fbbfef3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:58.817600 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cc08c-ba5e-4361-bbcb-484fbbfef3c5 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:58.817879 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cc08c-ba5e-4361-bbcb-484fbbfef3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:58.818146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cc08c-ba5e-4361-bbcb-484fbbfef3c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:58.833870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 323/656] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Sep 6 22:38:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:58.834686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc77e4-056c-4af6-ba8b-5572d355919e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:58.847895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:58.892872 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cc08c-ba5e-4361-bbcb-484fbbfef3c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:58.894318 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cc08c-ba5e-4361-bbcb-484fbbfef3c5 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:58.929877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:58.956101 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc77e4-056c-4af6-ba8b-5572d355919e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:58.993692 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05ef1a-ba18-4ce2-85dc-a0f697b5c283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:58.994325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05ef1a-ba18-4ce2-85dc-a0f697b5c283 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:58.994604 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05ef1a-ba18-4ce2-85dc-a0f697b5c283 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:58.999639 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05ef1a-ba18-4ce2-85dc-a0f697b5c283 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:58.999790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 334/657] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:58.999790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa1173-5a17-4e07-9416-e6532fa9752a None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:58.999790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa1173-5a17-4e07-9416-e6532fa9752a None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:58.999790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa1173-5a17-4e07-9416-e6532fa9752a None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:58.999790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 335/658] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:38:58.999790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa1173-5a17-4e07-9416-e6532fa9752a None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:59.008134 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05ef1a-ba18-4ce2-85dc-a0f697b5c283 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:59.009615 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05ef1a-ba18-4ce2-85dc-a0f697b5c283 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:59.021855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-0d05ef1a-ba18-4ce2-85dc-a0f697b5c283 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 22:38:59.021855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:59.021855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:59.021855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:59.021855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:59.021855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:59.021855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:59.021855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:59.021855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:59.021855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:59.021855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:59.021855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:59.021855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:38:59.021855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:38:59.021855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:38:59.021855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:38:59.022843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:59.022843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:59.022843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:38:59.022843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:59.022843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:38:59.022843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:38:59.022843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:59.022843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:59.022843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:59.022843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:59.022843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:59.022843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:59.022843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:59.022843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:59.022843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:59.022843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:59.022843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:59.022843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:59.023791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:59.023791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:59.023791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:38:59.023791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:38:59.023791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:38:59.023791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:38:59.023791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:38:59.023791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:38:59.023791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 22:38:59.023791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:59.027569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 324/659] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:38:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:59.029145 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05ef1a-ba18-4ce2-85dc-a0f697b5c283 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:59.063217 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:59.120117 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa1173-5a17-4e07-9416-e6532fa9752a None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:59.134969 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05ef1a-ba18-4ce2-85dc-a0f697b5c283 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:59.157087 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f43fac-fbc4-4d47-b8b1-604d34a5f3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:59.157939 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f43fac-fbc4-4d47-b8b1-604d34a5f3e0 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:59.158414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f43fac-fbc4-4d47-b8b1-604d34a5f3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:59.158860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f43fac-fbc4-4d47-b8b1-604d34a5f3e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:59.170655 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1f099-4c87-4a0d-a45f-f8b760551be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:59.171279 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1f099-4c87-4a0d-a45f-f8b760551be5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:59.171556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1f099-4c87-4a0d-a45f-f8b760551be5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:59.171825 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1f099-4c87-4a0d-a45f-f8b760551be5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:59.178862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:59.182616 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1f099-4c87-4a0d-a45f-f8b760551be5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:59.184168 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1f099-4c87-4a0d-a45f-f8b760551be5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:59.199844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-adf1f099-4c87-4a0d-a45f-f8b760551be5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:59.199844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:59.199844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:59.199844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:59.199844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:59.199844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:59.199844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:59.199844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:59.199844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:59.199844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:59.199844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:59.199844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:59.199844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:59.199844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:59.199844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:59.199844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:59.201432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:59.201432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:59.201432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:59.201432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:59.201432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:59.201432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:59.201432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:59.201432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:59.201432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:59.201432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:59.201432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:59.201432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:59.201432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:59.201432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:59.201432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:59.201432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:59.201432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:59.202414 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:59.202414 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:59.202414 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:59.206385 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 325/660] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:59.207645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d5408-da40-4251-92d0-5d191d3bcd62 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:59.207935 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d5408-da40-4251-92d0-5d191d3bcd62 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:59.208219 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d5408-da40-4251-92d0-5d191d3bcd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:59.227040 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-185d5408-da40-4251-92d0-5d191d3bcd62 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:38:59.228233 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-185d5408-da40-4251-92d0-5d191d3bcd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:38:59.233976 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f43fac-fbc4-4d47-b8b1-604d34a5f3e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:59.235419 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f43fac-fbc4-4d47-b8b1-604d34a5f3e0 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:59.295627 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:59.304511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 326/661] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:38:59.305373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d5408-da40-4251-92d0-5d191d3bcd62 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:59.348349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 336/662] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:38:59.349517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f43fac-fbc4-4d47-b8b1-604d34a5f3e0 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:59.456152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d5408-da40-4251-92d0-5d191d3bcd62 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:59.462593 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f43fac-fbc4-4d47-b8b1-604d34a5f3e0 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:59.485316 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:59.501421 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a860fa5-1495-4342-98b6-7f37ea16fdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:59.502254 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a860fa5-1495-4342-98b6-7f37ea16fdb8 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:59.502709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a860fa5-1495-4342-98b6-7f37ea16fdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:59.503161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a46fae-59ee-4555-8916-09e4bf0bbce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:59.503381 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a860fa5-1495-4342-98b6-7f37ea16fdb8 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:59.503904 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a46fae-59ee-4555-8916-09e4bf0bbce2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:59.504272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a46fae-59ee-4555-8916-09e4bf0bbce2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:59.504608 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a860fa5-1495-4342-98b6-7f37ea16fdb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:59.504803 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a46fae-59ee-4555-8916-09e4bf0bbce2 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:59.505265 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a860fa5-1495-4342-98b6-7f37ea16fdb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:59.505524 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a46fae-59ee-4555-8916-09e4bf0bbce2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:38:59.505896 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a46fae-59ee-4555-8916-09e4bf0bbce2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:59.507206 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a860fa5-1495-4342-98b6-7f37ea16fdb8 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:59.507523 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a46fae-59ee-4555-8916-09e4bf0bbce2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:59.523297 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 337/663] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:59.524329 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a860fa5-1495-4342-98b6-7f37ea16fdb8 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:59.534620 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 327/664] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Sep 6 22:38:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:38:59.536080 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a46fae-59ee-4555-8916-09e4bf0bbce2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:59.545157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:59.654165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a860fa5-1495-4342-98b6-7f37ea16fdb8 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:59.659753 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a46fae-59ee-4555-8916-09e4bf0bbce2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:59.689250 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34464ca2-514f-43a5-8031-9fd8c36dc05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:59.689889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34464ca2-514f-43a5-8031-9fd8c36dc05a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:59.690173 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34464ca2-514f-43a5-8031-9fd8c36dc05a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:59.690447 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34464ca2-514f-43a5-8031-9fd8c36dc05a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:59.699414 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d4a51-1b7f-4ea7-ab41-6b24fb51db35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:59.700067 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d4a51-1b7f-4ea7-ab41-6b24fb51db35 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:59.700357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d4a51-1b7f-4ea7-ab41-6b24fb51db35 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:59.700656 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d4a51-1b7f-4ea7-ab41-6b24fb51db35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:59.701022 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34464ca2-514f-43a5-8031-9fd8c36dc05a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:59.702469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34464ca2-514f-43a5-8031-9fd8c36dc05a None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:59.707767 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d4a51-1b7f-4ea7-ab41-6b24fb51db35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:59.709395 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d4a51-1b7f-4ea7-ab41-6b24fb51db35 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:38:59.716650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-34464ca2-514f-43a5-8031-9fd8c36dc05a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:59.716650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:59.716650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:59.716650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:59.716650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:59.716650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:59.716650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:59.716650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:59.716650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:59.716650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:59.716650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:59.716650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:59.716650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:38:59.716650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:38:59.716650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:38:59.716650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:38:59.717599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:59.717599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:59.717599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:59.717599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:59.717599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:59.717599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:59.717599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:59.717599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:59.717599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:59.717599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:59.717599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:59.717599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:59.717599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:59.717599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:59.717599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:59.717599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:59.717599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:38:59.719167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:38:59.719167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:38:59.719167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:38:59.719167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 338/665] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:59.719167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34464ca2-514f-43a5-8031-9fd8c36dc05a None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:59.723128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-be3d4a51-1b7f-4ea7-ab41-6b24fb51db35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:59.723128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:59.723128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:59.723128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:59.723128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:59.723128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:59.723128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:59.723128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:59.723128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:59.723128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:59.723128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:59.723128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:59.723128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:38:59.723128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:38:59.723128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:38:59.724178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:38:59.724178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:59.724178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:59.724178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:59.724178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:59.724178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:59.724178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:59.724178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:59.724178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:59.724178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:59.724178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:59.724178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:59.724178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:59.724178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:59.724178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:59.724178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:59.724178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:59.725175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:38:59.725175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:38:59.725175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:38:59.725175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:38:59.725175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:38:59.725175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:38:59.725175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:38:59.725175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:59.725175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 328/666] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:38:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:59.725676 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d4a51-1b7f-4ea7-ab41-6b24fb51db35 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:59.772856 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:59.791757 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:38:59.828943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34464ca2-514f-43a5-8031-9fd8c36dc05a None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:59.838458 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d4a51-1b7f-4ea7-ab41-6b24fb51db35 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:38:59.863494 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5ffec-0102-41e7-b2aa-9122c68b8b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:59.864110 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5ffec-0102-41e7-b2aa-9122c68b8b76 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:59.864387 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5ffec-0102-41e7-b2aa-9122c68b8b76 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:59.864683 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5ffec-0102-41e7-b2aa-9122c68b8b76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:59.876284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3c8dc-385d-496f-b834-49a98371b170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:38:59.876969 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3c8dc-385d-496f-b834-49a98371b170 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:38:59.877249 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3c8dc-385d-496f-b834-49a98371b170 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:38:59.877520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3c8dc-385d-496f-b834-49a98371b170 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:38:59.888858 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3c8dc-385d-496f-b834-49a98371b170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:38:59.894079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-20a3c8dc-385d-496f-b834-49a98371b170 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:59.894079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:38:59.894079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:38:59.894079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:38:59.894079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:38:59.894079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:38:59.894079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:38:59.894079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:38:59.894079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:38:59.894079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:38:59.894079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:38:59.894079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:38:59.894079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:38:59.894079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:38:59.894079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:38:59.894079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:38:59.895015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:38:59.895015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:38:59.895015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:38:59.895015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:38:59.895015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:38:59.895015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:38:59.895015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:38:59.895015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:38:59.895015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:38:59.895015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:38:59.895015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:38:59.895015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:38:59.895015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:38:59.895015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:38:59.895015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:38:59.895015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:38:59.895870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:38:59.895870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:38:59.895870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:38:59.895870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:38:59.895870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:38:59.895870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:38:59.895870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:38:59.895870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:38:59.895870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:38:59.895870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:38:59.895870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:38:59.895870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:38:59.895870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 329/667] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:38:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:38:59.896626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3c8dc-385d-496f-b834-49a98371b170 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:38:59.947903 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5ffec-0102-41e7-b2aa-9122c68b8b76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:38:59.947903 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5ffec-0102-41e7-b2aa-9122c68b8b76 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:00.010187 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:00.031893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:00.035947 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3c8dc-385d-496f-b834-49a98371b170 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:00.048244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 339/668] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:38:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:39:00.049367 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5ffec-0102-41e7-b2aa-9122c68b8b76 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:00.077722 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bb67b-a0c3-4ead-bc3e-b59a2935ba48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:00.078664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bb67b-a0c3-4ead-bc3e-b59a2935ba48 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:00.079019 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bb67b-a0c3-4ead-bc3e-b59a2935ba48 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:00.079298 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bb67b-a0c3-4ead-bc3e-b59a2935ba48 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:00.079948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bb67b-a0c3-4ead-bc3e-b59a2935ba48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:00.080547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bb67b-a0c3-4ead-bc3e-b59a2935ba48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:00.081918 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bb67b-a0c3-4ead-bc3e-b59a2935ba48 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:00.101183 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 330/669] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:00.101183 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bb67b-a0c3-4ead-bc3e-b59a2935ba48 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:00.160812 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5ffec-0102-41e7-b2aa-9122c68b8b76 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:00.195252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667efbc-6fa9-494c-b94d-ef293c5da530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:00.195962 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667efbc-6fa9-494c-b94d-ef293c5da530 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:00.196143 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667efbc-6fa9-494c-b94d-ef293c5da530 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:00.196415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667efbc-6fa9-494c-b94d-ef293c5da530 None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:00.197143 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667efbc-6fa9-494c-b94d-ef293c5da530 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:00.197446 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667efbc-6fa9-494c-b94d-ef293c5da530 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:00.198916 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667efbc-6fa9-494c-b94d-ef293c5da530 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:00.203262 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bb67b-a0c3-4ead-bc3e-b59a2935ba48 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:00.212739 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 340/670] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:39:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:00.214368 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667efbc-6fa9-494c-b94d-ef293c5da530 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:00.243191 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:00.243789 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff6b9e-f1c9-408e-afb2-4ace85074397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:00.244413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff6b9e-f1c9-408e-afb2-4ace85074397 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:00.244752 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff6b9e-f1c9-408e-afb2-4ace85074397 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:00.245025 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff6b9e-f1c9-408e-afb2-4ace85074397 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:00.245686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff6b9e-f1c9-408e-afb2-4ace85074397 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:00.245984 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff6b9e-f1c9-408e-afb2-4ace85074397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:00.247397 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff6b9e-f1c9-408e-afb2-4ace85074397 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:00.255555 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 331/671] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:39:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:00.257049 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff6b9e-f1c9-408e-afb2-4ace85074397 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:00.283377 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:00.326947 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667efbc-6fa9-494c-b94d-ef293c5da530 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:00.363252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d60e2-eae9-4bfc-8795-1af015792ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:00.363889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d60e2-eae9-4bfc-8795-1af015792ca3 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:00.364182 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d60e2-eae9-4bfc-8795-1af015792ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:00.364444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d60e2-eae9-4bfc-8795-1af015792ca3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:00.367783 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff6b9e-f1c9-408e-afb2-4ace85074397 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:00.375921 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d60e2-eae9-4bfc-8795-1af015792ca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:00.377771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d60e2-eae9-4bfc-8795-1af015792ca3 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:00.393640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-274d60e2-eae9-4bfc-8795-1af015792ca3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:00.393640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:00.393640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:00.393640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:00.393640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:00.393640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:00.393640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:00.393640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:00.393640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:00.393640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:00.393640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:00.393640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:00.393640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:00.393640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:00.393640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:00.393640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:00.399335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:00.399335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:00.399335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:00.399335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:00.399335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:00.399335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:00.399335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:00.399335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:00.399335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:00.399335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:00.399335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:00.399335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:00.399335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:00.399335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:00.399335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:00.399335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:00.399335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:00.400596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:00.400596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:00.400596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:00.400596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 341/672] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:00.400596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d60e2-eae9-4bfc-8795-1af015792ca3 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:00.411063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d08d1-7011-44b7-a694-affc526a66b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:00.411698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d08d1-7011-44b7-a694-affc526a66b5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:00.411977 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d08d1-7011-44b7-a694-affc526a66b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:00.412248 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d08d1-7011-44b7-a694-affc526a66b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:00.419189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d08d1-7011-44b7-a694-affc526a66b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:00.420667 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d08d1-7011-44b7-a694-affc526a66b5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:00.432077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-a63d08d1-7011-44b7-a694-affc526a66b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:00.432077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:00.432077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:00.432077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:00.432077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:00.432077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:00.432077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:00.432077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:00.432077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:00.432077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:00.432077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:00.432077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:00.432077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:39:00.432077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:39:00.432077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:39:00.433037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:39:00.433037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:00.433037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:00.433037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:00.433037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:00.433037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:00.433037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:00.433037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:00.433037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:00.433037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:00.433037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:00.433037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:00.433037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:00.433037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:00.433037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:00.433037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:00.433037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:00.433995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:39:00.433995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:39:00.433995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:39:00.433995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:39:00.433995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:39:00.433995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:39:00.433995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:00.433995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:00.437879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 332/673] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:00.438709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d08d1-7011-44b7-a694-affc526a66b5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:00.490699 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:00.512551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d60e2-eae9-4bfc-8795-1af015792ca3 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:00.529701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:00.548928 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d08d1-7011-44b7-a694-affc526a66b5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:00.551509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17429f4-faa4-48b6-a130-5312719d6dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:00.552133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17429f4-faa4-48b6-a130-5312719d6dce None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:00.552412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17429f4-faa4-48b6-a130-5312719d6dce None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:00.552719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17429f4-faa4-48b6-a130-5312719d6dce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:00.553466 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17429f4-faa4-48b6-a130-5312719d6dce None admin] RBAC: Adding query filter params (role.id=85bcc17628d742209f79cc936d4290b5, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=4a2c1f1668814a5e9e654c6308fa0628) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:00.553771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17429f4-faa4-48b6-a130-5312719d6dce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:00.555195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17429f4-faa4-48b6-a130-5312719d6dce None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:00.561729 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 342/674] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:39:00 2022] GET /identity/v3/role_assignments?user.id=4a2c1f1668814a5e9e654c6308fa0628&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=85bcc17628d742209f79cc936d4290b5 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:00.562517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17429f4-faa4-48b6-a130-5312719d6dce None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:00.610050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359dc9b0-f50e-4524-8cd5-2bb4f8da7b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:00.611060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dc9b0-f50e-4524-8cd5-2bb4f8da7b72 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:00.612262 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dc9b0-f50e-4524-8cd5-2bb4f8da7b72 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:00.612754 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dc9b0-f50e-4524-8cd5-2bb4f8da7b72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:00.629501 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359dc9b0-f50e-4524-8cd5-2bb4f8da7b72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:00.632574 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359dc9b0-f50e-4524-8cd5-2bb4f8da7b72 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:00.656681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-359dc9b0-f50e-4524-8cd5-2bb4f8da7b72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:00.656681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:00.656681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:00.656681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:00.656681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:00.656681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:00.656681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:00.656681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:00.656681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:00.656681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:00.656681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:00.656681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:00.656681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:00.656681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:00.656681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:00.656681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:00.657806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:00.657806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:00.657806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:00.657806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:00.657806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:00.657806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:00.657806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:00.657806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:00.657806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:00.657806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:00.657806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:00.657806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:00.657806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:00.657806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:00.657806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:00.657806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:00.657806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:00.658838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:00.658838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:00.658838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:00.661759 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 333/675] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:00.663563 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359dc9b0-f50e-4524-8cd5-2bb4f8da7b72 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:00.703537 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17429f4-faa4-48b6-a130-5312719d6dce None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:00.751778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413284c2-c3f6-4e6f-9942-d2be5dc207b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:00.754255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413284c2-c3f6-4e6f-9942-d2be5dc207b7 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:00.754255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413284c2-c3f6-4e6f-9942-d2be5dc207b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:00.754255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413284c2-c3f6-4e6f-9942-d2be5dc207b7 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:00.756587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413284c2-c3f6-4e6f-9942-d2be5dc207b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:00.756587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413284c2-c3f6-4e6f-9942-d2be5dc207b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:00.756587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413284c2-c3f6-4e6f-9942-d2be5dc207b7 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:00.771386 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 343/676] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:00.772306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413284c2-c3f6-4e6f-9942-d2be5dc207b7 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:00.775230 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:00.795037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359dc9b0-f50e-4524-8cd5-2bb4f8da7b72 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:00.829891 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:00.835504 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd9eb5-108f-40fe-8977-2aa47b97e1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:00.836127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd9eb5-108f-40fe-8977-2aa47b97e1b4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:00.836406 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd9eb5-108f-40fe-8977-2aa47b97e1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:00.836872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd9eb5-108f-40fe-8977-2aa47b97e1b4 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:00.838033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd9eb5-108f-40fe-8977-2aa47b97e1b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:00.838033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd9eb5-108f-40fe-8977-2aa47b97e1b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:00.839305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd9eb5-108f-40fe-8977-2aa47b97e1b4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:00.853795 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 334/677] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:39:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:00.854552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd9eb5-108f-40fe-8977-2aa47b97e1b4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:00.884633 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413284c2-c3f6-4e6f-9942-d2be5dc207b7 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:00.921670 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1d571-1a16-489c-b7da-377d91fb4542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:00.922288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1d571-1a16-489c-b7da-377d91fb4542 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:00.922567 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1d571-1a16-489c-b7da-377d91fb4542 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:00.922837 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1d571-1a16-489c-b7da-377d91fb4542 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:00.923481 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1d571-1a16-489c-b7da-377d91fb4542 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:00.923786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1d571-1a16-489c-b7da-377d91fb4542 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:00.925207 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1d571-1a16-489c-b7da-377d91fb4542 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:00.936508 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 344/678] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:00.937741 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dc9e8-8d37-4a25-99fc-165eaf942064 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:00.938027 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dc9e8-8d37-4a25-99fc-165eaf942064 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:00.938302 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dc9e8-8d37-4a25-99fc-165eaf942064 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:00.939654 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 345/679] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:00.940187 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dc9e8-8d37-4a25-99fc-165eaf942064 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:00.966430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd9eb5-108f-40fe-8977-2aa47b97e1b4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:01.004310 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9555b7-ca3f-488f-9884-a2619b337888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:01.005338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9555b7-ca3f-488f-9884-a2619b337888 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:01.005721 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9555b7-ca3f-488f-9884-a2619b337888 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:01.006096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9555b7-ca3f-488f-9884-a2619b337888 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:01.007100 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:01.014793 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9555b7-ca3f-488f-9884-a2619b337888 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:01.019719 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9555b7-ca3f-488f-9884-a2619b337888 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:01.028099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-db9555b7-ca3f-488f-9884-a2619b337888 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:01.028099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:01.028099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:01.028099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:01.028099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:01.028099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:01.028099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:01.028099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:01.028099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:01.028099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:01.028099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:01.028099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:01.028099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:39:01.028099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:39:01.028099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:39:01.029846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:39:01.029846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:01.029846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:01.029846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:01.029846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:01.029846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:01.029846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:01.029846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:01.029846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:01.029846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:01.029846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:01.029846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:01.029846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:01.029846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:01.029846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:01.029846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:01.029846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:01.030956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:39:01.030956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:39:01.030956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:39:01.030956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:39:01.030956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:39:01.030956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:39:01.030956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:01.030956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:01.036291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 335/680] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:01.037306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9555b7-ca3f-488f-9884-a2619b337888 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:01.052929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dc9e8-8d37-4a25-99fc-165eaf942064 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:01.095998 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46228bb-aceb-4ed5-bb64-735292ac5792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:01.096761 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46228bb-aceb-4ed5-bb64-735292ac5792 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:01.097142 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46228bb-aceb-4ed5-bb64-735292ac5792 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:01.097548 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46228bb-aceb-4ed5-bb64-735292ac5792 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:01.097992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:01.098451 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46228bb-aceb-4ed5-bb64-735292ac5792 None admin] RBAC: Adding query filter params (role.id=85bcc17628d742209f79cc936d4290b5, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=5ef596f83ce54fab8779e4e0f3899abc) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:01.098883 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46228bb-aceb-4ed5-bb64-735292ac5792 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:01.100314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46228bb-aceb-4ed5-bb64-735292ac5792 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:01.112784 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 346/681] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:39:00 2022] GET /identity/v3/role_assignments?user.id=5ef596f83ce54fab8779e4e0f3899abc&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=85bcc17628d742209f79cc936d4290b5 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:01.112784 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6dc12-da36-4196-b7e4-b2849709ba2a None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:01.112784 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6dc12-da36-4196-b7e4-b2849709ba2a None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:01.112784 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6dc12-da36-4196-b7e4-b2849709ba2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:01.134754 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-eed6dc12-da36-4196-b7e4-b2849709ba2a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:01.136142 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-eed6dc12-da36-4196-b7e4-b2849709ba2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:01.160937 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9555b7-ca3f-488f-9884-a2619b337888 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:01.206297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a04e43-da24-48f2-aed7-01dc0606dd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:01.207256 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a04e43-da24-48f2-aed7-01dc0606dd0b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:01.207654 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a04e43-da24-48f2-aed7-01dc0606dd0b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:01.208024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a04e43-da24-48f2-aed7-01dc0606dd0b None admin] PATH_INFO: `/v3/users/swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:01.217311 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a04e43-da24-48f2-aed7-01dc0606dd0b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:01.218983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a04e43-da24-48f2-aed7-01dc0606dd0b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:01.232106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-92a04e43-da24-48f2-aed7-01dc0606dd0b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 22:39:01.232106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:01.232106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:01.232106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:01.232106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:01.232106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:01.232106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:01.232106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:01.232106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:01.232106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:01.232106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:01.232106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:01.232106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:39:01.232106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:39:01.232106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:39:01.232106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:39:01.233291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:01.233291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:01.233291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:39:01.233291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:01.233291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:39:01.233291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:01.233291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:01.233291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:01.233291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:01.233291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:01.233291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:01.233291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:01.233291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:01.233291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:01.233291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:01.233291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:01.233291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:01.233291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:01.234273 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:01.234273 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:01.234273 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:39:01.234273 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:39:01.234273 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:39:01.234273 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:39:01.234273 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:39:01.234273 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:39:01.234273 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 22:39:01.234273 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:01.238768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 336/682] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:39:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:01.239087 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 347/683] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:39:01.239986 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a04e43-da24-48f2-aed7-01dc0606dd0b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:01.240108 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6dc12-da36-4196-b7e4-b2849709ba2a None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:01.348148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:01.377000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a04e43-da24-48f2-aed7-01dc0606dd0b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:01.392255 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:01.407200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6dc12-da36-4196-b7e4-b2849709ba2a None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:01.416905 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbe592-eb36-4c0a-b33f-9019609ccf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:01.417848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbe592-eb36-4c0a-b33f-9019609ccf40 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:01.418284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbe592-eb36-4c0a-b33f-9019609ccf40 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:01.418690 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbe592-eb36-4c0a-b33f-9019609ccf40 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:01.419867 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbe592-eb36-4c0a-b33f-9019609ccf40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:01.420383 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbe592-eb36-4c0a-b33f-9019609ccf40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:01.422063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbe592-eb36-4c0a-b33f-9019609ccf40 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:01.441665 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 337/684] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:39:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:01.448241 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbe592-eb36-4c0a-b33f-9019609ccf40 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:01.468676 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa6a5e-ce4b-4bbd-91aa-03b3da1719c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:01.469306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa6a5e-ce4b-4bbd-91aa-03b3da1719c4 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:01.469583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa6a5e-ce4b-4bbd-91aa-03b3da1719c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:01.469850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa6a5e-ce4b-4bbd-91aa-03b3da1719c4 None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:01.470590 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa6a5e-ce4b-4bbd-91aa-03b3da1719c4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:01.470895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa6a5e-ce4b-4bbd-91aa-03b3da1719c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:01.472337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa6a5e-ce4b-4bbd-91aa-03b3da1719c4 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:01.500524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 348/685] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Sep 6 22:39:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:01.506069 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa6a5e-ce4b-4bbd-91aa-03b3da1719c4 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:01.605792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbe592-eb36-4c0a-b33f-9019609ccf40 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:01.642487 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd62293-6643-4d5a-b202-7536e69fe5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:01.643099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd62293-6643-4d5a-b202-7536e69fe5c9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:01.643375 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd62293-6643-4d5a-b202-7536e69fe5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:01.643643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd62293-6643-4d5a-b202-7536e69fe5c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:01.643894 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa6a5e-ce4b-4bbd-91aa-03b3da1719c4 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:01.644365 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd62293-6643-4d5a-b202-7536e69fe5c9 None admin] RBAC: Adding query filter params (role.id=85bcc17628d742209f79cc936d4290b5, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=314bb14d5fa1414a832efb6d37c0446d) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:01.644752 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd62293-6643-4d5a-b202-7536e69fe5c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:01.646178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd62293-6643-4d5a-b202-7536e69fe5c9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:01.652564 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 338/686] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:39:01 2022] GET /identity/v3/role_assignments?user.id=314bb14d5fa1414a832efb6d37c0446d&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=85bcc17628d742209f79cc936d4290b5 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:01.653473 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd62293-6643-4d5a-b202-7536e69fe5c9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:01.659793 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:01.682886 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e9ad5-0ca1-47f1-9352-5548c3aa37e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:01.683869 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e9ad5-0ca1-47f1-9352-5548c3aa37e2 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:01.684895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e9ad5-0ca1-47f1-9352-5548c3aa37e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:01.685357 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e9ad5-0ca1-47f1-9352-5548c3aa37e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:01.695116 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:01.774645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd62293-6643-4d5a-b202-7536e69fe5c9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:01.776359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e9ad5-0ca1-47f1-9352-5548c3aa37e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:01.778301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e9ad5-0ca1-47f1-9352-5548c3aa37e2 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:01.813666 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae7a2a-858b-43ef-9dae-d3b4ff663f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:01.814317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae7a2a-858b-43ef-9dae-d3b4ff663f2e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:01.814599 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae7a2a-858b-43ef-9dae-d3b4ff663f2e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:01.814902 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae7a2a-858b-43ef-9dae-d3b4ff663f2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:01.827608 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae7a2a-858b-43ef-9dae-d3b4ff663f2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:39:01.834591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-0cae7a2a-858b-43ef-9dae-d3b4ff663f2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:39:01.834591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:01.834591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:01.834591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:01.834591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:01.834591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:01.834591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:01.834591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:01.834591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:01.834591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:01.834591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:01.834591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:01.834591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:39:01.834591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:39:01.834591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:39:01.834591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:39:01.835605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:39:01.835605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:39:01.835605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:39:01.835605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:39:01.835605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:01.835605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:01.835605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:01.835605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:01.835605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:01.835605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:01.835605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:01.835605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:01.835605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:01.835605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:01.835605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:01.835605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:01.836485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:01.836485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:01.836485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:01.836485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:01.836485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:39:01.836485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:39:01.836485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:39:01.836485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:39:01.836485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:39:01.836485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:39:01.836485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:39:01.836485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:01.836485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 339/687] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:39:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:01.842001 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae7a2a-858b-43ef-9dae-d3b4ff663f2e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:01.892120 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 349/688] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:39:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:39:01.897498 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e9ad5-0ca1-47f1-9352-5548c3aa37e2 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:01.918610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:01.951838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:01.961252 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae7a2a-858b-43ef-9dae-d3b4ff663f2e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:02.008102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e72b88-cf13-4cf3-8797-4d6a0aa83ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:02.009084 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e72b88-cf13-4cf3-8797-4d6a0aa83ec0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:02.009607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e72b88-cf13-4cf3-8797-4d6a0aa83ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:02.010057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e72b88-cf13-4cf3-8797-4d6a0aa83ec0 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:02.010911 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e72b88-cf13-4cf3-8797-4d6a0aa83ec0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:02.011394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e72b88-cf13-4cf3-8797-4d6a0aa83ec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:02.013132 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e72b88-cf13-4cf3-8797-4d6a0aa83ec0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:02.025185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 340/689] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:39:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:02.030709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e72b88-cf13-4cf3-8797-4d6a0aa83ec0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:02.044831 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e9ad5-0ca1-47f1-9352-5548c3aa37e2 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:02.105967 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d75bd-4bb4-4a77-bbab-b375247041ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:02.107149 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d75bd-4bb4-4a77-bbab-b375247041ac None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:02.107428 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d75bd-4bb4-4a77-bbab-b375247041ac None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:02.107695 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d75bd-4bb4-4a77-bbab-b375247041ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:02.127044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d75bd-4bb4-4a77-bbab-b375247041ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:02.129219 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d75bd-4bb4-4a77-bbab-b375247041ac None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:02.149186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-4b3d75bd-4bb4-4a77-bbab-b375247041ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:02.149186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:02.149186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:02.149186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:02.149186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:02.149186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:02.149186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:02.149186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:02.149186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:02.149186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:02.149186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:02.149186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:02.149186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:02.149186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:02.149186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:02.149186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:02.150349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:02.150349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:02.150349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:02.150349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:02.150349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:02.150349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:02.150349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:02.150349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:02.150349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:02.150349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:02.150349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:02.150349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:02.150349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:02.150349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:02.150349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:02.150349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:02.150349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:02.151457 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:02.151457 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:02.151457 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:02.154360 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 350/690] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:02.160347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d75bd-4bb4-4a77-bbab-b375247041ac None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:02.191166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e72b88-cf13-4cf3-8797-4d6a0aa83ec0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:02.239127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332add4-d538-478b-a260-94f986ab9e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:02.240201 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332add4-d538-478b-a260-94f986ab9e93 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:02.241025 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332add4-d538-478b-a260-94f986ab9e93 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:02.241590 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332add4-d538-478b-a260-94f986ab9e93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:02.262132 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332add4-d538-478b-a260-94f986ab9e93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:02.263708 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332add4-d538-478b-a260-94f986ab9e93 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:02.264530 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:02.291972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-a332add4-d538-478b-a260-94f986ab9e93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:02.291972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:02.291972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:02.291972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:02.291972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:02.291972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:02.291972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:02.291972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:02.291972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:02.291972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:02.291972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:02.291972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:02.291972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:02.291972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:02.291972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:02.291972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:02.293244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:02.293244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:02.293244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:02.293244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:02.293244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:02.293244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:02.293244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:02.293244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:02.293244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:02.293244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:02.293244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:02.293244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:02.293244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:02.293244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:02.293244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:02.293244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:02.293244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:02.294949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:02.294949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:02.294949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:02.294949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 341/691] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:02.301254 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332add4-d538-478b-a260-94f986ab9e93 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:02.316807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:02.351315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d75bd-4bb4-4a77-bbab-b375247041ac None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:02.452611 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208ee91-3eca-41df-89e7-27290446821c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:02.453153 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208ee91-3eca-41df-89e7-27290446821c None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:02.453430 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208ee91-3eca-41df-89e7-27290446821c None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:02.453698 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208ee91-3eca-41df-89e7-27290446821c None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:02.456299 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208ee91-3eca-41df-89e7-27290446821c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:02.456635 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208ee91-3eca-41df-89e7-27290446821c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:02.458008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208ee91-3eca-41df-89e7-27290446821c None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:02.461664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332add4-d538-478b-a260-94f986ab9e93 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:02.491249 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 351/692] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:02.497079 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208ee91-3eca-41df-89e7-27290446821c None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:02.565718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea264c-7b45-4e91-b295-aa2ef16139fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:02.566347 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea264c-7b45-4e91-b295-aa2ef16139fe None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:02.566622 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea264c-7b45-4e91-b295-aa2ef16139fe None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:02.566891 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea264c-7b45-4e91-b295-aa2ef16139fe None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:02.567544 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea264c-7b45-4e91-b295-aa2ef16139fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:02.567844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea264c-7b45-4e91-b295-aa2ef16139fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:02.569242 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea264c-7b45-4e91-b295-aa2ef16139fe None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:02.584173 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 342/693] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:02.599074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea264c-7b45-4e91-b295-aa2ef16139fe None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:02.613750 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208ee91-3eca-41df-89e7-27290446821c None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:02.650775 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17ff00-0448-4e68-84ea-7bbe128a7027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:02.651420 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17ff00-0448-4e68-84ea-7bbe128a7027 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:02.651696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17ff00-0448-4e68-84ea-7bbe128a7027 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:02.651967 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17ff00-0448-4e68-84ea-7bbe128a7027 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:02.659986 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17ff00-0448-4e68-84ea-7bbe128a7027 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:02.661476 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17ff00-0448-4e68-84ea-7bbe128a7027 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:02.664620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:02.682190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-ca17ff00-0448-4e68-84ea-7bbe128a7027 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:02.682190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:02.682190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:02.682190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:02.682190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:02.682190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:02.682190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:02.682190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:02.682190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:02.682190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:02.682190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:02.682190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:02.682190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:39:02.682190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:39:02.682190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:39:02.688154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:39:02.688154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:02.688154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:02.688154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:02.688154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:02.688154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:02.688154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:02.688154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:02.688154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:02.688154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:02.688154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:02.688154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:02.688154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:02.688154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:02.688154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:02.688154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:02.688154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:02.689136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:39:02.689136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:39:02.689136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:39:02.689136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:39:02.689136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:39:02.689136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:39:02.689136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:02.689136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:02.689136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 352/694] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:02.691907 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17ff00-0448-4e68-84ea-7bbe128a7027 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:02.756800 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:02.793905 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea264c-7b45-4e91-b295-aa2ef16139fe None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:02.837661 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564c881-3cdc-46ba-85d6-7d66117c624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:02.838469 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564c881-3cdc-46ba-85d6-7d66117c624b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:02.838841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564c881-3cdc-46ba-85d6-7d66117c624b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:02.839235 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564c881-3cdc-46ba-85d6-7d66117c624b None admin] PATH_INFO: `/v3/users/nova` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:02.848381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564c881-3cdc-46ba-85d6-7d66117c624b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:02.850159 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564c881-3cdc-46ba-85d6-7d66117c624b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:02.863895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-2564c881-3cdc-46ba-85d6-7d66117c624b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 22:39:02.863895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:02.863895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:02.863895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:02.863895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:02.863895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:02.863895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:02.863895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:02.863895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:02.863895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:02.863895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:02.863895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:02.863895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:39:02.863895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:39:02.863895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:39:02.863895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:39:02.865009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:02.865009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:02.865009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:39:02.865009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:02.865009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:39:02.865009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:02.865009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:02.865009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:02.865009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:02.865009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:02.865009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:02.865009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:02.865009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:02.865009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:02.865009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:02.865009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:02.865009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:02.865009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:02.865992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:02.865992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:02.865992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:39:02.865992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:39:02.865992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:39:02.865992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:39:02.865992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:39:02.865992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:39:02.865992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 22:39:02.865992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:02.870386 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 343/695] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Sep 6 22:39:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:02.871610 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564c881-3cdc-46ba-85d6-7d66117c624b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:02.957893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17ff00-0448-4e68-84ea-7bbe128a7027 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:02.987489 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564c881-3cdc-46ba-85d6-7d66117c624b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:02.991552 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80862e14-fe24-4cc7-b1ad-85f8edc3eb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:02.992245 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80862e14-fe24-4cc7-b1ad-85f8edc3eb9e None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:02.992612 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80862e14-fe24-4cc7-b1ad-85f8edc3eb9e None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:02.992951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80862e14-fe24-4cc7-b1ad-85f8edc3eb9e None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:02.993761 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80862e14-fe24-4cc7-b1ad-85f8edc3eb9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:02.994165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80862e14-fe24-4cc7-b1ad-85f8edc3eb9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:02.995696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80862e14-fe24-4cc7-b1ad-85f8edc3eb9e None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:03.009057 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 353/696] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:39:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:03.010479 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221ff5c-a45e-4321-82da-ef0bfb143854 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:03.010861 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221ff5c-a45e-4321-82da-ef0bfb143854 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:03.011201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221ff5c-a45e-4321-82da-ef0bfb143854 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:03.017774 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 354/697] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:03.018845 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221ff5c-a45e-4321-82da-ef0bfb143854 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:03.029330 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f2732-f6b9-4e26-91d2-b93e995dd233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:03.029952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2732-f6b9-4e26-91d2-b93e995dd233 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:03.030601 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2732-f6b9-4e26-91d2-b93e995dd233 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:03.030887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f2732-f6b9-4e26-91d2-b93e995dd233 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:03.031627 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f2732-f6b9-4e26-91d2-b93e995dd233 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:03.032251 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f2732-f6b9-4e26-91d2-b93e995dd233 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:03.034149 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f2732-f6b9-4e26-91d2-b93e995dd233 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:03.057009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 344/698] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Sep 6 22:39:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:03.058605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63458117-a2e5-44d3-842d-576a066c66c5 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:03.058968 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63458117-a2e5-44d3-842d-576a066c66c5 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:03.059845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63458117-a2e5-44d3-842d-576a066c66c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:03.068816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:03.081328 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-63458117-a2e5-44d3-842d-576a066c66c5 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:03.082346 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:03.082687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-63458117-a2e5-44d3-842d-576a066c66c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:03.145180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221ff5c-a45e-4321-82da-ef0bfb143854 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:03.160701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 345/699] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:39:03.161757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63458117-a2e5-44d3-842d-576a066c66c5 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:03.180390 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ed85f-c939-4a7e-9ae3-878e4c8c3f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:03.181026 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ed85f-c939-4a7e-9ae3-878e4c8c3f79 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:03.181303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ed85f-c939-4a7e-9ae3-878e4c8c3f79 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:03.181571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ed85f-c939-4a7e-9ae3-878e4c8c3f79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:03.182388 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ed85f-c939-4a7e-9ae3-878e4c8c3f79 None admin] RBAC: Adding query filter params (role.id=85bcc17628d742209f79cc936d4290b5, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=660248a90f524a43b143bae127e0eaa1) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:03.182695 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ed85f-c939-4a7e-9ae3-878e4c8c3f79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:03.184921 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ed85f-c939-4a7e-9ae3-878e4c8c3f79 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:03.192762 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 355/700] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:39:03 2022] GET /identity/v3/role_assignments?user.id=660248a90f524a43b143bae127e0eaa1&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=85bcc17628d742209f79cc936d4290b5 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:03.345459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63458117-a2e5-44d3-842d-576a066c66c5 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:03.373265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:03.395715 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68684ea9-9018-41bb-b41c-e1da26457b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:03.396398 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68684ea9-9018-41bb-b41c-e1da26457b02 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:03.396700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68684ea9-9018-41bb-b41c-e1da26457b02 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:03.396974 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68684ea9-9018-41bb-b41c-e1da26457b02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:03.479146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68684ea9-9018-41bb-b41c-e1da26457b02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:03.480647 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68684ea9-9018-41bb-b41c-e1da26457b02 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:03.551308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ed85f-c939-4a7e-9ae3-878e4c8c3f79 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:03.608593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 346/701] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:39:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:39:03.611883 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68684ea9-9018-41bb-b41c-e1da26457b02 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:03.635237 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:03.673509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ed85f-c939-4a7e-9ae3-878e4c8c3f79 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:03.685656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:03.718089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5ea22-d30c-4111-9576-5f71d9fe5724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:03.719557 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5ea22-d30c-4111-9576-5f71d9fe5724 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:03.720002 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5ea22-d30c-4111-9576-5f71d9fe5724 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:03.720529 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5ea22-d30c-4111-9576-5f71d9fe5724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:03.735662 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5ea22-d30c-4111-9576-5f71d9fe5724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:03.738164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5ea22-d30c-4111-9576-5f71d9fe5724 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:03.740604 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68684ea9-9018-41bb-b41c-e1da26457b02 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:03.757649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-c8b5ea22-d30c-4111-9576-5f71d9fe5724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:03.757649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:03.757649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:03.757649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:03.757649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:03.757649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:03.757649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:03.757649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:03.757649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:03.757649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:03.757649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:03.757649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:03.757649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:03.757649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:03.757649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:03.757649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:03.758827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:03.758827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:03.758827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:03.758827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:03.758827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:03.758827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:03.758827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:03.758827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:03.758827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:03.758827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:03.758827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:03.758827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:03.758827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:03.758827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:03.758827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:03.758827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:03.758827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:03.759999 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:03.759999 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:03.759999 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:03.762216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 356/702] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:03.769345 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5ea22-d30c-4111-9576-5f71d9fe5724 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:03.790313 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb4e72-d87e-4a76-94eb-1bfb9f664dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:03.791090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb4e72-d87e-4a76-94eb-1bfb9f664dcb None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:03.791482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb4e72-d87e-4a76-94eb-1bfb9f664dcb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:03.791944 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb4e72-d87e-4a76-94eb-1bfb9f664dcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:03.803896 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb4e72-d87e-4a76-94eb-1bfb9f664dcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:03.805853 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb4e72-d87e-4a76-94eb-1bfb9f664dcb None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:03.823394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-b2fb4e72-d87e-4a76-94eb-1bfb9f664dcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:03.823394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:03.823394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:03.823394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:03.823394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:03.823394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:03.823394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:03.823394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:03.823394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:03.823394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:03.823394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:03.823394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:03.823394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:03.823394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:03.823394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:03.823394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:03.824587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:03.824587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:03.824587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:03.824587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:03.824587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:03.824587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:03.824587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:03.824587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:03.824587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:03.824587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:03.824587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:03.824587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:03.824587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:03.824587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:03.824587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:03.824587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:03.824587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:03.825729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:03.825729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:03.825729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:03.831823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 347/703] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:03.833881 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb4e72-d87e-4a76-94eb-1bfb9f664dcb None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:03.907547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5ea22-d30c-4111-9576-5f71d9fe5724 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:03.921370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:03.949130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc253f71-ac31-48d7-a1f9-475d20d6f4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:03.950206 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc253f71-ac31-48d7-a1f9-475d20d6f4d0 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:03.950685 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc253f71-ac31-48d7-a1f9-475d20d6f4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:03.951163 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc253f71-ac31-48d7-a1f9-475d20d6f4d0 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:03.952026 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc253f71-ac31-48d7-a1f9-475d20d6f4d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:03.952555 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc253f71-ac31-48d7-a1f9-475d20d6f4d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:03.953721 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb4e72-d87e-4a76-94eb-1bfb9f664dcb None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:03.954534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc253f71-ac31-48d7-a1f9-475d20d6f4d0 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:03.970521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 357/704] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:03.982827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc253f71-ac31-48d7-a1f9-475d20d6f4d0 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:03.995893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3a835-4eb9-4d82-827d-b3337642d3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:03.996538 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3a835-4eb9-4d82-827d-b3337642d3ec None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:03.996895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3a835-4eb9-4d82-827d-b3337642d3ec None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:03.997191 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3a835-4eb9-4d82-827d-b3337642d3ec None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:03.997825 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3a835-4eb9-4d82-827d-b3337642d3ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:03.998126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3a835-4eb9-4d82-827d-b3337642d3ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:04.000014 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3a835-4eb9-4d82-827d-b3337642d3ec None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:04.016142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 348/705] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:04.016142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df70364-9541-4833-870c-89faf86e7357 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:04.016142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df70364-9541-4833-870c-89faf86e7357 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:04.016142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df70364-9541-4833-870c-89faf86e7357 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:04.016142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 349/706] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:04.022740 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419d0e7-cd6b-4427-98fd-6cd74a3ec3ae None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:04.023503 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:04.024162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419d0e7-cd6b-4427-98fd-6cd74a3ec3ae None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:04.024688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419d0e7-cd6b-4427-98fd-6cd74a3ec3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:04.050823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c419d0e7-cd6b-4427-98fd-6cd74a3ec3ae None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:04.052646 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c419d0e7-cd6b-4427-98fd-6cd74a3ec3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:04.118023 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc253f71-ac31-48d7-a1f9-475d20d6f4d0 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:04.143751 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 350/707] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:39:04.144953 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419d0e7-cd6b-4427-98fd-6cd74a3ec3ae None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:04.169759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78312839-fe4b-45b0-9625-189e2c1b4741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:04.170317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78312839-fe4b-45b0-9625-189e2c1b4741 None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:04.170665 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78312839-fe4b-45b0-9625-189e2c1b4741 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:04.170950 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78312839-fe4b-45b0-9625-189e2c1b4741 None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:04.171663 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78312839-fe4b-45b0-9625-189e2c1b4741 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:04.173181 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78312839-fe4b-45b0-9625-189e2c1b4741 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:04.209598 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:04.251160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419d0e7-cd6b-4427-98fd-6cd74a3ec3ae None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:04.267094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 358/708] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Sep 6 22:39:03 2022] POST /identity/v3/users => generated 254 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:39:04.289528 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011db1a5-f376-427f-be68-9607afaf1345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:04.297500 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011db1a5-f376-427f-be68-9607afaf1345 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:04.298029 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011db1a5-f376-427f-be68-9607afaf1345 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:04.298475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011db1a5-f376-427f-be68-9607afaf1345 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:04.306733 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011db1a5-f376-427f-be68-9607afaf1345 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:04.310847 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011db1a5-f376-427f-be68-9607afaf1345 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:04.323709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-011db1a5-f376-427f-be68-9607afaf1345 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:04.323709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:04.323709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:04.323709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:04.323709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:04.323709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:04.323709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:04.323709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:04.323709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:04.323709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:04.323709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:04.323709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:04.323709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:39:04.323709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:39:04.323709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:39:04.329028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:39:04.329028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:04.329028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:04.329028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:04.329028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:04.329028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:04.329028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:04.329028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:04.329028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:04.329028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:04.329028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:04.329028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:04.329028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:04.329028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:04.329028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:04.329028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:04.329028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:04.330401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:39:04.330401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:39:04.330401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:39:04.330401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:39:04.330401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:39:04.330401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:39:04.330401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:04.330401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:04.333644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 351/709] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:04.339605 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78312839-fe4b-45b0-9625-189e2c1b4741 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:04.468361 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:04.486551 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011db1a5-f376-427f-be68-9607afaf1345 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:04.500508 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78312839-fe4b-45b0-9625-189e2c1b4741 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:04.557100 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f50104-337d-4ae6-a502-1bcee297da30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:04.557331 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f50104-337d-4ae6-a502-1bcee297da30 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:04.557565 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f50104-337d-4ae6-a502-1bcee297da30 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:04.557803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f50104-337d-4ae6-a502-1bcee297da30 None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:04.558502 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f50104-337d-4ae6-a502-1bcee297da30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:04.558803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f50104-337d-4ae6-a502-1bcee297da30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:04.561830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f50104-337d-4ae6-a502-1bcee297da30 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:04.578573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 359/710] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:39:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:04.581271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c70a2-ca2d-40d0-ad56-46d5432cf853 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:04.581754 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c70a2-ca2d-40d0-ad56-46d5432cf853 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:04.582210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c70a2-ca2d-40d0-ad56-46d5432cf853 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:04.583604 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 360/711] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:04.585360 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c70a2-ca2d-40d0-ad56-46d5432cf853 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:04.639265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011db1a5-f376-427f-be68-9607afaf1345 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:04.663544 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:04.690019 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60effab9-1218-4126-b6b9-4208b0ef1eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:04.690932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60effab9-1218-4126-b6b9-4208b0ef1eef None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:04.691751 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60effab9-1218-4126-b6b9-4208b0ef1eef None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:04.692039 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60effab9-1218-4126-b6b9-4208b0ef1eef None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:04.692980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60effab9-1218-4126-b6b9-4208b0ef1eef None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:04.694657 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60effab9-1218-4126-b6b9-4208b0ef1eef None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:04.711063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-60effab9-1218-4126-b6b9-4208b0ef1eef None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 22:39:04.711063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:04.711063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:04.711063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:04.711063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:04.711063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:04.711063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:04.711063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:04.711063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 22:39:04.711063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:04.711063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:04.711063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:04.711063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:04.711063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:04.711063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:04.711063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:04.711063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:04.712126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:04.712126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:04.712126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:04.712126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:04.712126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:04.712126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:04.712126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:04.712126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:04.712126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:04.712126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:04.712126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:04.712126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:04.712126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:04.712126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:04.712126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:04.712126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:04.713022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:04.713022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:04.713022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:04.713022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:04.713022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:04.713022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:04.713022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:04.713022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:04.713022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:04.713022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:04.713022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:04.713022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:04.713022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 22:39:04.713022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:04.713898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c70a2-ca2d-40d0-ad56-46d5432cf853 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:04.713998 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 352/712] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Sep 6 22:39:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:04.715112 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e29d0-761d-4f71-85d8-a932a2d3da35 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:04.715408 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e29d0-761d-4f71-85d8-a932a2d3da35 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:04.715696 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e29d0-761d-4f71-85d8-a932a2d3da35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:04.740068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c72e29d0-761d-4f71-85d8-a932a2d3da35 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:04.741929 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c72e29d0-761d-4f71-85d8-a932a2d3da35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:04.748594 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfaf7d-ec3e-4d8b-8a0f-789bda9f2b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:04.749321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfaf7d-ec3e-4d8b-8a0f-789bda9f2b66 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:04.749697 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfaf7d-ec3e-4d8b-8a0f-789bda9f2b66 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:04.750065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfaf7d-ec3e-4d8b-8a0f-789bda9f2b66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:04.750887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfaf7d-ec3e-4d8b-8a0f-789bda9f2b66 None admin] RBAC: Adding query filter params (role.id=aa2332d1bdb74e48a88ed7c2a7ed2990, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=b18fd296138349408613004929144e70) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:04.751291 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfaf7d-ec3e-4d8b-8a0f-789bda9f2b66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:04.752850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfaf7d-ec3e-4d8b-8a0f-789bda9f2b66 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:04.758992 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 361/713] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:39:04 2022] GET /identity/v3/role_assignments?user.id=b18fd296138349408613004929144e70&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:04.765493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfaf7d-ec3e-4d8b-8a0f-789bda9f2b66 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:04.771504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:04.854587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 353/714] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:39:04.967856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfaf7d-ec3e-4d8b-8a0f-789bda9f2b66 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:05.005909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356bdba-e726-41e9-8a48-f028881643f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:05.006518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356bdba-e726-41e9-8a48-f028881643f7 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:05.006794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356bdba-e726-41e9-8a48-f028881643f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:05.007091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356bdba-e726-41e9-8a48-f028881643f7 None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:05.007697 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356bdba-e726-41e9-8a48-f028881643f7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:05.007996 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356bdba-e726-41e9-8a48-f028881643f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:05.009382 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356bdba-e726-41e9-8a48-f028881643f7 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:05.014256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 362/715] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Sep 6 22:39:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:05.019521 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e29d0-761d-4f71-85d8-a932a2d3da35 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:05.135982 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e29d0-761d-4f71-85d8-a932a2d3da35 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:05.137406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356bdba-e726-41e9-8a48-f028881643f7 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:05.176800 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:05.213321 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433315a-df09-49b0-b9d8-161e74c1a06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:05.214316 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433315a-df09-49b0-b9d8-161e74c1a06e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:05.217110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433315a-df09-49b0-b9d8-161e74c1a06e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:05.217596 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433315a-df09-49b0-b9d8-161e74c1a06e None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:05.218443 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433315a-df09-49b0-b9d8-161e74c1a06e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:05.218951 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433315a-df09-49b0-b9d8-161e74c1a06e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:05.220689 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433315a-df09-49b0-b9d8-161e74c1a06e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:05.235263 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 354/716] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Sep 6 22:39:05 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:05.277284 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:05.336769 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356bdba-e726-41e9-8a48-f028881643f7 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:05.379907 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18634667-1bb4-4189-95e2-07aace632f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:05.380595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18634667-1bb4-4189-95e2-07aace632f7b None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:05.380878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18634667-1bb4-4189-95e2-07aace632f7b None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:05.381149 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18634667-1bb4-4189-95e2-07aace632f7b None admin] PATH_INFO: `/v3/services/network` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:05.381805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18634667-1bb4-4189-95e2-07aace632f7b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:05.383229 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18634667-1bb4-4189-95e2-07aace632f7b None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:05.394807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-18634667-1bb4-4189-95e2-07aace632f7b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 22:39:05.394807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:05.394807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:05.394807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:05.394807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:05.394807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:05.394807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:05.394807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:05.394807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 22:39:05.394807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:05.394807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:05.394807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:05.394807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:05.394807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:05.394807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:05.394807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:05.394807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:05.395901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:05.395901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:05.395901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:05.395901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:05.395901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:05.395901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:05.395901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:05.395901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:05.395901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:05.395901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:05.395901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:05.395901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:05.395901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:05.395901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:05.395901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:05.395901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:05.396804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:05.396804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:05.396804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:05.396804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:05.396804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:05.396804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:05.396804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:05.396804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:05.396804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:05.396804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:05.396804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:05.396804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:05.396804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 22:39:05.396804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:05.396804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 363/717] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:05 2022] GET /identity/v3/services/network => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:05.404924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433315a-df09-49b0-b9d8-161e74c1a06e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:05.536682 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433315a-df09-49b0-b9d8-161e74c1a06e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:05.577431 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9a242-6a45-450b-8213-1db8e7ee3e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:05.578502 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9a242-6a45-450b-8213-1db8e7ee3e8b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:05.578991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9a242-6a45-450b-8213-1db8e7ee3e8b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:05.579486 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9a242-6a45-450b-8213-1db8e7ee3e8b None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:05.580688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9a242-6a45-450b-8213-1db8e7ee3e8b None admin] RBAC: Adding query filter params (name=network) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:05.581213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9a242-6a45-450b-8213-1db8e7ee3e8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:05.584550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9a242-6a45-450b-8213-1db8e7ee3e8b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:05.590061 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 355/718] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Sep 6 22:39:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:05.597065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18634667-1bb4-4189-95e2-07aace632f7b None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:05.703219 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18634667-1bb4-4189-95e2-07aace632f7b None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:05.734803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:05.741281 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfeddb-fd2f-4e9b-b625-a08f9ec6515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:05.742171 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfeddb-fd2f-4e9b-b625-a08f9ec6515d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:05.742680 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfeddb-fd2f-4e9b-b625-a08f9ec6515d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:05.743154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfeddb-fd2f-4e9b-b625-a08f9ec6515d None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:05.744004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfeddb-fd2f-4e9b-b625-a08f9ec6515d None admin] RBAC: Adding query filter params (type=network) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:05.744550 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfeddb-fd2f-4e9b-b625-a08f9ec6515d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:05.746293 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfeddb-fd2f-4e9b-b625-a08f9ec6515d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:05.752828 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 364/719] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Sep 6 22:39:05 2022] GET /identity/v3/services?type=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:06.104746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752845de-4d9d-428f-9dd4-7e3924a093b7 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:06.105277 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752845de-4d9d-428f-9dd4-7e3924a093b7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:06.105277 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752845de-4d9d-428f-9dd4-7e3924a093b7 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:06.106872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 356/720] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:06.112858 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03161e8-9ecd-401c-960c-d7a1a6a87f31 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:06.113585 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03161e8-9ecd-401c-960c-d7a1a6a87f31 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:06.113585 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03161e8-9ecd-401c-960c-d7a1a6a87f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:06.145676 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-a03161e8-9ecd-401c-960c-d7a1a6a87f31 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:06.146880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-a03161e8-9ecd-401c-960c-d7a1a6a87f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:06.236354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 365/721] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:39:06.628654 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752845de-4d9d-428f-9dd4-7e3924a093b7 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:06.688322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:06.759995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752845de-4d9d-428f-9dd4-7e3924a093b7 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:06.795090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9886c-cf61-4f44-b804-746cac8e38ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:06.795742 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9886c-cf61-4f44-b804-746cac8e38ac None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:06.796024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9886c-cf61-4f44-b804-746cac8e38ac None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:06.796297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9886c-cf61-4f44-b804-746cac8e38ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:06.806935 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9886c-cf61-4f44-b804-746cac8e38ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:39:06.812284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-e0a9886c-cf61-4f44-b804-746cac8e38ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:39:06.812284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:06.812284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:06.812284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:06.812284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:06.812284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:06.812284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:06.812284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:06.812284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:06.812284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:06.812284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:06.812284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:06.812284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:39:06.812284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:39:06.812284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:39:06.812284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:39:06.813272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:39:06.813272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:39:06.813272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:39:06.813272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:39:06.813272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:06.813272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:06.813272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:06.813272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:06.813272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:06.813272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:06.813272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:06.813272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:06.813272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:06.813272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:06.813272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:06.813272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:06.814519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:06.814519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:06.814519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:06.814519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:06.814519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:39:06.814519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:39:06.814519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:39:06.814519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:39:06.814519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:39:06.814519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:39:06.814519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:39:06.814519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:06.814519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 357/722] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:39:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:06.819592 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03161e8-9ecd-401c-960c-d7a1a6a87f31 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:06.925216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03161e8-9ecd-401c-960c-d7a1a6a87f31 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:06.950381 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:06.961735 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decfe0a-b553-4f15-992b-a2f01c346e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:06.962365 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decfe0a-b553-4f15-992b-a2f01c346e54 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:06.962646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decfe0a-b553-4f15-992b-a2f01c346e54 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:06.962985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decfe0a-b553-4f15-992b-a2f01c346e54 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:06.963661 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decfe0a-b553-4f15-992b-a2f01c346e54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:06.964018 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decfe0a-b553-4f15-992b-a2f01c346e54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:06.966320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decfe0a-b553-4f15-992b-a2f01c346e54 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:06.975636 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 366/723] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:39:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:06.982119 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9886c-cf61-4f44-b804-746cac8e38ac None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:07.111868 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9886c-cf61-4f44-b804-746cac8e38ac None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:07.114285 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:07.167564 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6eef8-34ad-40a1-8c84-04d7b9a04041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:07.168624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6eef8-34ad-40a1-8c84-04d7b9a04041 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:07.169135 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6eef8-34ad-40a1-8c84-04d7b9a04041 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:07.169587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6eef8-34ad-40a1-8c84-04d7b9a04041 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:07.186430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6eef8-34ad-40a1-8c84-04d7b9a04041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:07.188110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6eef8-34ad-40a1-8c84-04d7b9a04041 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:07.207060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-bfc6eef8-34ad-40a1-8c84-04d7b9a04041 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:07.207060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:07.207060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:07.207060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:07.207060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:07.207060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:07.207060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:07.207060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:07.207060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:07.207060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:07.207060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:07.207060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:07.207060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:07.207060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:07.207060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:07.207060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:07.208102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:07.208102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:07.208102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:07.208102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:07.208102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:07.208102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:07.208102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:07.208102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:07.208102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:07.208102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:07.208102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:07.208102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:07.208102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:07.208102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:07.208102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:07.208102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:07.208102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:07.209056 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:07.209056 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:07.209056 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:07.210551 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 358/724] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:07.216901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decfe0a-b553-4f15-992b-a2f01c346e54 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:07.250023 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74f6c-4227-4deb-a003-0626c82a5275 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:07.250539 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74f6c-4227-4deb-a003-0626c82a5275 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:07.250963 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74f6c-4227-4deb-a003-0626c82a5275 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:07.252454 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 359/725] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:39:07.257307 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e599a-6460-4ba8-8689-92479a0fdbea None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:07.257776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e599a-6460-4ba8-8689-92479a0fdbea None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:07.258230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e599a-6460-4ba8-8689-92479a0fdbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:07.284810 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-601e599a-6460-4ba8-8689-92479a0fdbea None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:07.287418 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-601e599a-6460-4ba8-8689-92479a0fdbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:07.372690 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decfe0a-b553-4f15-992b-a2f01c346e54 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:07.414235 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc12d9d-970d-432c-afde-bf4c287f14fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:07.414922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc12d9d-970d-432c-afde-bf4c287f14fc None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:07.415204 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc12d9d-970d-432c-afde-bf4c287f14fc None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:07.415479 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc12d9d-970d-432c-afde-bf4c287f14fc None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:07.416178 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc12d9d-970d-432c-afde-bf4c287f14fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:07.416559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc12d9d-970d-432c-afde-bf4c287f14fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:07.417957 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc12d9d-970d-432c-afde-bf4c287f14fc None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:07.434944 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 367/726] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:07.436515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81942ea-56a2-4399-95d9-0f349eadabec None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:07.437006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81942ea-56a2-4399-95d9-0f349eadabec None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:07.437496 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81942ea-56a2-4399-95d9-0f349eadabec None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:07.443234 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 368/727] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:07.443234 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81942ea-56a2-4399-95d9-0f349eadabec None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:07.447168 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 360/728] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:39:07.448826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a103c-16b7-470f-abbe-fc1743564eda None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:07.448962 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a103c-16b7-470f-abbe-fc1743564eda None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:07.449192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a103c-16b7-470f-abbe-fc1743564eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:07.468127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-1f5a103c-16b7-470f-abbe-fc1743564eda None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:07.469435 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1f5a103c-16b7-470f-abbe-fc1743564eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:07.513210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:07.549754 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 361/729] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:39:07.586307 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81942ea-56a2-4399-95d9-0f349eadabec None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:07.634449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5e1e7-ab30-4320-a9b3-8140f5ea5c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:07.635488 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e1e7-ab30-4320-a9b3-8140f5ea5c61 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:07.635975 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e1e7-ab30-4320-a9b3-8140f5ea5c61 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:07.636499 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e1e7-ab30-4320-a9b3-8140f5ea5c61 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:07.648614 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5e1e7-ab30-4320-a9b3-8140f5ea5c61 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:07.650308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5e1e7-ab30-4320-a9b3-8140f5ea5c61 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:07.663896 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-15c5e1e7-ab30-4320-a9b3-8140f5ea5c61 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 22:39:07.663896 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:07.663896 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:07.663896 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:07.663896 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:07.663896 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:07.663896 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:07.663896 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:07.663896 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:07.663896 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:07.663896 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:07.663896 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:07.663896 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:39:07.663896 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:39:07.663896 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:39:07.663896 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:39:07.664919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:07.664919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:07.664919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:39:07.664919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:07.664919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:39:07.664919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:07.664919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:07.664919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:07.664919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:07.664919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:07.664919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:07.664919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:07.664919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:07.664919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:07.664919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:07.664919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:07.664919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:07.664919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:07.665898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:07.665898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:07.665898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:39:07.665898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:39:07.665898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:39:07.665898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:39:07.665898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:39:07.665898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:39:07.665898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 22:39:07.665898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:07.668479 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 369/730] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:39:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:07.674387 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a103c-16b7-470f-abbe-fc1743564eda None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:07.695501 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:07.811308 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a103c-16b7-470f-abbe-fc1743564eda None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:07.855502 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41253840-4824-4b5f-98a0-f29cdf7dca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:07.856711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41253840-4824-4b5f-98a0-f29cdf7dca53 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:07.856991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41253840-4824-4b5f-98a0-f29cdf7dca53 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:07.857263 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41253840-4824-4b5f-98a0-f29cdf7dca53 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:07.858017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41253840-4824-4b5f-98a0-f29cdf7dca53 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:07.858319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41253840-4824-4b5f-98a0-f29cdf7dca53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:07.859806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41253840-4824-4b5f-98a0-f29cdf7dca53 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:07.878982 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 362/731] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Sep 6 22:39:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:07.884279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5e1e7-ab30-4320-a9b3-8140f5ea5c61 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:07.902182 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41253840-4824-4b5f-98a0-f29cdf7dca53 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:07.984905 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:08.027241 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5e1e7-ab30-4320-a9b3-8140f5ea5c61 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:08.036917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:08.064086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41253840-4824-4b5f-98a0-f29cdf7dca53 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:08.064409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b1072-b99e-4bee-bbcc-62d2523db58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:08.067613 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b1072-b99e-4bee-bbcc-62d2523db58e None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:08.067613 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b1072-b99e-4bee-bbcc-62d2523db58e None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:08.067613 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b1072-b99e-4bee-bbcc-62d2523db58e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:08.109159 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f5c82-8c95-4a73-9d29-53a8a10c4bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:08.109794 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f5c82-8c95-4a73-9d29-53a8a10c4bdb None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:08.110069 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f5c82-8c95-4a73-9d29-53a8a10c4bdb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:08.110455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f5c82-8c95-4a73-9d29-53a8a10c4bdb None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:08.122485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f5c82-8c95-4a73-9d29-53a8a10c4bdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:39:08.127725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-278f5c82-8c95-4a73-9d29-53a8a10c4bdb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:39:08.127725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:08.127725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:08.127725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:08.127725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:08.127725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:08.127725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:08.127725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:08.127725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:08.127725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:08.127725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:08.127725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:08.127725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:39:08.127725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:39:08.127725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:39:08.127725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:39:08.128705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:39:08.128705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:39:08.128705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:39:08.128705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:39:08.128705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:08.128705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:08.128705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:08.128705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:08.128705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:08.128705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:08.128705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:08.128705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:08.128705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:08.128705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:08.128705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:08.128705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:08.129567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:08.129567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:08.129567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:08.129567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:08.129567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:39:08.129567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:39:08.129567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:39:08.129567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:39:08.129567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:39:08.129567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:39:08.129567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:39:08.129567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:08.129567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 363/732] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:39:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:08.130283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f5c82-8c95-4a73-9d29-53a8a10c4bdb None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:08.145398 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b1072-b99e-4bee-bbcc-62d2523db58e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:08.146849 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b1072-b99e-4bee-bbcc-62d2523db58e None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:08.234865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f5c82-8c95-4a73-9d29-53a8a10c4bdb None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:08.251139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 370/733] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:39:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 22:39:08.251139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cb04e-4e5b-4cf8-94d0-6e92b280e0df None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:08.251139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cb04e-4e5b-4cf8-94d0-6e92b280e0df None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:08.251139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cb04e-4e5b-4cf8-94d0-6e92b280e0df None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:08.251139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 371/734] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:08.251139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1cb04e-4e5b-4cf8-94d0-6e92b280e0df None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:08.260230 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:08.273954 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:08.279821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9484c-440e-48d3-b4b8-8bbb84100503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:08.280482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9484c-440e-48d3-b4b8-8bbb84100503 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:08.280763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9484c-440e-48d3-b4b8-8bbb84100503 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:08.281115 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9484c-440e-48d3-b4b8-8bbb84100503 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:08.291319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9484c-440e-48d3-b4b8-8bbb84100503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:39:08.296821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-69d9484c-440e-48d3-b4b8-8bbb84100503 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:39:08.296821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:08.296821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:08.296821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:08.296821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:08.296821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:08.296821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:08.296821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:08.296821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:08.296821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:08.296821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:08.296821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:08.296821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:39:08.296821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:39:08.296821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:39:08.296821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:39:08.303729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:39:08.303729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:39:08.303729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:39:08.303729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:39:08.303729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:08.303729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:08.303729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:08.303729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:08.303729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:08.303729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:08.303729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:08.303729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:08.303729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:08.303729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:08.303729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:08.303729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:08.304658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:08.304658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:08.304658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:08.304658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:08.304658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:39:08.304658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:39:08.304658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:39:08.304658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:39:08.304658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:39:08.304658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:39:08.304658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:39:08.304658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:08.304658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 364/735] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:39:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:08.304658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9484c-440e-48d3-b4b8-8bbb84100503 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:08.360867 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1cb04e-4e5b-4cf8-94d0-6e92b280e0df None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:08.395853 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052c041-2752-4f18-9e94-cf38f0c2622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:08.396495 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052c041-2752-4f18-9e94-cf38f0c2622d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:08.396781 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052c041-2752-4f18-9e94-cf38f0c2622d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:08.397052 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052c041-2752-4f18-9e94-cf38f0c2622d None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:08.397721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052c041-2752-4f18-9e94-cf38f0c2622d None admin] RBAC: Adding query filter params (name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:08.398043 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052c041-2752-4f18-9e94-cf38f0c2622d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:08.399373 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052c041-2752-4f18-9e94-cf38f0c2622d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:08.408193 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 372/736] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:39:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:08.409197 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124884df-86e2-4a5d-9917-648d3b1b029d None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:08.409484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124884df-86e2-4a5d-9917-648d3b1b029d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:08.409759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124884df-86e2-4a5d-9917-648d3b1b029d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:08.414717 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9484c-440e-48d3-b4b8-8bbb84100503 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:08.428529 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-124884df-86e2-4a5d-9917-648d3b1b029d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:08.429713 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-124884df-86e2-4a5d-9917-648d3b1b029d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:08.451644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64481341-86af-461e-bffc-f827887de350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:08.452698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64481341-86af-461e-bffc-f827887de350 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:08.453187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64481341-86af-461e-bffc-f827887de350 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:08.453663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64481341-86af-461e-bffc-f827887de350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:08.464830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64481341-86af-461e-bffc-f827887de350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:08.466967 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64481341-86af-461e-bffc-f827887de350 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:08.483229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-64481341-86af-461e-bffc-f827887de350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:08.483229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:08.483229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:08.483229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:08.483229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:08.483229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:08.483229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:08.483229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:08.483229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:08.483229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:08.483229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:08.483229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:08.483229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:08.483229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:08.483229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:08.483229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:08.484390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:08.484390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:08.484390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:08.484390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:08.484390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:08.484390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:08.484390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:08.484390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:08.484390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:08.484390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:08.484390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:08.484390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:08.484390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:08.484390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:08.484390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:08.484390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:08.484390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:08.485379 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:08.485379 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:08.485379 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:08.485796 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 365/737] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:08.486443 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64481341-86af-461e-bffc-f827887de350 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:08.495739 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:08.501573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 373/738] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:39:08.502316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124884df-86e2-4a5d-9917-648d3b1b029d None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:08.568643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:08.624199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124884df-86e2-4a5d-9917-648d3b1b029d None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:08.645715 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64481341-86af-461e-bffc-f827887de350 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:08.663204 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fe668-872e-4cfe-b49b-a5dc140b7d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:08.663925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fe668-872e-4cfe-b49b-a5dc140b7d06 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:08.664276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fe668-872e-4cfe-b49b-a5dc140b7d06 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:08.664652 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fe668-872e-4cfe-b49b-a5dc140b7d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:08.675550 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fe668-872e-4cfe-b49b-a5dc140b7d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:08.677181 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fe668-872e-4cfe-b49b-a5dc140b7d06 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:08.690048 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ec067-16b3-4881-82d0-45331abde077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:08.690664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ec067-16b3-4881-82d0-45331abde077 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:08.690945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ec067-16b3-4881-82d0-45331abde077 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:08.691221 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ec067-16b3-4881-82d0-45331abde077 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:08.691901 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ec067-16b3-4881-82d0-45331abde077 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:08.692207 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ec067-16b3-4881-82d0-45331abde077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:08.693165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-ba4fe668-872e-4cfe-b49b-a5dc140b7d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:08.693165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:08.693165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:08.693165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:08.693165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:08.693165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:08.693165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:08.693165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:08.693165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:08.693165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:08.693165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:08.693165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:08.693165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:08.693165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:08.693165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:08.693165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:08.694086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:08.694086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:08.694086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:08.694086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:08.694086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:08.694086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:08.694086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:08.694086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:08.694086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:08.694086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:08.694086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:08.694086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:08.694086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:08.694086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:08.694086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:08.694086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:08.694086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:08.694987 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:08.694987 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:08.694987 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:08.695177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ec067-16b3-4881-82d0-45331abde077 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:08.695249 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 374/739] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:08.695412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fe668-872e-4cfe-b49b-a5dc140b7d06 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:08.709224 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 366/740] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:39:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:08.710650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ec067-16b3-4881-82d0-45331abde077 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:08.754930 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:08.812068 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fe668-872e-4cfe-b49b-a5dc140b7d06 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:08.820708 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ec067-16b3-4881-82d0-45331abde077 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:08.828199 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:08.846371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d1120-d420-4f72-bf29-1fcbe6ffa697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:08.846985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d1120-d420-4f72-bf29-1fcbe6ffa697 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:08.847267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d1120-d420-4f72-bf29-1fcbe6ffa697 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:08.847540 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d1120-d420-4f72-bf29-1fcbe6ffa697 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:08.848182 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d1120-d420-4f72-bf29-1fcbe6ffa697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:08.848512 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d1120-d420-4f72-bf29-1fcbe6ffa697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:08.849923 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d1120-d420-4f72-bf29-1fcbe6ffa697 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:08.855484 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818fe29-44af-4bcd-b31c-444c216f0a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:08.856120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818fe29-44af-4bcd-b31c-444c216f0a9e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:08.856394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818fe29-44af-4bcd-b31c-444c216f0a9e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:08.856699 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818fe29-44af-4bcd-b31c-444c216f0a9e None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:08.857324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818fe29-44af-4bcd-b31c-444c216f0a9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:08.857619 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818fe29-44af-4bcd-b31c-444c216f0a9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:08.858960 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818fe29-44af-4bcd-b31c-444c216f0a9e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:08.861546 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 375/741] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:08.862332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d1120-d420-4f72-bf29-1fcbe6ffa697 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:08.870498 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 367/742] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:08.871723 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60048d6-7367-4e0f-be0f-43c8f0ffa519 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:08.872006 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60048d6-7367-4e0f-be0f-43c8f0ffa519 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:08.872277 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60048d6-7367-4e0f-be0f-43c8f0ffa519 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:08.873487 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 368/743] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:08.874155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60048d6-7367-4e0f-be0f-43c8f0ffa519 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:08.970558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d1120-d420-4f72-bf29-1fcbe6ffa697 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:08.974514 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60048d6-7367-4e0f-be0f-43c8f0ffa519 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:08.981074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:09.004037 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1f428-7959-42e9-8546-f185c51cd690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:09.004902 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1f428-7959-42e9-8546-f185c51cd690 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:09.005241 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1f428-7959-42e9-8546-f185c51cd690 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:09.005529 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1f428-7959-42e9-8546-f185c51cd690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:09.008258 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cafc6c-afe2-4441-8514-27c98b6cb578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:09.008880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cafc6c-afe2-4441-8514-27c98b6cb578 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:09.009158 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cafc6c-afe2-4441-8514-27c98b6cb578 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:09.009428 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cafc6c-afe2-4441-8514-27c98b6cb578 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:09.010074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cafc6c-afe2-4441-8514-27c98b6cb578 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:09.011443 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cafc6c-afe2-4441-8514-27c98b6cb578 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:09.016558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1f428-7959-42e9-8546-f185c51cd690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:09.017973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1f428-7959-42e9-8546-f185c51cd690 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:09.032136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-dab1f428-7959-42e9-8546-f185c51cd690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:09.032136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:09.032136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:09.032136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:09.032136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:09.032136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:09.032136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:09.032136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:09.032136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:09.032136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:09.032136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:09.032136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:09.032136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:09.032136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:09.032136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:09.032136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:09.033323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:09.033323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:09.033323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:09.033323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:09.033323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:09.033323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:09.033323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:09.033323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:09.033323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:09.033323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:09.033323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:09.033323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:09.033323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:09.033323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:09.033323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:09.033323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:09.033323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:09.034421 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:09.034421 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:09.034421 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:09.034421 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 376/744] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:09.034421 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1f428-7959-42e9-8546-f185c51cd690 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:09.086235 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 369/745] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Sep 6 22:39:08 2022] POST /identity/v3/services => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:39:09.087123 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cafc6c-afe2-4441-8514-27c98b6cb578 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:09.122015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:09.142777 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1f428-7959-42e9-8546-f185c51cd690 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:09.197585 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0105f2a-6ee6-4e65-b671-a12ec9ff06d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:09.198393 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0105f2a-6ee6-4e65-b671-a12ec9ff06d4 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:09.198676 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0105f2a-6ee6-4e65-b671-a12ec9ff06d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:09.198947 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0105f2a-6ee6-4e65-b671-a12ec9ff06d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:09.207321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0105f2a-6ee6-4e65-b671-a12ec9ff06d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:09.207700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cafc6c-afe2-4441-8514-27c98b6cb578 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:09.208820 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0105f2a-6ee6-4e65-b671-a12ec9ff06d4 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:09.221292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-d0105f2a-6ee6-4e65-b671-a12ec9ff06d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:09.221292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:09.221292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:09.221292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:09.221292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:09.221292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:09.221292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:09.221292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:09.221292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:09.221292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:09.221292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:09.221292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:09.221292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:39:09.221292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:39:09.221292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:39:09.222369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:39:09.222369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:09.222369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:09.222369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:09.222369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:09.222369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:09.222369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:09.222369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:09.222369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:09.222369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:09.222369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:09.222369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:09.222369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:09.222369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:09.222369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:09.222369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:09.222369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:09.223265 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:39:09.223265 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:39:09.223265 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:39:09.223265 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:39:09.223265 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:39:09.223265 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:39:09.223265 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:09.223265 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:09.223265 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 377/746] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:09.225536 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f0e49-a28b-44d0-90a5-6e35751dd463 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:09.225827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f0e49-a28b-44d0-90a5-6e35751dd463 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:09.226103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f0e49-a28b-44d0-90a5-6e35751dd463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:09.244556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-4e4f0e49-a28b-44d0-90a5-6e35751dd463 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:09.245812 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4e4f0e49-a28b-44d0-90a5-6e35751dd463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:09.254871 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762667c-ed84-4514-8439-bc1c12808ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:09.255724 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762667c-ed84-4514-8439-bc1c12808ac9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:09.256039 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762667c-ed84-4514-8439-bc1c12808ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:09.256410 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762667c-ed84-4514-8439-bc1c12808ac9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:09.262526 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:09.266814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762667c-ed84-4514-8439-bc1c12808ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:09.268263 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762667c-ed84-4514-8439-bc1c12808ac9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:09.283426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-0762667c-ed84-4514-8439-bc1c12808ac9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 22:39:09.283426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:09.283426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:09.283426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:09.283426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:09.283426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:09.283426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:09.283426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:09.283426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:09.283426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:09.283426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:09.283426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:09.283426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:39:09.283426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:39:09.283426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:39:09.283426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:39:09.284550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:09.284550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:09.284550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:39:09.284550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:09.284550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:39:09.284550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:09.284550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:09.284550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:09.284550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:09.284550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:09.284550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:09.284550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:09.284550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:09.284550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:09.284550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:09.284550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:09.284550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:09.284550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:09.285650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:09.285650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:09.285650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:39:09.285650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:39:09.285650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:39:09.285650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:39:09.285650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:39:09.285650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:39:09.285650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 22:39:09.285650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:09.289709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 370/747] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Sep 6 22:39:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:09.290248 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762667c-ed84-4514-8439-bc1c12808ac9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:09.327564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 378/748] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:09 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 22:39:09.328832 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f0e49-a28b-44d0-90a5-6e35751dd463 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:09.408857 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:09.423653 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762667c-ed84-4514-8439-bc1c12808ac9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:09.435907 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f0e49-a28b-44d0-90a5-6e35751dd463 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:09.469761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230c16d-eef3-4f05-a1fc-bc1215998d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:09.470877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230c16d-eef3-4f05-a1fc-bc1215998d9e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:09.471407 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230c16d-eef3-4f05-a1fc-bc1215998d9e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:09.471844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230c16d-eef3-4f05-a1fc-bc1215998d9e None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:09.472651 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230c16d-eef3-4f05-a1fc-bc1215998d9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:09.473228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230c16d-eef3-4f05-a1fc-bc1215998d9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:09.473716 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e23e1-0839-4384-beb8-21211114460a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:09.474438 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e23e1-0839-4384-beb8-21211114460a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:09.474820 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e23e1-0839-4384-beb8-21211114460a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:09.475213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e23e1-0839-4384-beb8-21211114460a None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:09.475518 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230c16d-eef3-4f05-a1fc-bc1215998d9e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:09.476133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e23e1-0839-4384-beb8-21211114460a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:09.476603 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e23e1-0839-4384-beb8-21211114460a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:09.478312 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e23e1-0839-4384-beb8-21211114460a None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:09.491813 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 379/749] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:39:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:09.492267 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 371/750] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:09.497900 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230c16d-eef3-4f05-a1fc-bc1215998d9e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:09.498034 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e23e1-0839-4384-beb8-21211114460a None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:09.509716 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:09.614998 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e23e1-0839-4384-beb8-21211114460a None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:09.633654 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230c16d-eef3-4f05-a1fc-bc1215998d9e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:09.652266 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb08ce-7858-45b7-a534-9d419580b66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:09.653575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb08ce-7858-45b7-a534-9d419580b66d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:09.653919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb08ce-7858-45b7-a534-9d419580b66d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:09.654254 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb08ce-7858-45b7-a534-9d419580b66d None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:09.655058 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb08ce-7858-45b7-a534-9d419580b66d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:09.655430 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb08ce-7858-45b7-a534-9d419580b66d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:09.656986 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb08ce-7858-45b7-a534-9d419580b66d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:09.675270 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 380/751] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Sep 6 22:39:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:09.676156 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb08ce-7858-45b7-a534-9d419580b66d None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:09.678549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93300e-35af-409a-85e6-93a01f66afd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:09.679487 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93300e-35af-409a-85e6-93a01f66afd2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:09.679921 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93300e-35af-409a-85e6-93a01f66afd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:09.680193 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93300e-35af-409a-85e6-93a01f66afd2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:09.688714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93300e-35af-409a-85e6-93a01f66afd2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:09.690727 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93300e-35af-409a-85e6-93a01f66afd2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:09.703107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ce93300e-35af-409a-85e6-93a01f66afd2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 22:39:09.703107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:09.703107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:09.703107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:09.703107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:09.703107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:09.703107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:09.703107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:09.703107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:09.703107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:09.703107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:09.703107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:09.703107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:39:09.703107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:39:09.703107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:39:09.703107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:39:09.704215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:09.704215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:09.704215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:39:09.704215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:09.704215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:39:09.704215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:09.704215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:09.704215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:09.704215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:09.704215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:09.704215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:09.704215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:09.704215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:09.704215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:09.704215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:09.704215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:09.704215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:09.704215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:09.705556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:09.705556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:09.705556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:39:09.705556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:39:09.705556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:39:09.705556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:39:09.705556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:39:09.705556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:39:09.705556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 22:39:09.705556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:09.705556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 372/752] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Sep 6 22:39:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:09.705556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93300e-35af-409a-85e6-93a01f66afd2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:09.717862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:09.752087 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:09.788875 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb08ce-7858-45b7-a534-9d419580b66d None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:09.813506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93300e-35af-409a-85e6-93a01f66afd2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:09.825959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9299ea-fae0-4263-8437-b5facc7e4721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:09.826589 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9299ea-fae0-4263-8437-b5facc7e4721 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:09.826873 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9299ea-fae0-4263-8437-b5facc7e4721 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:09.827146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9299ea-fae0-4263-8437-b5facc7e4721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:09.827897 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9299ea-fae0-4263-8437-b5facc7e4721 None admin] RBAC: Adding query filter params (role.id=aa2332d1bdb74e48a88ed7c2a7ed2990, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=660248a90f524a43b143bae127e0eaa1) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:09.828202 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9299ea-fae0-4263-8437-b5facc7e4721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:09.829663 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9299ea-fae0-4263-8437-b5facc7e4721 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:09.835866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 381/753] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:39:09 2022] GET /identity/v3/role_assignments?user.id=660248a90f524a43b143bae127e0eaa1&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:09.837318 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9299ea-fae0-4263-8437-b5facc7e4721 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:09.851245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32a515-d1e7-4b5c-b8c6-4b4aef44a542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:09.851497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32a515-d1e7-4b5c-b8c6-4b4aef44a542 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:09.851580 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32a515-d1e7-4b5c-b8c6-4b4aef44a542 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:09.851940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32a515-d1e7-4b5c-b8c6-4b4aef44a542 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:09.852733 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32a515-d1e7-4b5c-b8c6-4b4aef44a542 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:09.854266 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32a515-d1e7-4b5c-b8c6-4b4aef44a542 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:09.923017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 373/754] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Sep 6 22:39:09 2022] POST /identity/v3/services => generated 240 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:39:09.924865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32a515-d1e7-4b5c-b8c6-4b4aef44a542 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:09.967142 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9299ea-fae0-4263-8437-b5facc7e4721 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:10.006338 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:10.020688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0919f-7c7f-43fa-b54c-09a41e231c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:10.021710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0919f-7c7f-43fa-b54c-09a41e231c26 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:10.022203 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0919f-7c7f-43fa-b54c-09a41e231c26 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:10.022726 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0919f-7c7f-43fa-b54c-09a41e231c26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:10.024814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:10.079515 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32a515-d1e7-4b5c-b8c6-4b4aef44a542 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:10.124568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc638fe-ccce-43a7-94a5-9a038727be7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:10.125192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc638fe-ccce-43a7-94a5-9a038727be7c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:10.125478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc638fe-ccce-43a7-94a5-9a038727be7c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:10.127373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc638fe-ccce-43a7-94a5-9a038727be7c None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:10.128150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc638fe-ccce-43a7-94a5-9a038727be7c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:10.128592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc638fe-ccce-43a7-94a5-9a038727be7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:10.129536 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0919f-7c7f-43fa-b54c-09a41e231c26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:10.130018 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc638fe-ccce-43a7-94a5-9a038727be7c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:10.131440 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0919f-7c7f-43fa-b54c-09a41e231c26 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:10.151851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 374/755] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Sep 6 22:39:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:10.158317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc638fe-ccce-43a7-94a5-9a038727be7c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:10.273925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 382/756] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:39:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 22:39:10.276703 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0919f-7c7f-43fa-b54c-09a41e231c26 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:10.282052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc638fe-ccce-43a7-94a5-9a038727be7c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:10.308638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:10.311802 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:10.320368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbe1e7-dd67-44cf-ac71-4fe9c40faa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:10.321151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbe1e7-dd67-44cf-ac71-4fe9c40faa07 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:10.322126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbe1e7-dd67-44cf-ac71-4fe9c40faa07 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:10.322126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbe1e7-dd67-44cf-ac71-4fe9c40faa07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:10.333474 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbe1e7-dd67-44cf-ac71-4fe9c40faa07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:10.334870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbe1e7-dd67-44cf-ac71-4fe9c40faa07 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:10.351945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-a7dbe1e7-dd67-44cf-ac71-4fe9c40faa07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:10.351945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:10.351945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:10.351945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:10.351945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:10.351945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:10.351945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:10.351945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:10.351945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:10.351945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:10.351945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:10.351945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:10.351945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:10.351945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:10.351945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:10.351945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:10.353110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:10.353110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:10.353110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:10.353110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:10.353110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:10.353110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:10.353110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:10.353110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:10.353110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:10.353110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:10.353110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:10.353110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:10.353110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:10.353110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:10.353110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:10.353110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:10.353110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:10.354409 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:10.354409 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:10.354409 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:10.354409 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 375/757] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:10.359114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbe1e7-dd67-44cf-ac71-4fe9c40faa07 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:10.416029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0919f-7c7f-43fa-b54c-09a41e231c26 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:10.457355 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57369c-7768-45c6-8f2d-c602b0b31332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:10.458158 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57369c-7768-45c6-8f2d-c602b0b31332 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:10.458442 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57369c-7768-45c6-8f2d-c602b0b31332 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:10.458707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57369c-7768-45c6-8f2d-c602b0b31332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:10.471990 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57369c-7768-45c6-8f2d-c602b0b31332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:10.473869 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57369c-7768-45c6-8f2d-c602b0b31332 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:10.493200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-6f57369c-7768-45c6-8f2d-c602b0b31332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:10.493200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:10.493200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:10.493200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:10.493200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:10.493200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:10.493200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:10.493200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:10.493200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:10.493200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:10.493200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:10.493200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:10.493200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:10.493200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:10.493200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:10.493200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:10.494198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:10.494198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:10.494198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:10.494198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:10.494198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:10.494198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:10.494198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:10.494198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:10.494198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:10.494198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:10.494198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:10.494198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:10.494198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:10.494198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:10.494198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:10.494198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:10.494198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:10.495100 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:10.495100 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:10.495100 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:10.499502 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 383/758] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:10.500774 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57369c-7768-45c6-8f2d-c602b0b31332 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:10.509612 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbe1e7-dd67-44cf-ac71-4fe9c40faa07 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:10.603830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743d529-82f2-4d8c-ab14-4d3813a2e56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:10.604830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743d529-82f2-4d8c-ab14-4d3813a2e56a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:10.605311 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743d529-82f2-4d8c-ab14-4d3813a2e56a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:10.607400 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743d529-82f2-4d8c-ab14-4d3813a2e56a None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:10.608266 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743d529-82f2-4d8c-ab14-4d3813a2e56a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:10.609144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743d529-82f2-4d8c-ab14-4d3813a2e56a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:10.613148 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743d529-82f2-4d8c-ab14-4d3813a2e56a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:10.613942 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:10.644476 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 376/759] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:10.648674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57369c-7768-45c6-8f2d-c602b0b31332 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:10.649396 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743d529-82f2-4d8c-ab14-4d3813a2e56a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:10.695849 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaa8d2-f53b-4d7d-9154-7b36dadf8cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:10.696489 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaa8d2-f53b-4d7d-9154-7b36dadf8cd1 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:10.696820 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaa8d2-f53b-4d7d-9154-7b36dadf8cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:10.697088 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaa8d2-f53b-4d7d-9154-7b36dadf8cd1 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:10.697794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaa8d2-f53b-4d7d-9154-7b36dadf8cd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:10.698094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaa8d2-f53b-4d7d-9154-7b36dadf8cd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:10.700035 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaa8d2-f53b-4d7d-9154-7b36dadf8cd1 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:10.713265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:10.726035 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 384/760] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:10.731534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaa8d2-f53b-4d7d-9154-7b36dadf8cd1 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:10.780699 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743d529-82f2-4d8c-ab14-4d3813a2e56a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:10.867258 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaa8d2-f53b-4d7d-9154-7b36dadf8cd1 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:10.901180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5994d-8e08-4aa5-a0c9-e391d85b3d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:10.901791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5994d-8e08-4aa5-a0c9-e391d85b3d52 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:10.902074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5994d-8e08-4aa5-a0c9-e391d85b3d52 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:10.902378 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5994d-8e08-4aa5-a0c9-e391d85b3d52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:10.907456 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e906a8-97f9-46ed-9b60-397e2e74506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:10.908333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e906a8-97f9-46ed-9b60-397e2e74506a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:10.908872 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e906a8-97f9-46ed-9b60-397e2e74506a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:10.909343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e906a8-97f9-46ed-9b60-397e2e74506a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:10.916958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e906a8-97f9-46ed-9b60-397e2e74506a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:10.917504 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5994d-8e08-4aa5-a0c9-e391d85b3d52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:10.919517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5994d-8e08-4aa5-a0c9-e391d85b3d52 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:10.919753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e906a8-97f9-46ed-9b60-397e2e74506a None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:10.921795 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:10.934196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-42e906a8-97f9-46ed-9b60-397e2e74506a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:10.934196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:10.934196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:10.934196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:10.934196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:10.934196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:10.934196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:10.934196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:10.934196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:10.934196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:10.934196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:10.934196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:10.934196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:39:10.934196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:39:10.934196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:39:10.935152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:39:10.935152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:10.935152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:10.935152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:10.935152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:10.935152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:10.935152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:10.935152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:10.935152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:10.935152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:10.935152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:10.935152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:10.935152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:10.935152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:10.935152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:10.935152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:10.935152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:10.936064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:39:10.936064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:39:10.936064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:39:10.936064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:39:10.936064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:39:10.936064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:39:10.936064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:10.936064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:10.938672 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 385/761] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:10.948597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-95a5994d-8e08-4aa5-a0c9-e391d85b3d52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:10.948597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:10.948597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:10.948597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:10.948597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:10.948597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:10.948597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:10.948597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:10.948597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:10.948597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:10.948597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:10.948597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:10.948597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:39:10.948597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:39:10.948597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:39:10.949497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:39:10.949497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:10.949497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:10.949497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:10.949497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:10.949497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:10.949497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:10.949497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:10.949497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:10.949497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:10.949497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:10.949497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:10.949497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:10.949497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:10.949497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:10.949497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:10.949497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:10.950430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:39:10.950430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:39:10.950430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:39:10.950430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:39:10.950430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:39:10.950430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:39:10.950430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:10.950430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:10.950430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 377/762] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:10.952518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e906a8-97f9-46ed-9b60-397e2e74506a None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:10.952889 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5994d-8e08-4aa5-a0c9-e391d85b3d52 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:11.146126 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e906a8-97f9-46ed-9b60-397e2e74506a None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:11.183935 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de35c0f-f53a-487c-8666-8fed11a07e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:11.184936 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de35c0f-f53a-487c-8666-8fed11a07e05 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:11.185419 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de35c0f-f53a-487c-8666-8fed11a07e05 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:11.185890 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de35c0f-f53a-487c-8666-8fed11a07e05 None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:11.186808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de35c0f-f53a-487c-8666-8fed11a07e05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:11.187335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de35c0f-f53a-487c-8666-8fed11a07e05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:11.189133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de35c0f-f53a-487c-8666-8fed11a07e05 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:11.197759 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:11.203976 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 386/763] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:39:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:11.210562 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de35c0f-f53a-487c-8666-8fed11a07e05 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:11.217668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5994d-8e08-4aa5-a0c9-e391d85b3d52 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:11.310426 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:11.325663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57366d4-6cc9-4186-b5c0-8ccf34bb9530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:11.326189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57366d4-6cc9-4186-b5c0-8ccf34bb9530 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:11.326189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57366d4-6cc9-4186-b5c0-8ccf34bb9530 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:11.326325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57366d4-6cc9-4186-b5c0-8ccf34bb9530 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:11.326983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57366d4-6cc9-4186-b5c0-8ccf34bb9530 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:11.327286 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57366d4-6cc9-4186-b5c0-8ccf34bb9530 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:11.328768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57366d4-6cc9-4186-b5c0-8ccf34bb9530 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:11.359095 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 378/764] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:39:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:11.362160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de35c0f-f53a-487c-8666-8fed11a07e05 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:11.364533 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57366d4-6cc9-4186-b5c0-8ccf34bb9530 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:11.405061 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e686797-3c5d-46df-9eed-a5b342252e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:11.406063 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e686797-3c5d-46df-9eed-a5b342252e60 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:11.407553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e686797-3c5d-46df-9eed-a5b342252e60 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:11.409577 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e686797-3c5d-46df-9eed-a5b342252e60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:11.410610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e686797-3c5d-46df-9eed-a5b342252e60 None admin] RBAC: Adding query filter params (role.id=85bcc17628d742209f79cc936d4290b5, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=642d4bef7e9c459a8d2dde636094b528) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:11.411125 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e686797-3c5d-46df-9eed-a5b342252e60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:11.412779 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e686797-3c5d-46df-9eed-a5b342252e60 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:11.425110 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 387/765] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:39:11 2022] GET /identity/v3/role_assignments?user.id=642d4bef7e9c459a8d2dde636094b528&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=85bcc17628d742209f79cc936d4290b5 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:11.426737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1887d-e362-4fe5-9571-bf4bc1b6c6f3 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:11.427140 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1887d-e362-4fe5-9571-bf4bc1b6c6f3 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:11.427873 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1887d-e362-4fe5-9571-bf4bc1b6c6f3 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:11.429966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 388/766] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:11.436012 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6929d-7f8c-4870-bcf4-ecd77c237bb9 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:11.436332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6929d-7f8c-4870-bcf4-ecd77c237bb9 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:11.436590 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6929d-7f8c-4870-bcf4-ecd77c237bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:11.462145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-a4d6929d-7f8c-4870-bcf4-ecd77c237bb9 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:11.464470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-a4d6929d-7f8c-4870-bcf4-ecd77c237bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:11.576554 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57366d4-6cc9-4186-b5c0-8ccf34bb9530 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:11.637375 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 389/767] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:11.663444 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05673b-8dce-447c-adb7-1b81a7b46ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:11.664102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05673b-8dce-447c-adb7-1b81a7b46ff1 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:11.664387 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05673b-8dce-447c-adb7-1b81a7b46ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:11.664684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05673b-8dce-447c-adb7-1b81a7b46ff1 None admin] PATH_INFO: `/v3/projects/f5e78b142d654280b161a34cec0186cd/users/b18fd296138349408613004929144e70/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:11.666602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05673b-8dce-447c-adb7-1b81a7b46ff1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5e78b142d654280b161a34cec0186cd, user_id=b18fd296138349408613004929144e70, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:11.668063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05673b-8dce-447c-adb7-1b81a7b46ff1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:11.769985 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 379/768] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:39:11 2022] PUT /identity/v3/projects/f5e78b142d654280b161a34cec0186cd/users/b18fd296138349408613004929144e70/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:39:12.012578 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6929d-7f8c-4870-bcf4-ecd77c237bb9 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:12.095550 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:12.152037 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6929d-7f8c-4870-bcf4-ecd77c237bb9 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:12.205540 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45541f9a-9ce3-45c3-84e5-be1eda70a197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:12.206215 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45541f9a-9ce3-45c3-84e5-be1eda70a197 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:12.206499 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45541f9a-9ce3-45c3-84e5-be1eda70a197 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:12.206776 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45541f9a-9ce3-45c3-84e5-be1eda70a197 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:12.207378 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45541f9a-9ce3-45c3-84e5-be1eda70a197 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:12.208783 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45541f9a-9ce3-45c3-84e5-be1eda70a197 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:12.220004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-45541f9a-9ce3-45c3-84e5-be1eda70a197 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 22:39:12.220004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:12.220004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:12.220004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:12.220004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:12.220004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:12.220004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:12.220004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:12.220004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 22:39:12.220004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:12.220004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:12.220004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:12.220004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:12.220004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:12.220004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:12.220004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:12.220004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:12.222029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:12.222029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:12.222029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:12.222029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:12.222029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:12.222029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:12.222029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:12.222029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:12.222029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:12.222029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:12.222029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:12.222029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:12.222029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:12.222029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:12.222029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:12.222029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:12.222880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:12.222880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:12.222880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:12.222880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:12.222880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:12.222880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:12.222880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:12.222880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:12.222880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:12.222880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:12.222880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:12.222880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:12.222880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 22:39:12.222880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:12.222880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 390/769] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Sep 6 22:39:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:12.231144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05673b-8dce-447c-adb7-1b81a7b46ff1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:12.260459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:12.385499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05673b-8dce-447c-adb7-1b81a7b46ff1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:12.432798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb998d-fd30-4195-9b06-186ceb0da52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:12.433436 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb998d-fd30-4195-9b06-186ceb0da52a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:12.434249 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb998d-fd30-4195-9b06-186ceb0da52a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:12.434519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb998d-fd30-4195-9b06-186ceb0da52a None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:12.435159 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb998d-fd30-4195-9b06-186ceb0da52a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:12.435458 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb998d-fd30-4195-9b06-186ceb0da52a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:12.436856 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb998d-fd30-4195-9b06-186ceb0da52a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:12.444584 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 380/770] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Sep 6 22:39:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:12.450521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45541f9a-9ce3-45c3-84e5-be1eda70a197 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:12.622739 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45541f9a-9ce3-45c3-84e5-be1eda70a197 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:12.645644 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:12.664036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4595121-b4ad-48e7-b886-fb1711b54868 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:12.664365 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4595121-b4ad-48e7-b886-fb1711b54868 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:12.664628 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4595121-b4ad-48e7-b886-fb1711b54868 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:12.666290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 381/771] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:12.671765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf5e75-3790-403c-bf6c-eb5669d8077c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:12.672044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf5e75-3790-403c-bf6c-eb5669d8077c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:12.672312 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf5e75-3790-403c-bf6c-eb5669d8077c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:12.673054 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee64476-e554-4c70-8b45-8a6a618ba0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:12.673673 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee64476-e554-4c70-8b45-8a6a618ba0e1 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:12.673950 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee64476-e554-4c70-8b45-8a6a618ba0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:12.674221 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee64476-e554-4c70-8b45-8a6a618ba0e1 None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:12.674850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee64476-e554-4c70-8b45-8a6a618ba0e1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:12.675147 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee64476-e554-4c70-8b45-8a6a618ba0e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:12.676546 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee64476-e554-4c70-8b45-8a6a618ba0e1 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:12.684717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 391/772] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Sep 6 22:39:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:12.690608 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3abf5e75-3790-403c-bf6c-eb5669d8077c None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:12.690972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee64476-e554-4c70-8b45-8a6a618ba0e1 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:12.691791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3abf5e75-3790-403c-bf6c-eb5669d8077c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:12.800704 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 382/773] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 22:39:12.802140 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca6cc6-0732-44f2-a652-dc2fa1f5a2b5 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:12.802427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca6cc6-0732-44f2-a652-dc2fa1f5a2b5 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:12.802695 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca6cc6-0732-44f2-a652-dc2fa1f5a2b5 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:12.804211 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 383/774] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:12.809725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee64476-e554-4c70-8b45-8a6a618ba0e1 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:12.813792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fb1d6-b226-441e-9129-1d24f9a735de None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:12.814138 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fb1d6-b226-441e-9129-1d24f9a735de None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:12.814415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fb1d6-b226-441e-9129-1d24f9a735de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:12.850974 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ae1fb1d6-b226-441e-9129-1d24f9a735de None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:12.852158 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ae1fb1d6-b226-441e-9129-1d24f9a735de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:12.859746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:12.877746 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2734d-a13e-4d1c-a457-ac34d9e488d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:12.881696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2734d-a13e-4d1c-a457-ac34d9e488d3 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:12.881696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2734d-a13e-4d1c-a457-ac34d9e488d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:12.881696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2734d-a13e-4d1c-a457-ac34d9e488d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:12.881696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2734d-a13e-4d1c-a457-ac34d9e488d3 None admin] RBAC: Adding query filter params (interface=public, service_id=898d335375214166acd664dca77e65ab, region_id=RegionOne) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:12.881696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2734d-a13e-4d1c-a457-ac34d9e488d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:12.881696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2734d-a13e-4d1c-a457-ac34d9e488d3 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:12.896267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 392/775] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Sep 6 22:39:12 2022] GET /identity/v3/endpoints?service_id=898d335375214166acd664dca77e65ab&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:12.903415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2734d-a13e-4d1c-a457-ac34d9e488d3 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:13.015327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 384/776] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:13.085758 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:13.156597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2734d-a13e-4d1c-a457-ac34d9e488d3 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:13.204263 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf8c43-c86d-476f-bb29-232ead4327d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:13.205467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf8c43-c86d-476f-bb29-232ead4327d1 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:13.205949 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf8c43-c86d-476f-bb29-232ead4327d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:13.206422 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf8c43-c86d-476f-bb29-232ead4327d1 None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:13.207242 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf8c43-c86d-476f-bb29-232ead4327d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:13.208822 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf8c43-c86d-476f-bb29-232ead4327d1 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:13.215489 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 393/777] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Sep 6 22:39:12 2022] GET /identity/v3/services => generated 772 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:13.230836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fb1d6-b226-441e-9129-1d24f9a735de None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:13.363842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fb1d6-b226-441e-9129-1d24f9a735de None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:13.414573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97891f-cb23-466f-b52c-36200f2cce02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:13.416068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97891f-cb23-466f-b52c-36200f2cce02 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:13.416578 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97891f-cb23-466f-b52c-36200f2cce02 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:13.417052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97891f-cb23-466f-b52c-36200f2cce02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:13.434986 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:13.438035 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97891f-cb23-466f-b52c-36200f2cce02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:39:13.442996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ef97891f-cb23-466f-b52c-36200f2cce02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:39:13.442996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:13.442996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:13.442996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:13.442996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:13.442996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:13.442996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:13.442996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:13.442996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:13.442996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:13.442996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:13.442996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:13.442996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:39:13.442996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:39:13.442996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:39:13.442996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:39:13.443940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:39:13.443940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:39:13.443940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:39:13.443940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:39:13.443940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:13.443940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:13.443940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:13.443940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:13.443940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:13.443940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:13.443940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:13.443940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:13.443940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:13.443940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:13.443940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:13.443940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:13.445267 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:13.445267 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:13.445267 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:13.445267 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:13.445267 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:39:13.445267 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:39:13.445267 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:39:13.445267 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:39:13.445267 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:39:13.445267 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:39:13.445267 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:39:13.445267 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:13.448630 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 385/778] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:39:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:13.450422 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf8c43-c86d-476f-bb29-232ead4327d1 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:13.473896 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97891f-cb23-466f-b52c-36200f2cce02 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:13.606333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf8c43-c86d-476f-bb29-232ead4327d1 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:13.624062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:13.626244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97891f-cb23-466f-b52c-36200f2cce02 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:13.655837 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a5897-3bf6-4e17-8b61-f23af3ac7637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:13.656590 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a5897-3bf6-4e17-8b61-f23af3ac7637 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:13.656869 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a5897-3bf6-4e17-8b61-f23af3ac7637 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:13.657147 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a5897-3bf6-4e17-8b61-f23af3ac7637 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:13.657810 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a5897-3bf6-4e17-8b61-f23af3ac7637 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:13.658114 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a5897-3bf6-4e17-8b61-f23af3ac7637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:13.659546 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a5897-3bf6-4e17-8b61-f23af3ac7637 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:13.670675 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 394/779] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:39:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:13.676065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a5897-3bf6-4e17-8b61-f23af3ac7637 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:13.694493 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba05544-844c-4e64-87cc-fa9b0149547a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:13.695144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba05544-844c-4e64-87cc-fa9b0149547a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:13.695421 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba05544-844c-4e64-87cc-fa9b0149547a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:13.695688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba05544-844c-4e64-87cc-fa9b0149547a None admin] PATH_INFO: `/v3/services/network` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:13.696275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba05544-844c-4e64-87cc-fa9b0149547a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:13.697677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba05544-844c-4e64-87cc-fa9b0149547a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:13.713494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-4ba05544-844c-4e64-87cc-fa9b0149547a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 22:39:13.713494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:13.713494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:13.713494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:13.713494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:13.713494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:13.713494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:13.713494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:13.713494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 22:39:13.713494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:13.713494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:13.713494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:13.713494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:13.713494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:13.713494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:13.713494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:13.713494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:13.715104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:13.715104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:13.715104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:13.715104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:13.715104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:13.715104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:13.715104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:13.715104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:13.715104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:13.715104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:13.715104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:13.715104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:13.715104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:13.715104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:13.715104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:13.715104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:13.715983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:13.715983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:13.715983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:13.715983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:13.715983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:13.715983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:13.715983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:13.715983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:13.715983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:13.715983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:13.715983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:13.715983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:13.715983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 22:39:13.715983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:13.720852 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 386/780] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:13 2022] GET /identity/v3/services/network => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:13.726540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba05544-844c-4e64-87cc-fa9b0149547a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:13.784839 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a5897-3bf6-4e17-8b61-f23af3ac7637 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:13.822978 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654de186-e062-44f0-9613-3846f45e7b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:13.824948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654de186-e062-44f0-9613-3846f45e7b54 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:13.825227 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654de186-e062-44f0-9613-3846f45e7b54 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:13.825503 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654de186-e062-44f0-9613-3846f45e7b54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:13.848367 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654de186-e062-44f0-9613-3846f45e7b54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:13.849851 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654de186-e062-44f0-9613-3846f45e7b54 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:13.865915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:13.881509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-654de186-e062-44f0-9613-3846f45e7b54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:13.881509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:13.881509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:13.881509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:13.881509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:13.881509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:13.881509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:13.881509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:13.881509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:13.881509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:13.881509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:13.881509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:13.881509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:13.881509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:13.881509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:13.881509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:13.883074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:13.883074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:13.883074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:13.883074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:13.883074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:13.883074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:13.883074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:13.883074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:13.883074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:13.883074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:13.883074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:13.883074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:13.883074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:13.883074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:13.883074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:13.883074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:13.883074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:13.884409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:13.884409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:13.884409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:13.888655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 395/781] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:13.895153 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654de186-e062-44f0-9613-3846f45e7b54 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:13.945893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba05544-844c-4e64-87cc-fa9b0149547a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:13.947742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:14.006511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692347c1-57ac-4ff9-93cf-408d8d951a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:14.008298 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692347c1-57ac-4ff9-93cf-408d8d951a40 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:14.008602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692347c1-57ac-4ff9-93cf-408d8d951a40 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:14.008878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692347c1-57ac-4ff9-93cf-408d8d951a40 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:14.009532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692347c1-57ac-4ff9-93cf-408d8d951a40 None admin] RBAC: Adding query filter params (name=network) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:14.009838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692347c1-57ac-4ff9-93cf-408d8d951a40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:14.015011 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692347c1-57ac-4ff9-93cf-408d8d951a40 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:14.030705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 387/782] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Sep 6 22:39:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:14.035945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692347c1-57ac-4ff9-93cf-408d8d951a40 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:14.119279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654de186-e062-44f0-9613-3846f45e7b54 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:14.166874 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692347c1-57ac-4ff9-93cf-408d8d951a40 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:14.175339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ca9b3-754b-46f2-8cad-250e21317d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:14.176184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ca9b3-754b-46f2-8cad-250e21317d6c None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:14.176712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ca9b3-754b-46f2-8cad-250e21317d6c None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:14.177194 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ca9b3-754b-46f2-8cad-250e21317d6c None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:14.178060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ca9b3-754b-46f2-8cad-250e21317d6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:14.178581 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ca9b3-754b-46f2-8cad-250e21317d6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:14.180151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ca9b3-754b-46f2-8cad-250e21317d6c None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:14.197587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 396/783] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:14.199792 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbbff3-c9bb-40ca-981c-09c1e7f7f470 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:14.200238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:14.201105 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbbff3-c9bb-40ca-981c-09c1e7f7f470 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:14.201633 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbbff3-c9bb-40ca-981c-09c1e7f7f470 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:14.207626 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 397/784] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:14.208808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d80c4-ebdc-4b60-bc19-15aa272df5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:14.209152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbbff3-c9bb-40ca-981c-09c1e7f7f470 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:14.209427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d80c4-ebdc-4b60-bc19-15aa272df5be None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:14.209709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d80c4-ebdc-4b60-bc19-15aa272df5be None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:14.209983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d80c4-ebdc-4b60-bc19-15aa272df5be None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:14.210745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d80c4-ebdc-4b60-bc19-15aa272df5be None admin] RBAC: Adding query filter params (type=network) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:14.211038 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d80c4-ebdc-4b60-bc19-15aa272df5be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:14.212415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d80c4-ebdc-4b60-bc19-15aa272df5be None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:14.218872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 388/785] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Sep 6 22:39:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:14.220206 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0629a3b-1f02-4f9e-8652-f64933f157f9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:14.220516 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0629a3b-1f02-4f9e-8652-f64933f157f9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:14.220795 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0629a3b-1f02-4f9e-8652-f64933f157f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:14.243827 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f0629a3b-1f02-4f9e-8652-f64933f157f9 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:14.246384 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f0629a3b-1f02-4f9e-8652-f64933f157f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:14.317267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:14.328121 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 389/786] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:14.330458 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0629a3b-1f02-4f9e-8652-f64933f157f9 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:14.339352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbbff3-c9bb-40ca-981c-09c1e7f7f470 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:14.379095 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625a011-225f-4e39-8fe7-3d0f9d3c58e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:14.380087 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625a011-225f-4e39-8fe7-3d0f9d3c58e0 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:14.380539 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625a011-225f-4e39-8fe7-3d0f9d3c58e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:14.380956 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625a011-225f-4e39-8fe7-3d0f9d3c58e0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:14.390077 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625a011-225f-4e39-8fe7-3d0f9d3c58e0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:14.391738 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625a011-225f-4e39-8fe7-3d0f9d3c58e0 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:14.406497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-d625a011-225f-4e39-8fe7-3d0f9d3c58e0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 22:39:14.406497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:14.406497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:14.406497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:14.406497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:14.406497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:14.406497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:14.406497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:14.406497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:14.406497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:14.406497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:14.406497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:14.406497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:39:14.406497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:39:14.406497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:39:14.406497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:39:14.407691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:14.407691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:14.407691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:39:14.407691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:14.407691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:39:14.407691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:14.407691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:14.407691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:14.407691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:14.407691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:14.407691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:14.407691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:14.407691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:14.407691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:14.407691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:14.407691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:14.407691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:14.407691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:14.408908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:14.408908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:14.408908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:39:14.408908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:39:14.408908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:39:14.408908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:39:14.408908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:39:14.408908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:39:14.408908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 22:39:14.408908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:14.411105 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 398/787] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:39:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:14.412663 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370ae8f-33d9-4c33-9e2b-b9ad386802cc None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:14.413164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370ae8f-33d9-4c33-9e2b-b9ad386802cc None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:14.413596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370ae8f-33d9-4c33-9e2b-b9ad386802cc None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:14.415278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 399/788] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:14.417105 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370ae8f-33d9-4c33-9e2b-b9ad386802cc None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:14.472940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0629a3b-1f02-4f9e-8652-f64933f157f9 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:14.507864 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:14.522605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa96a64-3b22-41a3-b04f-6d0114314e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:14.523222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa96a64-3b22-41a3-b04f-6d0114314e48 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:14.523499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa96a64-3b22-41a3-b04f-6d0114314e48 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:14.523770 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa96a64-3b22-41a3-b04f-6d0114314e48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:14.524523 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa96a64-3b22-41a3-b04f-6d0114314e48 None admin] RBAC: Adding query filter params (interface=public, service_id=19a25a557bd84509ac1679044ceaabb1, region_id=RegionOne) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:14.525333 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa96a64-3b22-41a3-b04f-6d0114314e48 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:14.527070 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa96a64-3b22-41a3-b04f-6d0114314e48 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:14.538771 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 390/789] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Sep 6 22:39:14 2022] GET /identity/v3/endpoints?service_id=19a25a557bd84509ac1679044ceaabb1&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:14.540781 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba28c39-ac48-475e-b7aa-a3c0b685b8f9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:14.541280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba28c39-ac48-475e-b7aa-a3c0b685b8f9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:14.541720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba28c39-ac48-475e-b7aa-a3c0b685b8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:14.546980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370ae8f-33d9-4c33-9e2b-b9ad386802cc None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:14.564172 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-6ba28c39-ac48-475e-b7aa-a3c0b685b8f9 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:14.565645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6ba28c39-ac48-475e-b7aa-a3c0b685b8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:14.584733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80544c2a-6851-4b4a-8440-bcf55a933563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:14.585632 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80544c2a-6851-4b4a-8440-bcf55a933563 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:14.586114 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80544c2a-6851-4b4a-8440-bcf55a933563 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:14.586586 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80544c2a-6851-4b4a-8440-bcf55a933563 None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:14.587593 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80544c2a-6851-4b4a-8440-bcf55a933563 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:14.588216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80544c2a-6851-4b4a-8440-bcf55a933563 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:14.590556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80544c2a-6851-4b4a-8440-bcf55a933563 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:14.606925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:14.612102 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 400/790] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Sep 6 22:39:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:14.613287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80544c2a-6851-4b4a-8440-bcf55a933563 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:14.649160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 391/791] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:14.650100 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba28c39-ac48-475e-b7aa-a3c0b685b8f9 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:14.725137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80544c2a-6851-4b4a-8440-bcf55a933563 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:14.750830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba28c39-ac48-475e-b7aa-a3c0b685b8f9 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:14.762884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cd411-eb84-4b8b-a0ac-56905e9d4bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:14.763784 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cd411-eb84-4b8b-a0ac-56905e9d4bbf None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:14.764309 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cd411-eb84-4b8b-a0ac-56905e9d4bbf None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:14.764872 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cd411-eb84-4b8b-a0ac-56905e9d4bbf None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:14.765754 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cd411-eb84-4b8b-a0ac-56905e9d4bbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:14.767289 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cd411-eb84-4b8b-a0ac-56905e9d4bbf None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:14.768102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:14.774096 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 401/792] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Sep 6 22:39:14 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:14.775289 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cd411-eb84-4b8b-a0ac-56905e9d4bbf None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:14.806315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489081bc-abf9-40e7-a5bc-d77d3d80eca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:14.806978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489081bc-abf9-40e7-a5bc-d77d3d80eca1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:14.807258 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489081bc-abf9-40e7-a5bc-d77d3d80eca1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:14.807525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489081bc-abf9-40e7-a5bc-d77d3d80eca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:14.829149 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489081bc-abf9-40e7-a5bc-d77d3d80eca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:14.830979 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489081bc-abf9-40e7-a5bc-d77d3d80eca1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:14.848840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:14.870494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-489081bc-abf9-40e7-a5bc-d77d3d80eca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:14.870494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:14.870494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:14.870494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:14.870494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:14.870494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:14.870494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:14.870494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:14.870494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:14.870494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:14.870494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:14.870494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:14.870494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:14.870494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:14.870494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:14.870494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:14.871582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:14.871582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:14.871582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:14.871582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:14.871582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:14.871582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:14.871582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:14.871582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:14.871582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:14.871582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:14.871582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:14.871582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:14.871582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:14.871582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:14.871582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:14.871582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:14.871582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:14.877034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:14.877034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:14.877034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:14.877034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 392/793] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:14.889499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489081bc-abf9-40e7-a5bc-d77d3d80eca1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:14.899864 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cd411-eb84-4b8b-a0ac-56905e9d4bbf None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:14.939020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393c24e-cd3f-4591-b247-208877257088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:14.947260 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393c24e-cd3f-4591-b247-208877257088 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:14.947260 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393c24e-cd3f-4591-b247-208877257088 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:14.947260 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393c24e-cd3f-4591-b247-208877257088 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:14.953994 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393c24e-cd3f-4591-b247-208877257088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:39:14.959416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-d393c24e-cd3f-4591-b247-208877257088 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:39:14.959416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:14.959416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:14.959416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:14.959416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:14.959416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:14.959416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:14.959416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:14.959416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:14.959416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:14.959416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:14.959416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:14.959416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:39:14.959416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:39:14.959416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:39:14.959416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:39:14.960454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:39:14.960454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:39:14.960454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:39:14.960454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:39:14.960454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:14.960454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:14.960454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:14.960454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:14.960454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:14.960454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:14.960454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:14.960454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:14.960454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:14.960454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:14.960454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:14.960454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:14.961343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:14.961343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:14.961343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:14.961343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:14.961343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:39:14.961343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:39:14.961343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:39:14.961343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:39:14.961343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:39:14.961343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:39:14.961343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:39:14.961343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:14.965784 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 402/794] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:39:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:14.966764 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393c24e-cd3f-4591-b247-208877257088 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:15.056469 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489081bc-abf9-40e7-a5bc-d77d3d80eca1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:15.099704 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5325dd4-9224-4c3e-a72e-f03bddf49b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:15.100730 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5325dd4-9224-4c3e-a72e-f03bddf49b05 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:15.101491 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5325dd4-9224-4c3e-a72e-f03bddf49b05 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:15.102072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5325dd4-9224-4c3e-a72e-f03bddf49b05 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:15.102964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5325dd4-9224-4c3e-a72e-f03bddf49b05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:15.103430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5325dd4-9224-4c3e-a72e-f03bddf49b05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:15.104438 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393c24e-cd3f-4591-b247-208877257088 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:15.105185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5325dd4-9224-4c3e-a72e-f03bddf49b05 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:15.122276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 393/795] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:15.123376 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5325dd4-9224-4c3e-a72e-f03bddf49b05 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:15.139871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:15.152574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3e377-226d-4a53-9ee5-3b7117968f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:15.153544 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3e377-226d-4a53-9ee5-3b7117968f6f None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:15.156307 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3e377-226d-4a53-9ee5-3b7117968f6f None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:15.156307 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3e377-226d-4a53-9ee5-3b7117968f6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:15.163853 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:15.166485 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3e377-226d-4a53-9ee5-3b7117968f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:39:15.171655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-b0f3e377-226d-4a53-9ee5-3b7117968f6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:39:15.171655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:15.171655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:15.171655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:15.171655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:15.171655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:15.171655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:15.171655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:15.171655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:15.171655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:15.171655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:15.171655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:15.171655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:39:15.171655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:39:15.171655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:39:15.171655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:39:15.172808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:39:15.172808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:39:15.172808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:39:15.172808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:39:15.172808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:15.172808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:15.172808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:15.172808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:15.172808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:15.172808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:15.172808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:15.172808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:15.172808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:15.172808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:15.172808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:15.172808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:15.173674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:15.173674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:15.173674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:15.173674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:15.173674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:39:15.173674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:39:15.173674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:39:15.173674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:39:15.173674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:39:15.173674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:39:15.173674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:39:15.173674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:15.176317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 403/796] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:39:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:15.181259 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3e377-226d-4a53-9ee5-3b7117968f6f None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:15.257487 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5325dd4-9224-4c3e-a72e-f03bddf49b05 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:15.288946 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3e377-226d-4a53-9ee5-3b7117968f6f None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:15.302672 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e5e90-37c1-4cc7-b388-2fadfe0175df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:15.303298 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e5e90-37c1-4cc7-b388-2fadfe0175df None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:15.303579 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e5e90-37c1-4cc7-b388-2fadfe0175df None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:15.303853 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e5e90-37c1-4cc7-b388-2fadfe0175df None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:15.304570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e5e90-37c1-4cc7-b388-2fadfe0175df None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:15.305009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e5e90-37c1-4cc7-b388-2fadfe0175df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:15.306876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e5e90-37c1-4cc7-b388-2fadfe0175df None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:15.318370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 394/797] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:39:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:15.321226 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e5e90-37c1-4cc7-b388-2fadfe0175df None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:15.335500 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562e9f6-0d6c-4bcb-8e6f-6560d2c97e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:15.336497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562e9f6-0d6c-4bcb-8e6f-6560d2c97e9a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:15.336980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562e9f6-0d6c-4bcb-8e6f-6560d2c97e9a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:15.337452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562e9f6-0d6c-4bcb-8e6f-6560d2c97e9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:15.344965 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562e9f6-0d6c-4bcb-8e6f-6560d2c97e9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:15.346660 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562e9f6-0d6c-4bcb-8e6f-6560d2c97e9a None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:15.359414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-7562e9f6-0d6c-4bcb-8e6f-6560d2c97e9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:15.359414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:15.359414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:15.359414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:15.359414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:15.359414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:15.359414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:15.359414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:15.359414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:15.359414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:15.359414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:15.359414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:15.359414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:39:15.359414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:39:15.359414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:39:15.360333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:39:15.360333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:15.360333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:15.360333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:15.360333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:15.360333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:15.360333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:15.360333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:15.360333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:15.360333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:15.360333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:15.360333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:15.360333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:15.360333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:15.360333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:15.360333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:15.360333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:15.361253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:39:15.361253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:39:15.361253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:39:15.361253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:39:15.361253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:39:15.361253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:39:15.361253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:15.361253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:15.363780 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 404/798] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:15.364844 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562e9f6-0d6c-4bcb-8e6f-6560d2c97e9a None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:15.420530 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:15.442236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:15.452329 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e5e90-37c1-4cc7-b388-2fadfe0175df None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:15.489483 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847b477-654f-424e-ab8e-8a7dd8617243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:15.490120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847b477-654f-424e-ab8e-8a7dd8617243 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:15.490490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847b477-654f-424e-ab8e-8a7dd8617243 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:15.490835 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847b477-654f-424e-ab8e-8a7dd8617243 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:15.491578 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847b477-654f-424e-ab8e-8a7dd8617243 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:15.491971 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847b477-654f-424e-ab8e-8a7dd8617243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:15.493508 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847b477-654f-424e-ab8e-8a7dd8617243 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:15.505957 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562e9f6-0d6c-4bcb-8e6f-6560d2c97e9a None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:15.507971 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 395/799] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:39:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:15.509597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847b477-654f-424e-ab8e-8a7dd8617243 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:15.552402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515ed4b-46d4-4d53-8764-f216953db80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:15.553309 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515ed4b-46d4-4d53-8764-f216953db80e None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:15.553684 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515ed4b-46d4-4d53-8764-f216953db80e None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:15.554059 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515ed4b-46d4-4d53-8764-f216953db80e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:15.567985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515ed4b-46d4-4d53-8764-f216953db80e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:15.569696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515ed4b-46d4-4d53-8764-f216953db80e None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:15.586531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-7515ed4b-46d4-4d53-8764-f216953db80e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:15.586531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:15.586531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:15.586531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:15.586531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:15.586531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:15.586531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:15.586531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:15.586531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:15.586531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:15.586531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:15.586531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:15.586531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:15.586531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:15.586531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:15.586531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:15.587748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:15.587748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:15.587748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:15.587748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:15.587748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:15.587748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:15.587748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:15.587748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:15.587748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:15.587748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:15.587748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:15.587748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:15.587748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:15.587748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:15.587748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:15.587748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:15.587748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:15.588851 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:15.588851 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:15.588851 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:15.590096 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 405/800] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:15.591323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515ed4b-46d4-4d53-8764-f216953db80e None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:15.644034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847b477-654f-424e-ab8e-8a7dd8617243 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:15.687128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03134b-c91a-4d8f-b7e7-fc8737c8f372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:15.688513 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03134b-c91a-4d8f-b7e7-fc8737c8f372 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:15.689405 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03134b-c91a-4d8f-b7e7-fc8737c8f372 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:15.689866 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03134b-c91a-4d8f-b7e7-fc8737c8f372 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:15.690991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03134b-c91a-4d8f-b7e7-fc8737c8f372 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:15.691478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03134b-c91a-4d8f-b7e7-fc8737c8f372 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:15.694092 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03134b-c91a-4d8f-b7e7-fc8737c8f372 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:15.706262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:15.712458 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515ed4b-46d4-4d53-8764-f216953db80e None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:15.750894 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d75e52-5221-4ac7-b70f-4640a9b55511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:15.751560 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d75e52-5221-4ac7-b70f-4640a9b55511 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:15.751839 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d75e52-5221-4ac7-b70f-4640a9b55511 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:15.752112 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d75e52-5221-4ac7-b70f-4640a9b55511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:15.764355 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d75e52-5221-4ac7-b70f-4640a9b55511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:15.765900 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d75e52-5221-4ac7-b70f-4640a9b55511 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:15.793493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-25d75e52-5221-4ac7-b70f-4640a9b55511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:15.793493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:15.793493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:15.793493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:15.793493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:15.793493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:15.793493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:15.793493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:15.793493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:15.793493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:15.793493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:15.793493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:15.793493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:15.793493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:15.793493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:15.793493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:15.794549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:15.794549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:15.794549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:15.794549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:15.794549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:15.794549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:15.794549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:15.794549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:15.794549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:15.794549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:15.794549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:15.794549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:15.794549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:15.794549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:15.794549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:15.794549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:15.794549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:15.795444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:15.795444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:15.795444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:15.796844 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 406/801] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:15.797982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d75e52-5221-4ac7-b70f-4640a9b55511 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:15.842266 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 396/802] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:39:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:15.844110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da91304-4749-4f6d-94c2-59f98c036de4 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:15.844615 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da91304-4749-4f6d-94c2-59f98c036de4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:15.845093 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da91304-4749-4f6d-94c2-59f98c036de4 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:15.850301 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 397/803] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:15.850301 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da91304-4749-4f6d-94c2-59f98c036de4 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:15.873671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:15.958154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d75e52-5221-4ac7-b70f-4640a9b55511 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:15.989697 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da91304-4749-4f6d-94c2-59f98c036de4 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:15.993763 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15cfd0-3a55-46bd-93ba-8f16217c6872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:15.994378 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15cfd0-3a55-46bd-93ba-8f16217c6872 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:15.994656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15cfd0-3a55-46bd-93ba-8f16217c6872 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:15.994927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15cfd0-3a55-46bd-93ba-8f16217c6872 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:15.995566 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15cfd0-3a55-46bd-93ba-8f16217c6872 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:15.995897 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15cfd0-3a55-46bd-93ba-8f16217c6872 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:15.997285 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15cfd0-3a55-46bd-93ba-8f16217c6872 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:16.009214 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 407/804] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:16.009987 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15cfd0-3a55-46bd-93ba-8f16217c6872 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:16.023034 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:16.029652 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd1414-6ae9-42f4-8126-4e838af1a746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:16.030335 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd1414-6ae9-42f4-8126-4e838af1a746 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:16.030620 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd1414-6ae9-42f4-8126-4e838af1a746 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:16.030893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd1414-6ae9-42f4-8126-4e838af1a746 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:16.031534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd1414-6ae9-42f4-8126-4e838af1a746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:16.031932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd1414-6ae9-42f4-8126-4e838af1a746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:16.033263 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd1414-6ae9-42f4-8126-4e838af1a746 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:16.045269 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 398/805] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:16.046247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cebb1-cb4e-47e9-a580-381f7a76b7ba None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:16.046534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cebb1-cb4e-47e9-a580-381f7a76b7ba None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:16.046811 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cebb1-cb4e-47e9-a580-381f7a76b7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:16.064137 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-007cebb1-cb4e-47e9-a580-381f7a76b7ba None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:16.067524 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-007cebb1-cb4e-47e9-a580-381f7a76b7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:16.125417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15cfd0-3a55-46bd-93ba-8f16217c6872 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:16.148475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 399/806] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:16.148475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cebb1-cb4e-47e9-a580-381f7a76b7ba None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:16.156068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:16.164646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f0c6b-c8d5-4b82-890a-e1aff7b1516f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:16.165324 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f0c6b-c8d5-4b82-890a-e1aff7b1516f None admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:16.165603 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f0c6b-c8d5-4b82-890a-e1aff7b1516f None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:16.165881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f0c6b-c8d5-4b82-890a-e1aff7b1516f None admin] PATH_INFO: `/v3/projects/f5e78b142d654280b161a34cec0186cd/users/660248a90f524a43b143bae127e0eaa1/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:16.168058 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f0c6b-c8d5-4b82-890a-e1aff7b1516f None admin] RBAC: Authorizing `identity:create_grant(project_id=f5e78b142d654280b161a34cec0186cd, user_id=660248a90f524a43b143bae127e0eaa1, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:16.169618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f0c6b-c8d5-4b82-890a-e1aff7b1516f None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:16.244232 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 408/807] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:39:16 2022] PUT /identity/v3/projects/f5e78b142d654280b161a34cec0186cd/users/660248a90f524a43b143bae127e0eaa1/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:39:16.245081 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f0c6b-c8d5-4b82-890a-e1aff7b1516f None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:16.298161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cebb1-cb4e-47e9-a580-381f7a76b7ba None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:16.358413 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:16.382343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20bc52-f7a2-4fb9-9112-3c0d7e7c1236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:16.382979 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20bc52-f7a2-4fb9-9112-3c0d7e7c1236 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:16.383267 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20bc52-f7a2-4fb9-9112-3c0d7e7c1236 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:16.383546 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20bc52-f7a2-4fb9-9112-3c0d7e7c1236 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:16.404169 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20bc52-f7a2-4fb9-9112-3c0d7e7c1236 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:16.405969 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20bc52-f7a2-4fb9-9112-3c0d7e7c1236 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:16.415165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f0c6b-c8d5-4b82-890a-e1aff7b1516f None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:16.430455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-dd20bc52-f7a2-4fb9-9112-3c0d7e7c1236 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 22:39:16.430455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:16.430455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:16.430455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:16.430455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:16.430455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:16.430455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:16.430455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:16.430455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:16.430455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:16.430455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:16.430455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:16.430455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:39:16.430455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:39:16.430455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:39:16.430455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:39:16.431475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:16.431475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:16.431475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:39:16.431475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:16.431475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:39:16.431475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:16.431475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:16.431475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:16.431475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:16.431475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:16.431475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:16.431475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:16.431475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:16.431475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:16.431475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:16.431475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:16.431475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:16.431475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:16.432459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:16.432459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:16.432459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:39:16.432459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:39:16.432459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:39:16.432459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:39:16.432459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:39:16.432459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:39:16.432459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 22:39:16.432459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:16.432459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 400/808] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Sep 6 22:39:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:16.432459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20bc52-f7a2-4fb9-9112-3c0d7e7c1236 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:16.467414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c07d88-29de-4387-b007-4c321d8774e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:16.468626 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c07d88-29de-4387-b007-4c321d8774e4 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:16.469161 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c07d88-29de-4387-b007-4c321d8774e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:16.469706 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c07d88-29de-4387-b007-4c321d8774e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:16.478165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c07d88-29de-4387-b007-4c321d8774e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:16.479632 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c07d88-29de-4387-b007-4c321d8774e4 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:16.492371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-79c07d88-29de-4387-b007-4c321d8774e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 22:39:16.492371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:16.492371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:16.492371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:16.492371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:16.492371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:16.492371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:16.492371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:16.492371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:16.492371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:16.492371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:16.492371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:16.492371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:39:16.492371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:39:16.492371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:39:16.492371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:39:16.493528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:16.493528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:16.493528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:39:16.493528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:16.493528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:39:16.493528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:16.493528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:16.493528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:16.493528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:16.493528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:16.493528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:16.493528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:16.493528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:16.493528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:16.493528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:16.493528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:16.493528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:16.493528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:16.494884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:16.494884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:16.494884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:39:16.494884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:39:16.494884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:39:16.494884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:39:16.494884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:39:16.494884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:39:16.494884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 22:39:16.494884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:16.498761 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 409/809] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Sep 6 22:39:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:16.499598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c07d88-29de-4387-b007-4c321d8774e4 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:16.514150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:16.562750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20bc52-f7a2-4fb9-9112-3c0d7e7c1236 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:16.611519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0676f-e21a-4653-95b1-3a6802990dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:16.612588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0676f-e21a-4653-95b1-3a6802990dd1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:16.612877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0676f-e21a-4653-95b1-3a6802990dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:16.613149 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0676f-e21a-4653-95b1-3a6802990dd1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:16.614001 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0676f-e21a-4653-95b1-3a6802990dd1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:16.615999 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0676f-e21a-4653-95b1-3a6802990dd1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:16.618797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c07d88-29de-4387-b007-4c321d8774e4 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:16.627034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-02f0676f-e21a-4653-95b1-3a6802990dd1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 22:39:16.627034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:16.627034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:16.627034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:16.627034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:16.627034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:16.627034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:16.627034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:16.627034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 22:39:16.627034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:16.627034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:16.627034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:16.627034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:16.627034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:16.627034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:16.627034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:16.627034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:16.628062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:16.628062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:16.628062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:16.628062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:16.628062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:16.628062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:16.628062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:16.628062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:16.628062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:16.628062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:16.628062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:16.628062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:16.628062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:16.628062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:16.628062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:16.628062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:16.628973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:16.628973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:16.628973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:16.628973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:16.628973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:16.628973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:16.628973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:16.628973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:16.628973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:16.628973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:16.628973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:16.628973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:16.628973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 22:39:16.628973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:16.629727 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 401/810] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Sep 6 22:39:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:16.630300 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0676f-e21a-4653-95b1-3a6802990dd1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:16.657806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:16.668606 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9ea88-ca8b-4506-85b1-c017e9e0eb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:16.672723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9ea88-ca8b-4506-85b1-c017e9e0eb44 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:16.672723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9ea88-ca8b-4506-85b1-c017e9e0eb44 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:16.672723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9ea88-ca8b-4506-85b1-c017e9e0eb44 None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:16.672723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9ea88-ca8b-4506-85b1-c017e9e0eb44 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:16.672723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9ea88-ca8b-4506-85b1-c017e9e0eb44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:16.673679 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9ea88-ca8b-4506-85b1-c017e9e0eb44 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:16.697822 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 410/811] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Sep 6 22:39:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:16.699538 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9ea88-ca8b-4506-85b1-c017e9e0eb44 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:16.778339 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0676f-e21a-4653-95b1-3a6802990dd1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:16.806698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:16.816832 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccb90a-79c3-4cbc-bd4a-4ee0f0c25a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:16.817683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccb90a-79c3-4cbc-bd4a-4ee0f0c25a15 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:16.818113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccb90a-79c3-4cbc-bd4a-4ee0f0c25a15 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:16.818536 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccb90a-79c3-4cbc-bd4a-4ee0f0c25a15 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:16.819564 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccb90a-79c3-4cbc-bd4a-4ee0f0c25a15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:16.821259 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9ea88-ca8b-4506-85b1-c017e9e0eb44 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:16.821697 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccb90a-79c3-4cbc-bd4a-4ee0f0c25a15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:16.822619 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccb90a-79c3-4cbc-bd4a-4ee0f0c25a15 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:16.841527 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 402/812] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Sep 6 22:39:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:16.842762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccb90a-79c3-4cbc-bd4a-4ee0f0c25a15 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:16.864479 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b89f17-692c-4331-baf2-2f01064157df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:16.865106 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b89f17-692c-4331-baf2-2f01064157df None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:16.865383 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b89f17-692c-4331-baf2-2f01064157df None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:16.865651 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b89f17-692c-4331-baf2-2f01064157df None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:16.866331 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b89f17-692c-4331-baf2-2f01064157df None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:16.866632 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b89f17-692c-4331-baf2-2f01064157df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:16.867984 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b89f17-692c-4331-baf2-2f01064157df None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:16.875140 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 411/813] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Sep 6 22:39:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:16.876873 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b89f17-692c-4331-baf2-2f01064157df None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:16.932794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:16.983266 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccb90a-79c3-4cbc-bd4a-4ee0f0c25a15 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:16.991234 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b89f17-692c-4331-baf2-2f01064157df None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:17.022527 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55222e-e74b-44c4-a49d-16bd5a2739c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:17.023500 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55222e-e74b-44c4-a49d-16bd5a2739c0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:17.023939 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55222e-e74b-44c4-a49d-16bd5a2739c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:17.024365 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55222e-e74b-44c4-a49d-16bd5a2739c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:17.028481 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc8f41-0655-46f3-82ef-485674a48bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:17.029222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc8f41-0655-46f3-82ef-485674a48bbb None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:17.029602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc8f41-0655-46f3-82ef-485674a48bbb None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:17.029978 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc8f41-0655-46f3-82ef-485674a48bbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:17.036395 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55222e-e74b-44c4-a49d-16bd5a2739c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:17.038127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55222e-e74b-44c4-a49d-16bd5a2739c0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:17.055671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-6f55222e-e74b-44c4-a49d-16bd5a2739c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:17.055671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:17.055671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:17.055671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:17.055671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:17.055671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:17.055671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:17.055671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:17.055671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:17.055671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:17.055671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:17.055671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:17.055671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:17.055671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:17.055671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:17.055671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:17.056731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:17.056731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:17.056731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:17.056731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:17.056731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:17.056731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:17.056731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:17.056731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:17.056731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:17.056731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:17.056731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:17.056731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:17.056731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:17.056731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:17.056731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:17.056731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:17.056731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:17.057650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:17.057650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:17.057650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:17.065435 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 403/814] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:17.066638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55222e-e74b-44c4-a49d-16bd5a2739c0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:17.106330 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc8f41-0655-46f3-82ef-485674a48bbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:17.107316 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:17.107877 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc8f41-0655-46f3-82ef-485674a48bbb None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:17.158715 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:17.178119 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55222e-e74b-44c4-a49d-16bd5a2739c0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:17.212243 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 412/815] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:39:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 22:39:17.213212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc8f41-0655-46f3-82ef-485674a48bbb None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:17.216502 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9504263-d49a-404d-a7eb-95507ca76bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:17.217350 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9504263-d49a-404d-a7eb-95507ca76bbc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:17.217805 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9504263-d49a-404d-a7eb-95507ca76bbc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:17.218225 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9504263-d49a-404d-a7eb-95507ca76bbc None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:17.218859 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9504263-d49a-404d-a7eb-95507ca76bbc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:17.219250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9504263-d49a-404d-a7eb-95507ca76bbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:17.220666 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9504263-d49a-404d-a7eb-95507ca76bbc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:17.226438 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 404/816] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Sep 6 22:39:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:17.227612 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f4f93-d122-41b4-831b-6064ab8f0c01 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:17.227899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f4f93-d122-41b4-831b-6064ab8f0c01 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:17.228172 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f4f93-d122-41b4-831b-6064ab8f0c01 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:17.232564 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 405/817] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:17.232564 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f4f93-d122-41b4-831b-6064ab8f0c01 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:17.326927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc8f41-0655-46f3-82ef-485674a48bbb None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:17.337619 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:17.342128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f4f93-d122-41b4-831b-6064ab8f0c01 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:17.366271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2e29a-3d79-49d7-8c69-21f8996a34eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:17.366889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2e29a-3d79-49d7-8c69-21f8996a34eb None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:17.367164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2e29a-3d79-49d7-8c69-21f8996a34eb None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:17.367435 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2e29a-3d79-49d7-8c69-21f8996a34eb None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:17.368073 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2e29a-3d79-49d7-8c69-21f8996a34eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:17.368372 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2e29a-3d79-49d7-8c69-21f8996a34eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:17.369756 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2e29a-3d79-49d7-8c69-21f8996a34eb None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:17.378265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55699bc-b447-44c5-80f2-a0c386e50a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:17.378889 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55699bc-b447-44c5-80f2-a0c386e50a6b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:17.379219 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55699bc-b447-44c5-80f2-a0c386e50a6b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:17.379493 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55699bc-b447-44c5-80f2-a0c386e50a6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:17.385794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 413/818] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:17.385794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2e29a-3d79-49d7-8c69-21f8996a34eb None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:17.394481 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55699bc-b447-44c5-80f2-a0c386e50a6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:17.396285 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55699bc-b447-44c5-80f2-a0c386e50a6b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:17.396756 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:17.412013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-b55699bc-b447-44c5-80f2-a0c386e50a6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:17.412013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:17.412013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:17.412013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:17.412013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:17.412013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:17.412013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:17.412013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:17.412013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:17.412013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:17.412013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:17.412013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:17.412013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:17.412013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:17.412013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:17.412013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:17.413142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:17.413142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:17.413142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:17.413142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:17.413142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:17.413142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:17.413142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:17.413142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:17.413142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:17.413142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:17.413142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:17.413142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:17.413142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:17.413142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:17.413142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:17.413142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:17.413142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:17.414146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:17.414146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:17.414146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:17.414146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 406/819] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:17.414372 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89703061-1c74-4e8b-b72d-d83b72efcb4a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:17.414794 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89703061-1c74-4e8b-b72d-d83b72efcb4a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:17.414899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89703061-1c74-4e8b-b72d-d83b72efcb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:17.433554 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-89703061-1c74-4e8b-b72d-d83b72efcb4a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:17.434731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-89703061-1c74-4e8b-b72d-d83b72efcb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:17.491462 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2e29a-3d79-49d7-8c69-21f8996a34eb None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:17.506725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 407/820] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:17.507472 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89703061-1c74-4e8b-b72d-d83b72efcb4a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:17.541525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bbc37-30f7-4281-b400-6335880f2e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:17.542584 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bbc37-30f7-4281-b400-6335880f2e2d None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:17.543065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bbc37-30f7-4281-b400-6335880f2e2d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:17.543605 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bbc37-30f7-4281-b400-6335880f2e2d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:17.544612 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bbc37-30f7-4281-b400-6335880f2e2d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:17.546252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bbc37-30f7-4281-b400-6335880f2e2d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:17.594450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:17.614152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89703061-1c74-4e8b-b72d-d83b72efcb4a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:17.654760 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e3397-dc77-4cdf-a8fd-720ae8081ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:17.655403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e3397-dc77-4cdf-a8fd-720ae8081ab7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:17.655676 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e3397-dc77-4cdf-a8fd-720ae8081ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:17.655943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e3397-dc77-4cdf-a8fd-720ae8081ab7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:17.664038 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e3397-dc77-4cdf-a8fd-720ae8081ab7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:17.665528 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e3397-dc77-4cdf-a8fd-720ae8081ab7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:17.669656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 414/821] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:39:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:39:17.670869 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bbc37-30f7-4281-b400-6335880f2e2d None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:17.685021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-550e3397-dc77-4cdf-a8fd-720ae8081ab7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:17.685021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:17.685021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:17.685021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:17.685021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:17.685021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:17.685021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:17.685021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:17.685021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:17.685021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:17.685021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:17.685021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:17.685021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:39:17.685021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:39:17.685021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:39:17.685994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:39:17.685994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:17.685994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:17.685994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:17.685994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:17.685994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:17.685994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:17.685994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:17.685994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:17.685994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:17.685994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:17.685994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:17.685994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:17.685994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:17.685994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:17.685994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:17.685994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:17.686915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:39:17.686915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:39:17.686915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:39:17.686915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:39:17.686915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:39:17.686915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:39:17.686915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:17.686915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:17.692571 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 408/822] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:17.693291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e3397-dc77-4cdf-a8fd-720ae8081ab7 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:17.768815 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:17.823334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bbc37-30f7-4281-b400-6335880f2e2d None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:17.864454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48400927-ce1c-4eb3-91a6-1b6ef1d53800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:17.865112 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48400927-ce1c-4eb3-91a6-1b6ef1d53800 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:17.865394 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48400927-ce1c-4eb3-91a6-1b6ef1d53800 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:17.865665 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48400927-ce1c-4eb3-91a6-1b6ef1d53800 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:17.866325 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48400927-ce1c-4eb3-91a6-1b6ef1d53800 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:17.866692 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48400927-ce1c-4eb3-91a6-1b6ef1d53800 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:17.868157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48400927-ce1c-4eb3-91a6-1b6ef1d53800 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:17.885751 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 415/823] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:17.887208 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48400927-ce1c-4eb3-91a6-1b6ef1d53800 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:17.894023 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e3397-dc77-4cdf-a8fd-720ae8081ab7 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:17.943827 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88aa29-5d81-4537-b5da-b752823e46cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:17.945223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88aa29-5d81-4537-b5da-b752823e46cd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:17.945223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88aa29-5d81-4537-b5da-b752823e46cd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:17.945569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88aa29-5d81-4537-b5da-b752823e46cd None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:17.946272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88aa29-5d81-4537-b5da-b752823e46cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:17.950167 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88aa29-5d81-4537-b5da-b752823e46cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:17.950167 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88aa29-5d81-4537-b5da-b752823e46cd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:17.962489 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 409/824] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:39:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:17.963431 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88aa29-5d81-4537-b5da-b752823e46cd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:17.971046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:18.013016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48400927-ce1c-4eb3-91a6-1b6ef1d53800 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:18.037636 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:18.050419 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a6938-0f63-458d-89a5-6c2982e9d4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:18.051065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a6938-0f63-458d-89a5-6c2982e9d4c2 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:18.051352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a6938-0f63-458d-89a5-6c2982e9d4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:18.051620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a6938-0f63-458d-89a5-6c2982e9d4c2 None admin] PATH_INFO: `/v3/services/network` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:18.052261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a6938-0f63-458d-89a5-6c2982e9d4c2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:18.053818 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a6938-0f63-458d-89a5-6c2982e9d4c2 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:18.064595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-b14a6938-0f63-458d-89a5-6c2982e9d4c2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 22:39:18.064595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:18.064595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:18.064595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:18.064595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:18.064595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:18.064595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:18.064595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:18.064595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 22:39:18.064595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:18.064595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:18.064595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:18.064595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:18.064595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:18.064595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:18.064595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:18.064595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:18.065719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:18.065719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:18.065719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:18.065719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:18.065719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:18.065719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:18.065719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:18.065719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:18.065719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:18.065719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:18.065719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:18.065719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:18.065719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:18.065719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:18.065719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:18.065719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:18.066811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:18.066811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:18.066811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:18.066811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:18.066811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:18.066811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:18.066811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:18.066811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:18.066811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:18.066811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:18.066811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:18.066811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:18.066811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 22:39:18.066811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:18.072710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 416/825] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:17 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:18.075246 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a6938-0f63-458d-89a5-6c2982e9d4c2 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:18.082103 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88aa29-5d81-4537-b5da-b752823e46cd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:18.119589 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed520b24-b8e3-45fd-9e5f-9d5791b8b63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:18.120930 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed520b24-b8e3-45fd-9e5f-9d5791b8b63b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:18.121506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed520b24-b8e3-45fd-9e5f-9d5791b8b63b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:18.121893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed520b24-b8e3-45fd-9e5f-9d5791b8b63b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:18.135337 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed520b24-b8e3-45fd-9e5f-9d5791b8b63b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:18.137703 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed520b24-b8e3-45fd-9e5f-9d5791b8b63b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:18.152750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ed520b24-b8e3-45fd-9e5f-9d5791b8b63b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:18.152750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:18.152750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:18.152750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:18.152750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:18.152750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:18.152750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:18.152750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:18.152750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:18.152750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:18.152750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:18.152750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:18.152750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:39:18.152750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:39:18.152750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:39:18.153899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:39:18.153899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:18.153899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:18.153899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:18.153899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:18.153899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:18.153899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:18.153899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:18.153899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:18.153899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:18.153899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:18.153899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:18.153899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:18.153899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:18.153899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:18.153899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:18.153899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:18.155163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:39:18.155163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:39:18.155163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:39:18.155163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:39:18.155163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:39:18.155163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:39:18.155163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:18.155163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:18.163864 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 410/826] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:18.165493 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed520b24-b8e3-45fd-9e5f-9d5791b8b63b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:18.194551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a6938-0f63-458d-89a5-6c2982e9d4c2 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:18.231885 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407350a7-acf1-4f35-b0d7-e0aac722d4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:18.232589 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407350a7-acf1-4f35-b0d7-e0aac722d4a8 None admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:18.232913 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407350a7-acf1-4f35-b0d7-e0aac722d4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:18.233292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407350a7-acf1-4f35-b0d7-e0aac722d4a8 None admin] PATH_INFO: `/v3/projects/f5e78b142d654280b161a34cec0186cd/users/642d4bef7e9c459a8d2dde636094b528/roles/85bcc17628d742209f79cc936d4290b5` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:18.247212 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:18.250834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407350a7-acf1-4f35-b0d7-e0aac722d4a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5e78b142d654280b161a34cec0186cd, user_id=642d4bef7e9c459a8d2dde636094b528, role_id=85bcc17628d742209f79cc936d4290b5)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:18.252454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407350a7-acf1-4f35-b0d7-e0aac722d4a8 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:18.288897 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed520b24-b8e3-45fd-9e5f-9d5791b8b63b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:18.326442 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8437cb-7940-437f-9968-bd5b11e6ecab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:18.327233 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8437cb-7940-437f-9968-bd5b11e6ecab None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:18.327620 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8437cb-7940-437f-9968-bd5b11e6ecab None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:18.328036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8437cb-7940-437f-9968-bd5b11e6ecab None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:18.328764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8437cb-7940-437f-9968-bd5b11e6ecab None admin] RBAC: Adding query filter params (name=network) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:18.329169 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8437cb-7940-437f-9968-bd5b11e6ecab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:18.330958 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8437cb-7940-437f-9968-bd5b11e6ecab None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:18.336852 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 417/827] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:39:18 2022] PUT /identity/v3/projects/f5e78b142d654280b161a34cec0186cd/users/642d4bef7e9c459a8d2dde636094b528/roles/85bcc17628d742209f79cc936d4290b5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:39:18.339293 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407350a7-acf1-4f35-b0d7-e0aac722d4a8 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:18.343468 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 411/828] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Sep 6 22:39:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:18.350759 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8437cb-7940-437f-9968-bd5b11e6ecab None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:18.421058 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:18.564020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407350a7-acf1-4f35-b0d7-e0aac722d4a8 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:18.577136 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8437cb-7940-437f-9968-bd5b11e6ecab None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:18.610830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:18.613376 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5964a-53b5-431e-ba50-e74500de04c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:18.614005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5964a-53b5-431e-ba50-e74500de04c1 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:18.614289 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5964a-53b5-431e-ba50-e74500de04c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:18.614566 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5964a-53b5-431e-ba50-e74500de04c1 None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:18.615269 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5964a-53b5-431e-ba50-e74500de04c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:18.615576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5964a-53b5-431e-ba50-e74500de04c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:18.617144 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5964a-53b5-431e-ba50-e74500de04c1 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:18.624393 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cad045-6e5a-4500-86ac-5934141b5d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:18.625038 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cad045-6e5a-4500-86ac-5934141b5d7a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:18.625322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cad045-6e5a-4500-86ac-5934141b5d7a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:18.625594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cad045-6e5a-4500-86ac-5934141b5d7a None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:18.626232 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cad045-6e5a-4500-86ac-5934141b5d7a None admin] RBAC: Adding query filter params (type=network) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:18.626536 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cad045-6e5a-4500-86ac-5934141b5d7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:18.627910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cad045-6e5a-4500-86ac-5934141b5d7a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:18.632859 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 418/829] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:39:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:18.634333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1fff2-88cc-4a75-871c-ade2e44ec43f None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:18.634826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1fff2-88cc-4a75-871c-ade2e44ec43f None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:18.635311 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1fff2-88cc-4a75-871c-ade2e44ec43f None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:18.636740 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 412/830] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Sep 6 22:39:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:18.637021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 419/831] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:18.644471 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011a076-3724-4060-ad46-49e0f302957a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:18.644471 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011a076-3724-4060-ad46-49e0f302957a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:18.644471 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011a076-3724-4060-ad46-49e0f302957a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:18.645652 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1fff2-88cc-4a75-871c-ade2e44ec43f None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:18.663214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d011a076-3724-4060-ad46-49e0f302957a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:18.664665 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d011a076-3724-4060-ad46-49e0f302957a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:18.744193 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 413/832] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 22:39:18.745090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011a076-3724-4060-ad46-49e0f302957a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:18.777719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:18.783541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1fff2-88cc-4a75-871c-ade2e44ec43f None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:18.864560 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfe1d9-6434-449b-ae91-97b7bb57bf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:18.865189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfe1d9-6434-449b-ae91-97b7bb57bf97 None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:18.865463 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfe1d9-6434-449b-ae91-97b7bb57bf97 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:18.865861 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfe1d9-6434-449b-ae91-97b7bb57bf97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:18.868863 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfe1d9-6434-449b-ae91-97b7bb57bf97 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:18.873146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfe1d9-6434-449b-ae91-97b7bb57bf97 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:18.926755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011a076-3724-4060-ad46-49e0f302957a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:18.949776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:18.965331 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d18b33-15bc-4a86-b8b5-5a808303a250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:18.965954 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d18b33-15bc-4a86-b8b5-5a808303a250 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:18.966233 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d18b33-15bc-4a86-b8b5-5a808303a250 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:18.966511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d18b33-15bc-4a86-b8b5-5a808303a250 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:18.967363 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d18b33-15bc-4a86-b8b5-5a808303a250 None admin] RBAC: Adding query filter params (role.id=aa2332d1bdb74e48a88ed7c2a7ed2990, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=b18fd296138349408613004929144e70) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:18.967680 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d18b33-15bc-4a86-b8b5-5a808303a250 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:18.971841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d18b33-15bc-4a86-b8b5-5a808303a250 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:18.977168 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 420/833] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:39:18 2022] POST /identity/v3/endpoints => generated 337 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:39:18.983769 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 414/834] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:39:18 2022] GET /identity/v3/role_assignments?user.id=b18fd296138349408613004929144e70&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:19.082033 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfe1d9-6434-449b-ae91-97b7bb57bf97 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:19.217064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfe1d9-6434-449b-ae91-97b7bb57bf97 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:19.270143 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa34444-df0a-4c8f-a4e2-1e75b5c18f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:19.271118 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa34444-df0a-4c8f-a4e2-1e75b5c18f0e None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:19.271597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa34444-df0a-4c8f-a4e2-1e75b5c18f0e None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:19.272061 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa34444-df0a-4c8f-a4e2-1e75b5c18f0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:19.286443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa34444-df0a-4c8f-a4e2-1e75b5c18f0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:39:19.292192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-6fa34444-df0a-4c8f-a4e2-1e75b5c18f0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:39:19.292192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:19.292192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:19.292192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:19.292192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:19.292192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:19.292192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:19.292192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:19.292192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:19.292192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:19.292192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:19.292192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:19.292192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:39:19.292192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:39:19.292192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:39:19.292192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:39:19.293231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:39:19.293231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:39:19.293231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:39:19.293231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:39:19.293231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:19.293231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:19.293231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:19.293231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:19.293231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:19.293231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:19.293231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:19.293231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:19.293231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:19.293231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:19.293231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:19.293231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:19.294094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:19.294094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:19.294094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:19.294094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:19.294094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:39:19.294094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:39:19.294094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:39:19.294094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:39:19.294094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:39:19.294094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:39:19.294094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:39:19.294094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:19.294746 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 421/835] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:39:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:19.300991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d18b33-15bc-4a86-b8b5-5a808303a250 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:19.424798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d18b33-15bc-4a86-b8b5-5a808303a250 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:19.464357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bbcf9-5d22-4ce2-a7ba-2b944f09709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:19.465323 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bbcf9-5d22-4ce2-a7ba-2b944f09709b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:19.465783 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bbcf9-5d22-4ce2-a7ba-2b944f09709b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:19.466258 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bbcf9-5d22-4ce2-a7ba-2b944f09709b None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:19.467166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bbcf9-5d22-4ce2-a7ba-2b944f09709b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:19.467646 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bbcf9-5d22-4ce2-a7ba-2b944f09709b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:19.469268 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bbcf9-5d22-4ce2-a7ba-2b944f09709b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:19.478261 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 415/836] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:39:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:19.484461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa34444-df0a-4c8f-a4e2-1e75b5c18f0e None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:19.495788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:19.588996 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa34444-df0a-4c8f-a4e2-1e75b5c18f0e None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:19.626072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bd86a-8a99-490c-9956-0f7e34889bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:19.626766 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bd86a-8a99-490c-9956-0f7e34889bac None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:19.627045 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bd86a-8a99-490c-9956-0f7e34889bac None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:19.627314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bd86a-8a99-490c-9956-0f7e34889bac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:19.639013 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00bd86a-8a99-490c-9956-0f7e34889bac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:19.640485 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00bd86a-8a99-490c-9956-0f7e34889bac None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:19.655257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-d00bd86a-8a99-490c-9956-0f7e34889bac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:19.655257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:19.655257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:19.655257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:19.655257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:19.655257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:19.655257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:19.655257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:19.655257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:19.655257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:19.655257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:19.655257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:19.655257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:19.655257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:19.655257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:19.655257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:19.656282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:19.656282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:19.656282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:19.656282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:19.656282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:19.656282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:19.656282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:19.656282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:19.656282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:19.656282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:19.656282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:19.656282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:19.656282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:19.656282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:19.656282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:19.656282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:19.656282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:19.657232 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:19.657232 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:19.657232 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:19.657232 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 422/837] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:19.662150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bbcf9-5d22-4ce2-a7ba-2b944f09709b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:19.711270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:19.767591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bbcf9-5d22-4ce2-a7ba-2b944f09709b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:19.807789 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9086266-7d91-4a64-b4e6-defda8c7508d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:19.808973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9086266-7d91-4a64-b4e6-defda8c7508d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:19.809252 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9086266-7d91-4a64-b4e6-defda8c7508d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:19.809523 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9086266-7d91-4a64-b4e6-defda8c7508d None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:19.810176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9086266-7d91-4a64-b4e6-defda8c7508d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:19.810476 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9086266-7d91-4a64-b4e6-defda8c7508d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:19.811857 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9086266-7d91-4a64-b4e6-defda8c7508d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:19.824692 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 416/838] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:19.830439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bd86a-8a99-490c-9956-0f7e34889bac None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:19.894758 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:19.938177 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bd86a-8a99-490c-9956-0f7e34889bac None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:19.975242 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a13a6-ed19-4791-a2ce-3523734d6d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:19.976222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a13a6-ed19-4791-a2ce-3523734d6d14 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:19.976738 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a13a6-ed19-4791-a2ce-3523734d6d14 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:19.977198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a13a6-ed19-4791-a2ce-3523734d6d14 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:19.987142 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a13a6-ed19-4791-a2ce-3523734d6d14 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:19.989045 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a13a6-ed19-4791-a2ce-3523734d6d14 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:20.002943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-417a13a6-ed19-4791-a2ce-3523734d6d14 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 22:39:20.002943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:20.002943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:20.002943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:20.002943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:20.002943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:20.002943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:20.002943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:20.002943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:20.002943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:20.002943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:20.002943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:20.002943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:39:20.002943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:39:20.002943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:39:20.002943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:39:20.003963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:20.003963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:20.003963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:39:20.003963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:20.003963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:39:20.003963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:20.003963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:20.003963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:20.003963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:20.003963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:20.003963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:20.003963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:20.003963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:20.003963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:20.003963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:20.003963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:20.003963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:20.003963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:20.004966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:20.004966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:20.004966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:39:20.004966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:39:20.004966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:39:20.004966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:39:20.004966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:39:20.004966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:39:20.004966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 22:39:20.004966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:20.004966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 423/839] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:39:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:20.011950 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9086266-7d91-4a64-b4e6-defda8c7508d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:20.092320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0732ec-be1e-4813-a250-386c7aef3f8f None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:20.092665 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0732ec-be1e-4813-a250-386c7aef3f8f None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:20.092989 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0732ec-be1e-4813-a250-386c7aef3f8f None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:20.094602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 424/840] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:20.099484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f50eb6-b456-468b-aca2-edb571c23f34 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:20.099771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f50eb6-b456-468b-aca2-edb571c23f34 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:20.100051 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f50eb6-b456-468b-aca2-edb571c23f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:20.122907 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-78f50eb6-b456-468b-aca2-edb571c23f34 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:20.124110 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-78f50eb6-b456-468b-aca2-edb571c23f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:20.139999 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9086266-7d91-4a64-b4e6-defda8c7508d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:20.149040 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:20.179540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8813a1-7187-45ec-a0e2-f1c6137465c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:20.180240 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8813a1-7187-45ec-a0e2-f1c6137465c3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:20.180570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8813a1-7187-45ec-a0e2-f1c6137465c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:20.181174 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8813a1-7187-45ec-a0e2-f1c6137465c3 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:20.182265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8813a1-7187-45ec-a0e2-f1c6137465c3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:20.183077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8813a1-7187-45ec-a0e2-f1c6137465c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:20.184621 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8813a1-7187-45ec-a0e2-f1c6137465c3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:20.203478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 417/841] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Sep 6 22:39:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:20.203887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 425/842] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 22:39:20.216564 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8813a1-7187-45ec-a0e2-f1c6137465c3 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:20.325047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8813a1-7187-45ec-a0e2-f1c6137465c3 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:20.361139 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03befa99-b61d-4a6b-aec9-3624282ea1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:20.361680 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03befa99-b61d-4a6b-aec9-3624282ea1d5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:20.361966 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03befa99-b61d-4a6b-aec9-3624282ea1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:20.362239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03befa99-b61d-4a6b-aec9-3624282ea1d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:20.396860 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:20.432384 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03befa99-b61d-4a6b-aec9-3624282ea1d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:20.433918 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03befa99-b61d-4a6b-aec9-3624282ea1d5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:20.494398 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f50eb6-b456-468b-aca2-edb571c23f34 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:20.544776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 418/843] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:39:20 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 22:39:20.549946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03befa99-b61d-4a6b-aec9-3624282ea1d5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:20.563535 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:20.623179 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:20.632933 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f50eb6-b456-468b-aca2-edb571c23f34 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:20.664518 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03befa99-b61d-4a6b-aec9-3624282ea1d5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:20.687394 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc39a75-f403-4802-a610-0e4c8af97940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:20.688396 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc39a75-f403-4802-a610-0e4c8af97940 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:20.688911 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc39a75-f403-4802-a610-0e4c8af97940 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:20.689360 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc39a75-f403-4802-a610-0e4c8af97940 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:20.690839 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc39a75-f403-4802-a610-0e4c8af97940 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:20.692826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc39a75-f403-4802-a610-0e4c8af97940 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:20.706348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-ecc39a75-f403-4802-a610-0e4c8af97940 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 22:39:20.706348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:20.706348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:20.706348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:20.706348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:20.706348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:20.706348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:20.706348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:20.706348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 22:39:20.706348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:20.706348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:20.706348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:20.706348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:20.706348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:20.706348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:20.706348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:20.706348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:20.707392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:20.707392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:20.707392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:20.707392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:20.707392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:20.707392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:20.707392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:20.707392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:20.707392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:20.707392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:20.707392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:20.707392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:20.707392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:20.707392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:20.707392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:20.707392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:20.708224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:20.708224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:20.708224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:20.708224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:20.708224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:20.708224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:20.708224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:20.708224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:20.708224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:20.708224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:20.708224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:20.708224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:20.708224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 22:39:20.708224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:20.709159 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1286d58-ba27-4949-9912-51b2f8c76c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:20.709159 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1286d58-ba27-4949-9912-51b2f8c76c92 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:20.709159 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1286d58-ba27-4949-9912-51b2f8c76c92 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:20.709159 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1286d58-ba27-4949-9912-51b2f8c76c92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:20.711591 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 426/844] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:39:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:20.720166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc39a75-f403-4802-a610-0e4c8af97940 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:20.720859 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1286d58-ba27-4949-9912-51b2f8c76c92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:20.724454 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1286d58-ba27-4949-9912-51b2f8c76c92 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:20.737659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-f1286d58-ba27-4949-9912-51b2f8c76c92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:20.737659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:20.737659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:20.737659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:20.737659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:20.737659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:20.737659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:20.737659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:20.737659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:20.737659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:20.737659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:20.737659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:20.737659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:20.737659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:20.737659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:20.737659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:20.738820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:20.738820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:20.738820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:20.738820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:20.738820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:20.738820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:20.738820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:20.738820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:20.738820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:20.738820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:20.738820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:20.738820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:20.738820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:20.738820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:20.738820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:20.738820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:20.738820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:20.739917 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:20.739917 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:20.739917 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:20.739917 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 419/845] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:20.746075 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1286d58-ba27-4949-9912-51b2f8c76c92 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:20.834531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc39a75-f403-4802-a610-0e4c8af97940 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:20.848548 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:20.849081 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1286d58-ba27-4949-9912-51b2f8c76c92 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:20.864941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:20.870951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2c39a-2386-400c-8275-8e2fad99595a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:20.871565 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2c39a-2386-400c-8275-8e2fad99595a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:20.871850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2c39a-2386-400c-8275-8e2fad99595a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:20.872148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2c39a-2386-400c-8275-8e2fad99595a None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:20.872877 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2c39a-2386-400c-8275-8e2fad99595a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:20.873233 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2c39a-2386-400c-8275-8e2fad99595a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:20.874539 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2c39a-2386-400c-8275-8e2fad99595a None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:20.879836 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 427/846] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:39:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:20.881690 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bbb80-6a6f-4c6c-819b-c93a0e7af224 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:20.888777 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bbb80-6a6f-4c6c-819b-c93a0e7af224 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:20.888777 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bbb80-6a6f-4c6c-819b-c93a0e7af224 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:20.888957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dee22-3a48-4c54-9804-5a88e771c43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:20.888957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dee22-3a48-4c54-9804-5a88e771c43b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:20.888957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dee22-3a48-4c54-9804-5a88e771c43b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:20.888957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dee22-3a48-4c54-9804-5a88e771c43b None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:20.889238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dee22-3a48-4c54-9804-5a88e771c43b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:20.889238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dee22-3a48-4c54-9804-5a88e771c43b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:20.889238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dee22-3a48-4c54-9804-5a88e771c43b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:20.889722 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 428/847] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:20.890798 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bbb80-6a6f-4c6c-819b-c93a0e7af224 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:20.904457 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 420/848] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:20.905705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3deda1-5eba-4197-92a1-b495f4755e09 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:20.905992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3deda1-5eba-4197-92a1-b495f4755e09 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:20.906270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3deda1-5eba-4197-92a1-b495f4755e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:20.923847 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-fb3deda1-5eba-4197-92a1-b495f4755e09 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:20.925075 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fb3deda1-5eba-4197-92a1-b495f4755e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:20.995770 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 421/849] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:20.996953 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3deda1-5eba-4197-92a1-b495f4755e09 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:21.019498 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bbb80-6a6f-4c6c-819b-c93a0e7af224 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:21.057215 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75839cc2-fb32-4386-840a-9cd9fe20884f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:21.058822 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75839cc2-fb32-4386-840a-9cd9fe20884f None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:21.059199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75839cc2-fb32-4386-840a-9cd9fe20884f None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:21.059567 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75839cc2-fb32-4386-840a-9cd9fe20884f None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:21.060296 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75839cc2-fb32-4386-840a-9cd9fe20884f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:21.060720 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75839cc2-fb32-4386-840a-9cd9fe20884f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:21.062602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75839cc2-fb32-4386-840a-9cd9fe20884f None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:21.076468 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 429/850] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:39:20 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:21.124610 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3deda1-5eba-4197-92a1-b495f4755e09 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:21.132835 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:21.163476 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e19ca-ff61-4f7e-829a-80091380cf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:21.164283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e19ca-ff61-4f7e-829a-80091380cf1f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:21.164785 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e19ca-ff61-4f7e-829a-80091380cf1f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:21.165161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e19ca-ff61-4f7e-829a-80091380cf1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:21.173815 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e19ca-ff61-4f7e-829a-80091380cf1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:21.175463 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e19ca-ff61-4f7e-829a-80091380cf1f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:21.188638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-684e19ca-ff61-4f7e-829a-80091380cf1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:21.188638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:21.188638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:21.188638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:21.188638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:21.188638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:21.188638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:21.188638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:21.188638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:21.188638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:21.188638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:21.188638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:21.188638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:39:21.188638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:39:21.188638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:39:21.189757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:39:21.189757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:21.189757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:21.189757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:21.189757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:21.189757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:21.189757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:21.189757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:21.189757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:21.189757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:21.189757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:21.189757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:21.189757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:21.189757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:21.189757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:21.189757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:21.189757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:21.190854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:39:21.190854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:39:21.190854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:39:21.190854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:39:21.190854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:39:21.190854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:39:21.190854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:21.190854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:21.193178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 422/851] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:21.201523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75839cc2-fb32-4386-840a-9cd9fe20884f None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:21.250151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:21.298639 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e19ca-ff61-4f7e-829a-80091380cf1f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:21.312769 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75839cc2-fb32-4386-840a-9cd9fe20884f None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:21.352235 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbe3d7-691f-4dd4-ab43-475e57e54907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:21.352885 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbe3d7-691f-4dd4-ab43-475e57e54907 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:21.353168 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbe3d7-691f-4dd4-ab43-475e57e54907 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:21.353447 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbe3d7-691f-4dd4-ab43-475e57e54907 None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:21.354144 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbe3d7-691f-4dd4-ab43-475e57e54907 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:21.354452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbe3d7-691f-4dd4-ab43-475e57e54907 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:21.356548 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbe3d7-691f-4dd4-ab43-475e57e54907 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:21.371018 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 430/852] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:39:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:21.377545 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbe3d7-691f-4dd4-ab43-475e57e54907 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:21.441968 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e19ca-ff61-4f7e-829a-80091380cf1f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:21.489531 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdb0bf-bdbd-4328-9af8-c5e2e809998b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:21.490173 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdb0bf-bdbd-4328-9af8-c5e2e809998b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:21.490451 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdb0bf-bdbd-4328-9af8-c5e2e809998b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:21.490721 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdb0bf-bdbd-4328-9af8-c5e2e809998b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:21.505419 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdb0bf-bdbd-4328-9af8-c5e2e809998b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:39:21.510955 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbe3d7-691f-4dd4-ab43-475e57e54907 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:21.512085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-12bdb0bf-bdbd-4328-9af8-c5e2e809998b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:39:21.512085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:21.512085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:21.512085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:21.512085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:21.512085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:21.512085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:21.512085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:21.512085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:21.512085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:21.512085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:21.512085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:21.512085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:39:21.512085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:39:21.512085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:39:21.512085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:39:21.513053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:39:21.513053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:39:21.513053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:39:21.513053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:39:21.513053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:21.513053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:21.513053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:21.513053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:21.513053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:21.513053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:21.513053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:21.513053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:21.513053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:21.513053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:21.513053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:21.513053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:21.514072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:21.514072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:21.514072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:21.514072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:21.514072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:39:21.514072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:39:21.514072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:39:21.514072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:39:21.514072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:39:21.514072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:39:21.514072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:39:21.514072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:21.514072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 423/853] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:39:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:21.515925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:21.518890 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdb0bf-bdbd-4328-9af8-c5e2e809998b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:21.554870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:21.560016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd7100-a6c9-4fc2-adec-a7fb336983df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:21.560665 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd7100-a6c9-4fc2-adec-a7fb336983df None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:21.560944 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd7100-a6c9-4fc2-adec-a7fb336983df None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:21.561269 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd7100-a6c9-4fc2-adec-a7fb336983df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:21.561942 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd7100-a6c9-4fc2-adec-a7fb336983df None admin] RBAC: Adding query filter params (role.id=aa2332d1bdb74e48a88ed7c2a7ed2990, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=660248a90f524a43b143bae127e0eaa1) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:21.562245 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd7100-a6c9-4fc2-adec-a7fb336983df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:21.563667 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd7100-a6c9-4fc2-adec-a7fb336983df None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:21.574719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 431/854] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:39:21 2022] GET /identity/v3/role_assignments?user.id=660248a90f524a43b143bae127e0eaa1&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:21.574719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f7d2f-40d6-4d67-a75c-6cafe5b1d723 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:21.574719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f7d2f-40d6-4d67-a75c-6cafe5b1d723 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:21.574719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f7d2f-40d6-4d67-a75c-6cafe5b1d723 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:21.574719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 432/855] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:21.579088 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd0d5d-a987-4e1e-a0f3-35332961170b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:21.579753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd0d5d-a987-4e1e-a0f3-35332961170b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:21.580046 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd0d5d-a987-4e1e-a0f3-35332961170b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:21.600354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-d4cd0d5d-a987-4e1e-a0f3-35332961170b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:21.601734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d4cd0d5d-a987-4e1e-a0f3-35332961170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:21.654232 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdb0bf-bdbd-4328-9af8-c5e2e809998b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:21.688602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 433/856] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 22:39:21.707638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e96417-9704-478d-83e9-504a7e8a6283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:21.711019 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e96417-9704-478d-83e9-504a7e8a6283 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:21.711019 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e96417-9704-478d-83e9-504a7e8a6283 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:21.711019 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e96417-9704-478d-83e9-504a7e8a6283 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:21.711019 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e96417-9704-478d-83e9-504a7e8a6283 None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:21.711019 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e96417-9704-478d-83e9-504a7e8a6283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:21.711608 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e96417-9704-478d-83e9-504a7e8a6283 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:21.722311 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 424/857] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:39:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:21.727797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd0d5d-a987-4e1e-a0f3-35332961170b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:21.830442 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:21.837162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd0d5d-a987-4e1e-a0f3-35332961170b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:21.874458 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de172aa9-e08b-48cf-b587-b0b7e1003c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:21.875361 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de172aa9-e08b-48cf-b587-b0b7e1003c16 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:21.875643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de172aa9-e08b-48cf-b587-b0b7e1003c16 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:21.875916 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de172aa9-e08b-48cf-b587-b0b7e1003c16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:21.887764 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de172aa9-e08b-48cf-b587-b0b7e1003c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:21.889261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de172aa9-e08b-48cf-b587-b0b7e1003c16 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:21.905212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-de172aa9-e08b-48cf-b587-b0b7e1003c16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:21.905212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:21.905212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:21.905212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:21.905212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:21.905212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:21.905212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:21.905212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:21.905212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:21.905212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:21.905212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:21.905212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:21.905212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:21.905212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:21.905212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:21.905212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:21.906195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:21.906195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:21.906195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:21.906195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:21.906195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:21.906195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:21.906195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:21.906195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:21.906195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:21.906195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:21.906195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:21.906195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:21.906195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:21.906195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:21.906195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:21.906195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:21.906195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:21.907121 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:21.907121 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:21.907121 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:21.907121 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 434/858] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:21.913779 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e96417-9704-478d-83e9-504a7e8a6283 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:21.953002 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de172aa9-e08b-48cf-b587-b0b7e1003c16 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:22.025599 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:22.042353 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e96417-9704-478d-83e9-504a7e8a6283 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:22.075522 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de172aa9-e08b-48cf-b587-b0b7e1003c16 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:22.080880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575e512-5484-4ccc-a0a8-9f8c26b8a18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:22.081726 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575e512-5484-4ccc-a0a8-9f8c26b8a18f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:22.082146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575e512-5484-4ccc-a0a8-9f8c26b8a18f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:22.082560 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575e512-5484-4ccc-a0a8-9f8c26b8a18f None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:22.083353 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575e512-5484-4ccc-a0a8-9f8c26b8a18f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:22.083796 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575e512-5484-4ccc-a0a8-9f8c26b8a18f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:22.085336 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575e512-5484-4ccc-a0a8-9f8c26b8a18f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:22.100069 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 425/859] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:22.106458 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575e512-5484-4ccc-a0a8-9f8c26b8a18f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:22.124291 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429b8bc-db98-4be1-a051-05ca4a484605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:22.124973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429b8bc-db98-4be1-a051-05ca4a484605 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:22.125251 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429b8bc-db98-4be1-a051-05ca4a484605 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:22.125517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429b8bc-db98-4be1-a051-05ca4a484605 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:22.126098 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429b8bc-db98-4be1-a051-05ca4a484605 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:22.127449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429b8bc-db98-4be1-a051-05ca4a484605 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:22.137015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-2429b8bc-db98-4be1-a051-05ca4a484605 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 22:39:22.137015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:22.137015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:22.137015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:22.137015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:22.137015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:22.137015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:22.137015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:22.137015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 22:39:22.137015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:22.137015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:22.137015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:22.137015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:22.137015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:22.137015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:22.137015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:22.137985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:22.137985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:22.137985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:22.137985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:22.137985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:22.137985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:22.137985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:22.137985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:22.137985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:22.137985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:22.137985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:22.137985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:22.137985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:22.137985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:22.137985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:22.137985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:22.137985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:22.138887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:22.138887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:22.138887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:22.138887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:22.138887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:22.138887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:22.138887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:22.138887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:22.138887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:22.138887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:22.138887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:22.138887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:22.138887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 22:39:22.138887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:22.142921 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 435/860] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Sep 6 22:39:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:22.143776 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429b8bc-db98-4be1-a051-05ca4a484605 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:22.160564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:22.244396 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575e512-5484-4ccc-a0a8-9f8c26b8a18f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:22.262908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429b8bc-db98-4be1-a051-05ca4a484605 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:22.291090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18317d66-43e2-44bd-a175-4ee445319ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:22.291725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18317d66-43e2-44bd-a175-4ee445319ceb None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:22.292047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18317d66-43e2-44bd-a175-4ee445319ceb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:22.292319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18317d66-43e2-44bd-a175-4ee445319ceb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:22.299944 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18317d66-43e2-44bd-a175-4ee445319ceb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:22.301534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18317d66-43e2-44bd-a175-4ee445319ceb None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:22.302756 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75f57c-1bcf-4c73-aa7e-cfb23773498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:22.303626 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75f57c-1bcf-4c73-aa7e-cfb23773498b None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:22.303978 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75f57c-1bcf-4c73-aa7e-cfb23773498b None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:22.304852 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75f57c-1bcf-4c73-aa7e-cfb23773498b None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:22.305486 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75f57c-1bcf-4c73-aa7e-cfb23773498b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:22.305787 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75f57c-1bcf-4c73-aa7e-cfb23773498b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:22.307183 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75f57c-1bcf-4c73-aa7e-cfb23773498b None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:22.312365 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 436/861] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Sep 6 22:39:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:22.313931 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-18317d66-43e2-44bd-a175-4ee445319ceb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 22:39:22.313931 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:22.313931 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:22.313931 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:22.313931 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:22.313931 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:22.313931 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:22.313931 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:22.313931 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:22.313931 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:22.313931 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:22.313931 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:22.313931 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:39:22.313931 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:39:22.313931 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:39:22.313931 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:39:22.314879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:22.314879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:22.314879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:39:22.314879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:22.314879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:39:22.314879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:22.314879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:22.314879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:22.314879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:22.314879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:22.314879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:22.314879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:22.314879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:22.314879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:22.314879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:22.314879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:22.314879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:22.314879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:22.315862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:22.315862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:22.315862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:39:22.315862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:39:22.315862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:39:22.315862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:39:22.315862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:39:22.315862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:39:22.315862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 22:39:22.315862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:22.315862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 426/862] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Sep 6 22:39:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:22.317973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75f57c-1bcf-4c73-aa7e-cfb23773498b None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:22.322284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18317d66-43e2-44bd-a175-4ee445319ceb None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:22.335030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:22.410272 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:22.434470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75f57c-1bcf-4c73-aa7e-cfb23773498b None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:22.458879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18317d66-43e2-44bd-a175-4ee445319ceb None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:22.471985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e76d9-635f-4e1d-a46f-deb7186ec41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:22.472786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e76d9-635f-4e1d-a46f-deb7186ec41d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:22.473337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e76d9-635f-4e1d-a46f-deb7186ec41d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:22.473556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e76d9-635f-4e1d-a46f-deb7186ec41d None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:22.474373 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e76d9-635f-4e1d-a46f-deb7186ec41d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:22.474726 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e76d9-635f-4e1d-a46f-deb7186ec41d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:22.476148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e76d9-635f-4e1d-a46f-deb7186ec41d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:22.488454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 437/863] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Sep 6 22:39:22 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:22.508949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee72f2b-1ec8-4389-bbff-98c90e65147c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:22.509616 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee72f2b-1ec8-4389-bbff-98c90e65147c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:22.509905 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee72f2b-1ec8-4389-bbff-98c90e65147c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:22.510180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee72f2b-1ec8-4389-bbff-98c90e65147c None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:22.511502 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee72f2b-1ec8-4389-bbff-98c90e65147c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:22.511802 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee72f2b-1ec8-4389-bbff-98c90e65147c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:22.513436 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee72f2b-1ec8-4389-bbff-98c90e65147c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:22.534411 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 427/864] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Sep 6 22:39:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:22.540073 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e76d9-635f-4e1d-a46f-deb7186ec41d None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:22.657691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e76d9-635f-4e1d-a46f-deb7186ec41d None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:22.695105 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1ad55-5750-4e50-9f65-8070dbb03db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:22.696012 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1ad55-5750-4e50-9f65-8070dbb03db3 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:22.696293 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1ad55-5750-4e50-9f65-8070dbb03db3 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:22.696594 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1ad55-5750-4e50-9f65-8070dbb03db3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:22.709465 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:22.767622 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1ad55-5750-4e50-9f65-8070dbb03db3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:22.769093 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1ad55-5750-4e50-9f65-8070dbb03db3 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:22.869907 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 438/865] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:39:22 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 22:39:22.876045 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee72f2b-1ec8-4389-bbff-98c90e65147c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:22.950627 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:22.986934 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee72f2b-1ec8-4389-bbff-98c90e65147c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:23.022596 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a6579-7971-4da3-871c-bef38ccf6823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:23.023242 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a6579-7971-4da3-871c-bef38ccf6823 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:23.023517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a6579-7971-4da3-871c-bef38ccf6823 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:23.023784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a6579-7971-4da3-871c-bef38ccf6823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:23.034491 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a6579-7971-4da3-871c-bef38ccf6823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:23.035954 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a6579-7971-4da3-871c-bef38ccf6823 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:23.051437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-218a6579-7971-4da3-871c-bef38ccf6823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:23.051437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:23.051437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:23.051437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:23.051437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:23.051437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:23.051437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:23.051437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:23.051437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:23.051437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:23.051437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:23.051437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:23.051437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:23.051437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:23.051437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:23.051437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:23.052447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:23.052447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:23.052447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:23.052447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:23.052447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:23.052447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:23.052447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:23.052447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:23.052447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:23.052447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:23.052447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:23.052447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:23.052447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:23.052447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:23.052447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:23.052447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:23.052447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:23.053358 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:23.053358 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:23.053358 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:23.053358 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 428/866] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:23.060259 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1ad55-5750-4e50-9f65-8070dbb03db3 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:23.105162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:23.167686 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1ad55-5750-4e50-9f65-8070dbb03db3 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:23.203865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc072e3-be4b-47df-a101-4b3c09f77050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:23.205087 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc072e3-be4b-47df-a101-4b3c09f77050 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:23.205572 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc072e3-be4b-47df-a101-4b3c09f77050 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:23.206043 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc072e3-be4b-47df-a101-4b3c09f77050 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:23.206891 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc072e3-be4b-47df-a101-4b3c09f77050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:23.207407 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc072e3-be4b-47df-a101-4b3c09f77050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:23.209004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc072e3-be4b-47df-a101-4b3c09f77050 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:23.222516 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 439/867] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:23.228329 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a6579-7971-4da3-871c-bef38ccf6823 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:23.339978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a6579-7971-4da3-871c-bef38ccf6823 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:23.358340 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:23.369726 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d9aec-343c-429f-b14a-73a4409ef63c None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:23.370037 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d9aec-343c-429f-b14a-73a4409ef63c None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:23.370393 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d9aec-343c-429f-b14a-73a4409ef63c None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:23.371868 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 440/868] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:23.375374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7dd0c-4fd2-470a-83bb-1f4025459152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:23.376234 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7dd0c-4fd2-470a-83bb-1f4025459152 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:23.377017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7dd0c-4fd2-470a-83bb-1f4025459152 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:23.377122 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e66c79-002d-481e-ba6f-355c65d449ef None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:23.377215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7dd0c-4fd2-470a-83bb-1f4025459152 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:23.377466 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e66c79-002d-481e-ba6f-355c65d449ef None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:23.377747 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e66c79-002d-481e-ba6f-355c65d449ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:23.384775 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7dd0c-4fd2-470a-83bb-1f4025459152 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:23.386528 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7dd0c-4fd2-470a-83bb-1f4025459152 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:23.396183 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-35e66c79-002d-481e-ba6f-355c65d449ef None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:23.397439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-35e66c79-002d-481e-ba6f-355c65d449ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:23.399299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ebb7dd0c-4fd2-470a-83bb-1f4025459152 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:23.399299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:23.399299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:23.399299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:23.399299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:23.399299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:23.399299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:23.399299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:23.399299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:23.399299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:23.399299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:23.399299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:23.399299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:39:23.399299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:39:23.399299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:39:23.400352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:39:23.400352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:23.400352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:23.400352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:23.400352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:23.400352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:23.400352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:23.400352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:23.400352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:23.400352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:23.400352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:23.400352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:23.400352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:23.400352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:23.400352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:23.400352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:23.400352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:23.402042 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:39:23.402042 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:39:23.402042 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:39:23.402042 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:39:23.402042 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:39:23.402042 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:39:23.402042 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:23.402042 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:23.404090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 429/869] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:23.414048 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7dd0c-4fd2-470a-83bb-1f4025459152 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:23.481841 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 441/870] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 22:39:23.542745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7dd0c-4fd2-470a-83bb-1f4025459152 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:23.577992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be807f38-9d63-468e-bcef-07a49450ba20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:23.578608 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be807f38-9d63-468e-bcef-07a49450ba20 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:23.578890 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be807f38-9d63-468e-bcef-07a49450ba20 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:23.579402 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be807f38-9d63-468e-bcef-07a49450ba20 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:23.580111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be807f38-9d63-468e-bcef-07a49450ba20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:23.580414 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be807f38-9d63-468e-bcef-07a49450ba20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:23.581859 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be807f38-9d63-468e-bcef-07a49450ba20 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:23.594923 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 430/871] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:39:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:23.600975 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e66c79-002d-481e-ba6f-355c65d449ef None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:23.635141 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:23.719571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e66c79-002d-481e-ba6f-355c65d449ef None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:23.754158 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2470b9-45eb-46f2-8bfd-4e7a5a76c23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:23.754767 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2470b9-45eb-46f2-8bfd-4e7a5a76c23a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:23.755042 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2470b9-45eb-46f2-8bfd-4e7a5a76c23a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:23.755311 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2470b9-45eb-46f2-8bfd-4e7a5a76c23a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:23.756028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2470b9-45eb-46f2-8bfd-4e7a5a76c23a None admin] RBAC: Adding query filter params (role.id=85bcc17628d742209f79cc936d4290b5, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=642d4bef7e9c459a8d2dde636094b528) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:23.756328 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2470b9-45eb-46f2-8bfd-4e7a5a76c23a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:23.757839 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2470b9-45eb-46f2-8bfd-4e7a5a76c23a None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:23.764834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 442/872] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:39:23 2022] GET /identity/v3/role_assignments?user.id=642d4bef7e9c459a8d2dde636094b528&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=85bcc17628d742209f79cc936d4290b5 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:23.769815 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be807f38-9d63-468e-bcef-07a49450ba20 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:23.818654 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:23.887730 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be807f38-9d63-468e-bcef-07a49450ba20 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:23.926568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d02bfe-b83f-49c9-8581-9e1b05e94e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:23.927260 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d02bfe-b83f-49c9-8581-9e1b05e94e55 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:23.927537 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d02bfe-b83f-49c9-8581-9e1b05e94e55 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:23.927806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d02bfe-b83f-49c9-8581-9e1b05e94e55 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:23.928577 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d02bfe-b83f-49c9-8581-9e1b05e94e55 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:23.929978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d02bfe-b83f-49c9-8581-9e1b05e94e55 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:23.934643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279807a-5b8d-49f3-9980-f1bf798d15e8 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:23.934928 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279807a-5b8d-49f3-9980-f1bf798d15e8 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:23.935191 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279807a-5b8d-49f3-9980-f1bf798d15e8 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:23.936628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 443/873] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:39:23.942755 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8f4a7-80a5-4c7c-a7ba-c46f6ebe5867 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:23.943066 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8f4a7-80a5-4c7c-a7ba-c46f6ebe5867 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:23.943304 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8f4a7-80a5-4c7c-a7ba-c46f6ebe5867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:23.963614 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-07c8f4a7-80a5-4c7c-a7ba-c46f6ebe5867 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:23.964924 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-07c8f4a7-80a5-4c7c-a7ba-c46f6ebe5867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:23.997751 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 431/874] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Sep 6 22:39:23 2022] POST /identity/v3/services => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:39:24.061454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 444/875] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 22:39:24.337043 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d02bfe-b83f-49c9-8581-9e1b05e94e55 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:24.438409 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:24.445192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d02bfe-b83f-49c9-8581-9e1b05e94e55 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:24.480895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216140a7-d4ac-466b-ac40-6eb3d7fb2ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:24.481603 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216140a7-d4ac-466b-ac40-6eb3d7fb2ed1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:24.481881 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216140a7-d4ac-466b-ac40-6eb3d7fb2ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:24.482152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216140a7-d4ac-466b-ac40-6eb3d7fb2ed1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:24.482802 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216140a7-d4ac-466b-ac40-6eb3d7fb2ed1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:24.484413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216140a7-d4ac-466b-ac40-6eb3d7fb2ed1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:24.493841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-216140a7-d4ac-466b-ac40-6eb3d7fb2ed1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 22:39:24.493841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:24.493841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:24.493841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:24.493841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:24.493841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:24.493841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:24.493841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:24.493841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 22:39:24.493841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:24.493841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:24.493841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:24.493841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:24.493841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:24.493841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:24.493841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:24.493841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:24.494880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:24.494880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:24.494880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:24.494880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:24.494880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:24.494880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:24.494880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:24.494880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:24.494880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:24.494880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:24.494880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:24.494880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:24.494880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:24.494880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:24.494880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:24.494880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:24.495761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:24.495761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:24.495761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:24.495761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:24.495761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:24.495761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:24.495761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:24.495761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:24.495761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:24.495761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:24.495761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:24.495761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:24.495761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 22:39:24.495761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:24.495761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 432/876] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Sep 6 22:39:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:24.501181 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8f4a7-80a5-4c7c-a7ba-c46f6ebe5867 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:24.525570 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:24.612193 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8f4a7-80a5-4c7c-a7ba-c46f6ebe5867 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:24.649618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036008d-4597-49f5-8210-ae69813cac00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:24.650587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036008d-4597-49f5-8210-ae69813cac00 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:24.651146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036008d-4597-49f5-8210-ae69813cac00 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:24.652118 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036008d-4597-49f5-8210-ae69813cac00 None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:24.652962 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036008d-4597-49f5-8210-ae69813cac00 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:24.653460 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036008d-4597-49f5-8210-ae69813cac00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:24.655022 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036008d-4597-49f5-8210-ae69813cac00 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:24.660332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 445/877] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Sep 6 22:39:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:24.669806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216140a7-d4ac-466b-ac40-6eb3d7fb2ed1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:24.781732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216140a7-d4ac-466b-ac40-6eb3d7fb2ed1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:24.815858 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b02331-0b50-48b9-b5b9-dc250d18dbf9 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:24.816180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b02331-0b50-48b9-b5b9-dc250d18dbf9 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:24.816401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b02331-0b50-48b9-b5b9-dc250d18dbf9 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:24.817997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 446/878] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:39:24.818377 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd92ff-09c3-45db-97ce-83ffc8138966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:24.819089 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd92ff-09c3-45db-97ce-83ffc8138966 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:24.819378 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd92ff-09c3-45db-97ce-83ffc8138966 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:24.819656 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd92ff-09c3-45db-97ce-83ffc8138966 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:24.820297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd92ff-09c3-45db-97ce-83ffc8138966 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:24.820631 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd92ff-09c3-45db-97ce-83ffc8138966 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:24.822098 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd92ff-09c3-45db-97ce-83ffc8138966 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:24.822876 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd543bc-f49c-4aa9-bc73-a3f616d6b33b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:24.823716 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd543bc-f49c-4aa9-bc73-a3f616d6b33b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:24.823987 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd543bc-f49c-4aa9-bc73-a3f616d6b33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:24.827936 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 433/879] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Sep 6 22:39:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:24.844636 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-0dd543bc-f49c-4aa9-bc73-a3f616d6b33b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:24.845972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0dd543bc-f49c-4aa9-bc73-a3f616d6b33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:24.930089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 447/880] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:24 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 22:39:25.202291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd92ff-09c3-45db-97ce-83ffc8138966 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:25.230807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:25.311636 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd92ff-09c3-45db-97ce-83ffc8138966 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:25.349350 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e094c6-4cae-48fe-87d5-d2085dd76587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:25.349970 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e094c6-4cae-48fe-87d5-d2085dd76587 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:25.350247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e094c6-4cae-48fe-87d5-d2085dd76587 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:25.350521 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e094c6-4cae-48fe-87d5-d2085dd76587 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:25.351176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e094c6-4cae-48fe-87d5-d2085dd76587 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:25.352582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e094c6-4cae-48fe-87d5-d2085dd76587 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:25.440006 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 434/881] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Sep 6 22:39:25 2022] POST /identity/v3/services => generated 269 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:39:26.144353 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7d0be-a4cc-497d-8d75-7eaaa57faff8 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:26.145240 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7d0be-a4cc-497d-8d75-7eaaa57faff8 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:26.145665 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7d0be-a4cc-497d-8d75-7eaaa57faff8 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:26.147427 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 448/882] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:26.153651 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5df15-bfa1-4df6-93d4-b8dc2552e10e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:26.154209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5df15-bfa1-4df6-93d4-b8dc2552e10e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:26.154688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5df15-bfa1-4df6-93d4-b8dc2552e10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:26.173411 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b8d5df15-bfa1-4df6-93d4-b8dc2552e10e None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:26.175033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b8d5df15-bfa1-4df6-93d4-b8dc2552e10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:26.255181 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 435/883] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:26.301483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb30c6-7ee0-4a83-99bf-4caa64d8d17e None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:26.302108 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb30c6-7ee0-4a83-99bf-4caa64d8d17e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:26.302576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb30c6-7ee0-4a83-99bf-4caa64d8d17e None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:26.304366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 449/884] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:26.310381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490be50-5141-490d-9885-ce3048f35d4b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:26.310901 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490be50-5141-490d-9885-ce3048f35d4b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:26.311370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490be50-5141-490d-9885-ce3048f35d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:26.330473 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e490be50-5141-490d-9885-ce3048f35d4b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:26.331928 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e490be50-5141-490d-9885-ce3048f35d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:26.339675 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:26.408915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 436/885] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:26.522312 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb30c6-7ee0-4a83-99bf-4caa64d8d17e None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:26.539041 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:26.629609 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb30c6-7ee0-4a83-99bf-4caa64d8d17e None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:26.669310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a8eb8-7d33-4cf6-b175-385713195346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:26.669959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a8eb8-7d33-4cf6-b175-385713195346 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:26.670237 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a8eb8-7d33-4cf6-b175-385713195346 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:26.670505 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a8eb8-7d33-4cf6-b175-385713195346 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:26.681136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a8eb8-7d33-4cf6-b175-385713195346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:39:26.686541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-4e8a8eb8-7d33-4cf6-b175-385713195346 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 22:39:26.686541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:26.686541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:26.686541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:26.686541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:26.686541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:26.686541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:26.686541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:26.686541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:26.686541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:26.686541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:26.686541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:26.686541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:39:26.686541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:39:26.686541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:39:26.686541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:39:26.687483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:39:26.687483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:39:26.687483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:39:26.687483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:39:26.687483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:26.687483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:26.687483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:26.687483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:26.687483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:26.687483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:26.687483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:26.687483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:26.687483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:26.687483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:26.687483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:26.687483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:26.688337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:26.688337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:26.688337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:26.688337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:26.688337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:39:26.688337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:39:26.688337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:39:26.688337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:39:26.688337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:39:26.688337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:39:26.688337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 22:39:26.688337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:26.688337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 450/886] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Sep 6 22:39:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:26.694571 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490be50-5141-490d-9885-ce3048f35d4b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:26.707994 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a8eb8-7d33-4cf6-b175-385713195346 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:26.795007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:26.813594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490be50-5141-490d-9885-ce3048f35d4b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:26.820170 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a8eb8-7d33-4cf6-b175-385713195346 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:26.853208 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94866c5f-785f-41b8-baad-8af266e6b8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:26.854712 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94866c5f-785f-41b8-baad-8af266e6b8f6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:26.855340 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94866c5f-785f-41b8-baad-8af266e6b8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:26.855816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94866c5f-785f-41b8-baad-8af266e6b8f6 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:26.856577 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862cecb-cfa0-4c9a-bfa6-d891a17b6969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:26.856781 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94866c5f-785f-41b8-baad-8af266e6b8f6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:26.857265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94866c5f-785f-41b8-baad-8af266e6b8f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:26.857573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862cecb-cfa0-4c9a-bfa6-d891a17b6969 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:26.858013 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862cecb-cfa0-4c9a-bfa6-d891a17b6969 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:26.858426 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862cecb-cfa0-4c9a-bfa6-d891a17b6969 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:26.859130 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94866c5f-785f-41b8-baad-8af266e6b8f6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:26.859242 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862cecb-cfa0-4c9a-bfa6-d891a17b6969 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:26.860490 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862cecb-cfa0-4c9a-bfa6-d891a17b6969 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:26.868618 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 437/887] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Sep 6 22:39:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:26.873310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-7862cecb-cfa0-4c9a-bfa6-d891a17b6969 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 22:39:26.873310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:26.873310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:26.873310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:26.873310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:26.873310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:26.873310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:26.873310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:26.873310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 22:39:26.873310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:26.873310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:26.873310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:26.873310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:26.873310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:26.873310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:26.873310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:26.873310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:26.874334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:26.874334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:26.874334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:26.874334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:26.874334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:26.874334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:26.874334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:26.874334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:26.874334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:26.874334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:26.874334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:26.874334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:26.874334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:26.874334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:26.874334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:26.874334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:26.875190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:26.875190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:26.875190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:26.875190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:26.875190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:26.875190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:26.875190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:26.875190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:26.875190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:26.875190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:26.875190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:26.875190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:26.875190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 22:39:26.875190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:26.877009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94866c5f-785f-41b8-baad-8af266e6b8f6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:26.878612 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 451/888] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:39:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:26.885213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:26.885601 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862cecb-cfa0-4c9a-bfa6-d891a17b6969 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:27.002144 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862cecb-cfa0-4c9a-bfa6-d891a17b6969 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:27.010945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94866c5f-785f-41b8-baad-8af266e6b8f6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:27.043268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c08e4-c5cf-4259-9c05-d36f7b51db94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:27.043886 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c08e4-c5cf-4259-9c05-d36f7b51db94 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:27.044169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c08e4-c5cf-4259-9c05-d36f7b51db94 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:27.044471 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c08e4-c5cf-4259-9c05-d36f7b51db94 None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:27.045102 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c08e4-c5cf-4259-9c05-d36f7b51db94 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:27.045407 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c08e4-c5cf-4259-9c05-d36f7b51db94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:27.046776 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c08e4-c5cf-4259-9c05-d36f7b51db94 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:27.056392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478eeb1c-45c6-4c43-9550-e891bc131c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:27.056584 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 452/889] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:39:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:27.057378 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c08e4-c5cf-4259-9c05-d36f7b51db94 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:27.057824 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478eeb1c-45c6-4c43-9550-e891bc131c80 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:27.058298 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478eeb1c-45c6-4c43-9550-e891bc131c80 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:27.058764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478eeb1c-45c6-4c43-9550-e891bc131c80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:27.060068 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:27.080902 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478eeb1c-45c6-4c43-9550-e891bc131c80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:27.090671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478eeb1c-45c6-4c43-9550-e891bc131c80 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:27.110910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-478eeb1c-45c6-4c43-9550-e891bc131c80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:27.110910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:27.110910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:27.110910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:27.110910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:27.110910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:27.110910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:27.110910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:27.110910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:27.110910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:27.110910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:27.110910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:27.110910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:27.110910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:27.110910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:27.110910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:27.111909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:27.111909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:27.111909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:27.111909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:27.111909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:27.111909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:27.111909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:27.111909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:27.111909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:27.111909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:27.111909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:27.111909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:27.111909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:27.111909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:27.111909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:27.111909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:27.111909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:27.112893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:27.112893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:27.112893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:27.113665 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 438/890] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:27.114854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71903675-d090-4388-9f65-955c0e00fcc2 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:27.115142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71903675-d090-4388-9f65-955c0e00fcc2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:27.115421 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71903675-d090-4388-9f65-955c0e00fcc2 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:27.116943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 439/891] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:27.119566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71903675-d090-4388-9f65-955c0e00fcc2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:27.173841 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c08e4-c5cf-4259-9c05-d36f7b51db94 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:27.179963 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:27.209322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e3665-10ec-44ac-8654-1a27b887f0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:27.209938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e3665-10ec-44ac-8654-1a27b887f0b9 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:27.210274 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e3665-10ec-44ac-8654-1a27b887f0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:27.210541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e3665-10ec-44ac-8654-1a27b887f0b9 None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:27.211223 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e3665-10ec-44ac-8654-1a27b887f0b9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:27.211458 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e3665-10ec-44ac-8654-1a27b887f0b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:27.212939 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e3665-10ec-44ac-8654-1a27b887f0b9 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:27.218892 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 453/892] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:39:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:27.220297 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fc07c-fbbb-4219-b647-1718b481144b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:27.220656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fc07c-fbbb-4219-b647-1718b481144b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:27.220937 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fc07c-fbbb-4219-b647-1718b481144b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:27.234745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71903675-d090-4388-9f65-955c0e00fcc2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:27.239516 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-753fc07c-fbbb-4219-b647-1718b481144b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:27.240726 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-753fc07c-fbbb-4219-b647-1718b481144b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:27.271114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1febf2-30a2-4092-896b-dbcb9c74bd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:27.271733 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1febf2-30a2-4092-896b-dbcb9c74bd19 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:27.272018 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1febf2-30a2-4092-896b-dbcb9c74bd19 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:27.272296 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1febf2-30a2-4092-896b-dbcb9c74bd19 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:27.272976 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1febf2-30a2-4092-896b-dbcb9c74bd19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:27.273282 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1febf2-30a2-4092-896b-dbcb9c74bd19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:27.274664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1febf2-30a2-4092-896b-dbcb9c74bd19 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:27.289007 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 440/893] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:27.289638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1febf2-30a2-4092-896b-dbcb9c74bd19 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:27.309100 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:27.317038 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 454/894] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:27.332491 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fc07c-fbbb-4219-b647-1718b481144b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:27.427120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1febf2-30a2-4092-896b-dbcb9c74bd19 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:27.437938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fc07c-fbbb-4219-b647-1718b481144b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:27.452410 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:27.475974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adbed9-66fa-411e-b1ac-49a966940f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:27.476833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adbed9-66fa-411e-b1ac-49a966940f97 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:27.477140 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adbed9-66fa-411e-b1ac-49a966940f97 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:27.477439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c792f8-e666-4ab8-9054-8a0a96093cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:27.477887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adbed9-66fa-411e-b1ac-49a966940f97 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:27.478524 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c792f8-e666-4ab8-9054-8a0a96093cb3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:27.478955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c792f8-e666-4ab8-9054-8a0a96093cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:27.479366 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c792f8-e666-4ab8-9054-8a0a96093cb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:27.480511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c792f8-e666-4ab8-9054-8a0a96093cb3 None admin] RBAC: Adding query filter params (interface=public, service_id=3dd866e9be264d6f8d0a1c2b7368a5f7, region_id=RegionOne) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:27.481564 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c792f8-e666-4ab8-9054-8a0a96093cb3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:27.483109 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c792f8-e666-4ab8-9054-8a0a96093cb3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:27.485657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adbed9-66fa-411e-b1ac-49a966940f97 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:27.487175 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adbed9-66fa-411e-b1ac-49a966940f97 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:27.489621 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 441/895] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Sep 6 22:39:27 2022] GET /identity/v3/endpoints?service_id=3dd866e9be264d6f8d0a1c2b7368a5f7&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:27.494978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c792f8-e666-4ab8-9054-8a0a96093cb3 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:27.502210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-51adbed9-66fa-411e-b1ac-49a966940f97 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 22:39:27.502210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:27.502210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:27.502210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:27.502210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:27.502210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:27.502210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:27.502210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:27.502210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:27.502210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:27.502210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:27.502210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:27.502210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:39:27.502210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:39:27.502210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:39:27.502210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:39:27.503133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:27.503133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:27.503133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:39:27.503133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:27.503133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:39:27.503133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:27.503133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:27.503133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:27.503133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:27.503133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:27.503133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:27.503133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:27.503133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:27.503133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:27.503133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:27.503133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:27.503133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:27.503133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:27.504091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:27.504091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:27.504091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:39:27.504091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:39:27.504091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:39:27.504091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:39:27.504091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:39:27.504091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:39:27.504091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 22:39:27.504091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:27.511611 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 455/896] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Sep 6 22:39:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:27.512849 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adbed9-66fa-411e-b1ac-49a966940f97 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:27.584784 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:27.607322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c792f8-e666-4ab8-9054-8a0a96093cb3 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:27.626830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adbed9-66fa-411e-b1ac-49a966940f97 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:27.642874 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad3a29-c386-4547-8ca6-bd556ead0975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:27.643486 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad3a29-c386-4547-8ca6-bd556ead0975 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:27.643763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad3a29-c386-4547-8ca6-bd556ead0975 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:27.644036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad3a29-c386-4547-8ca6-bd556ead0975 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:27.644666 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad3a29-c386-4547-8ca6-bd556ead0975 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:27.646026 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad3a29-c386-4547-8ca6-bd556ead0975 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:27.652230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 442/897] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Sep 6 22:39:27 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:39:27.653069 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad3a29-c386-4547-8ca6-bd556ead0975 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:27.681038 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfbcc0-420e-4510-9372-00917cfc2a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:27.681886 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfbcc0-420e-4510-9372-00917cfc2a8d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:27.682715 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfbcc0-420e-4510-9372-00917cfc2a8d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:27.682995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfbcc0-420e-4510-9372-00917cfc2a8d None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:27.683941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfbcc0-420e-4510-9372-00917cfc2a8d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:27.684733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfbcc0-420e-4510-9372-00917cfc2a8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:27.688369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfbcc0-420e-4510-9372-00917cfc2a8d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:27.708311 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:27.709118 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 456/898] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Sep 6 22:39:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:27.715182 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb82800-2d38-4c9f-8251-754bb2e35f79 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:27.715501 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb82800-2d38-4c9f-8251-754bb2e35f79 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:27.715778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb82800-2d38-4c9f-8251-754bb2e35f79 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:27.717433 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 457/899] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:27.717953 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb82800-2d38-4c9f-8251-754bb2e35f79 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:27.778405 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad3a29-c386-4547-8ca6-bd556ead0975 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:27.817164 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e02d5-cfb5-4d5d-8850-a55ee19cb8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:27.817788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e02d5-cfb5-4d5d-8850-a55ee19cb8ac None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:27.818067 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e02d5-cfb5-4d5d-8850-a55ee19cb8ac None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:27.818408 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e02d5-cfb5-4d5d-8850-a55ee19cb8ac None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:27.819075 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e02d5-cfb5-4d5d-8850-a55ee19cb8ac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:27.820478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e02d5-cfb5-4d5d-8850-a55ee19cb8ac None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:27.838607 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb82800-2d38-4c9f-8251-754bb2e35f79 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:27.853041 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:27.873227 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dc5e6-96fa-424c-a96e-2f07fbd3c26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:27.873837 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dc5e6-96fa-424c-a96e-2f07fbd3c26c None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:27.874120 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dc5e6-96fa-424c-a96e-2f07fbd3c26c None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:27.874392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dc5e6-96fa-424c-a96e-2f07fbd3c26c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:27.940550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 443/900] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Sep 6 22:39:27 2022] POST /identity/v3/services => generated 241 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:39:27.940550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed66c3c-cba9-4be1-a9bd-0c5de8d19163 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:27.940550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed66c3c-cba9-4be1-a9bd-0c5de8d19163 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:27.940550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed66c3c-cba9-4be1-a9bd-0c5de8d19163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:27.950770 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dc5e6-96fa-424c-a96e-2f07fbd3c26c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:27.953459 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dc5e6-96fa-424c-a96e-2f07fbd3c26c None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:27.970027 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4ed66c3c-cba9-4be1-a9bd-0c5de8d19163 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:27.971778 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4ed66c3c-cba9-4be1-a9bd-0c5de8d19163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:28.087794 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 444/901] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:28.113226 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 458/902] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:39:27 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 22:39:28.114782 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed66c3c-cba9-4be1-a9bd-0c5de8d19163 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:28.148545 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:28.222694 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed66c3c-cba9-4be1-a9bd-0c5de8d19163 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:28.258725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11cf32-dfa1-4c4a-bb47-ce9e5ae83cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:28.259454 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11cf32-dfa1-4c4a-bb47-ce9e5ae83cce None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:28.259738 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11cf32-dfa1-4c4a-bb47-ce9e5ae83cce None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:28.260012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11cf32-dfa1-4c4a-bb47-ce9e5ae83cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:28.270465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11cf32-dfa1-4c4a-bb47-ce9e5ae83cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:28.271916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11cf32-dfa1-4c4a-bb47-ce9e5ae83cce None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:28.286642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-0d11cf32-dfa1-4c4a-bb47-ce9e5ae83cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:28.286642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:28.286642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:28.286642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:28.286642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:28.286642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:28.286642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:28.286642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:28.286642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:28.286642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:28.286642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:28.286642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:28.286642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:28.286642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:28.286642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:28.286642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:28.287568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:28.287568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:28.287568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:28.287568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:28.287568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:28.287568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:28.287568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:28.287568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:28.287568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:28.287568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:28.287568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:28.287568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:28.287568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:28.287568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:28.287568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:28.287568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:28.287568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:28.288511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:28.288511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:28.288511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:28.288511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 445/903] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:28.297382 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dc5e6-96fa-424c-a96e-2f07fbd3c26c None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:28.312466 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:28.364735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11cf32-dfa1-4c4a-bb47-ce9e5ae83cce None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:28.408762 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dc5e6-96fa-424c-a96e-2f07fbd3c26c None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:28.454416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305bef0-60b7-48c1-a259-304c12d2ea3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:28.455840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305bef0-60b7-48c1-a259-304c12d2ea3e None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:28.456750 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305bef0-60b7-48c1-a259-304c12d2ea3e None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:28.457203 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305bef0-60b7-48c1-a259-304c12d2ea3e None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:28.458285 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305bef0-60b7-48c1-a259-304c12d2ea3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:28.458761 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305bef0-60b7-48c1-a259-304c12d2ea3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:28.460635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:28.461422 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305bef0-60b7-48c1-a259-304c12d2ea3e None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:28.486336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 459/904] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:28.487069 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305bef0-60b7-48c1-a259-304c12d2ea3e None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:28.490068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11cf32-dfa1-4c4a-bb47-ce9e5ae83cce None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:28.532932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654c524-1957-4bf9-8809-0a34b209f0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:28.534187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c524-1957-4bf9-8809-0a34b209f0d2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:28.534674 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c524-1957-4bf9-8809-0a34b209f0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:28.535398 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c524-1957-4bf9-8809-0a34b209f0d2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:28.536483 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654c524-1957-4bf9-8809-0a34b209f0d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:28.538213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654c524-1957-4bf9-8809-0a34b209f0d2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:28.550893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-1654c524-1957-4bf9-8809-0a34b209f0d2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 22:39:28.550893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:28.550893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:28.550893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:28.550893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:28.550893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:28.550893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:28.550893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:28.550893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 22:39:28.550893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:28.550893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:28.550893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:28.550893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:28.550893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:28.550893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:28.550893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:28.552105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:28.552105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:28.552105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:28.552105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:28.552105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:28.552105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:28.552105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:28.552105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:28.552105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:28.552105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:28.552105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:28.552105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:28.552105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:28.552105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:28.552105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:28.552105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:28.552105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:28.553238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:28.553238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:28.553238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:28.553238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:28.553238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:28.553238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:28.553238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:28.553238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:28.553238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:28.553238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:28.553238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:28.553238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:28.553238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 22:39:28.553238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:28.556345 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 446/905] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Sep 6 22:39:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:28.564543 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654c524-1957-4bf9-8809-0a34b209f0d2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:28.581192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:28.616455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305bef0-60b7-48c1-a259-304c12d2ea3e None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:28.661474 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382714c-9426-4872-81b7-3db1259784dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:28.662721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382714c-9426-4872-81b7-3db1259784dc None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:28.663639 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382714c-9426-4872-81b7-3db1259784dc None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:28.664243 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382714c-9426-4872-81b7-3db1259784dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:28.673765 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382714c-9426-4872-81b7-3db1259784dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:28.675989 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382714c-9426-4872-81b7-3db1259784dc None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:28.683237 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654c524-1957-4bf9-8809-0a34b209f0d2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:28.690752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-6382714c-9426-4872-81b7-3db1259784dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:28.690752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:28.690752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:28.690752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:28.690752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:28.690752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:28.690752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:28.690752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:28.690752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:28.690752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:28.690752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:28.690752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:28.690752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:39:28.690752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:39:28.690752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:39:28.691825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:39:28.691825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:28.691825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:28.691825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:28.691825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:28.691825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:28.691825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:28.691825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:28.691825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:28.691825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:28.691825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:28.691825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:28.691825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:28.691825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:28.691825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:28.691825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:28.691825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:28.692862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:39:28.692862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:39:28.692862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:39:28.692862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:39:28.692862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:39:28.692862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:39:28.692862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:28.692862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:28.694205 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 460/906] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:28.699197 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382714c-9426-4872-81b7-3db1259784dc None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:28.725320 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9759d9b-3c40-4c7e-89eb-d62b498fb171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:28.726278 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9759d9b-3c40-4c7e-89eb-d62b498fb171 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:28.726788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9759d9b-3c40-4c7e-89eb-d62b498fb171 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:28.727253 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9759d9b-3c40-4c7e-89eb-d62b498fb171 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:28.728074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9759d9b-3c40-4c7e-89eb-d62b498fb171 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:28.728682 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9759d9b-3c40-4c7e-89eb-d62b498fb171 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:28.730864 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9759d9b-3c40-4c7e-89eb-d62b498fb171 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:28.736244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 447/907] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Sep 6 22:39:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:28.741430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9759d9b-3c40-4c7e-89eb-d62b498fb171 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:28.753636 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:28.815842 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382714c-9426-4872-81b7-3db1259784dc None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:28.844110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9759d9b-3c40-4c7e-89eb-d62b498fb171 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:28.854253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baf883-d8c4-4aea-9cab-8af2c095e84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:28.855153 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baf883-d8c4-4aea-9cab-8af2c095e84e None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:28.855643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baf883-d8c4-4aea-9cab-8af2c095e84e None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:28.856139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baf883-d8c4-4aea-9cab-8af2c095e84e None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:28.857045 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baf883-d8c4-4aea-9cab-8af2c095e84e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:28.857641 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baf883-d8c4-4aea-9cab-8af2c095e84e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:28.859350 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baf883-d8c4-4aea-9cab-8af2c095e84e None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:28.861379 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:28.879157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 461/908] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:39:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:28.885877 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baf883-d8c4-4aea-9cab-8af2c095e84e None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:28.885988 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ebb11-b751-4fbc-8b68-d6996c1061b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:28.885988 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ebb11-b751-4fbc-8b68-d6996c1061b1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:28.885988 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ebb11-b751-4fbc-8b68-d6996c1061b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:28.885988 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ebb11-b751-4fbc-8b68-d6996c1061b1 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:28.886279 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ebb11-b751-4fbc-8b68-d6996c1061b1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:28.886530 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ebb11-b751-4fbc-8b68-d6996c1061b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:28.887889 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ebb11-b751-4fbc-8b68-d6996c1061b1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:28.893796 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 448/909] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Sep 6 22:39:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:28.899292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ebb11-b751-4fbc-8b68-d6996c1061b1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:28.978178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:29.002256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baf883-d8c4-4aea-9cab-8af2c095e84e None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:29.002547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ebb11-b751-4fbc-8b68-d6996c1061b1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:29.037987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58203c7-c9ac-4e05-b079-b948bc281017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:29.038616 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58203c7-c9ac-4e05-b079-b948bc281017 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:29.038890 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58203c7-c9ac-4e05-b079-b948bc281017 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:29.039162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58203c7-c9ac-4e05-b079-b948bc281017 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:29.039858 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58203c7-c9ac-4e05-b079-b948bc281017 None admin] RBAC: Adding query filter params (interface=public, service_id=96682ce65c044fe4aa0aad27b44d0d06, region_id=RegionOne) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:29.040162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58203c7-c9ac-4e05-b079-b948bc281017 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:29.041607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58203c7-c9ac-4e05-b079-b948bc281017 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:29.043086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4bb8e-7baa-4c82-bf99-5544b6e407dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:29.044132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4bb8e-7baa-4c82-bf99-5544b6e407dc None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:29.044645 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4bb8e-7baa-4c82-bf99-5544b6e407dc None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:29.045130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4bb8e-7baa-4c82-bf99-5544b6e407dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:29.046088 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4bb8e-7baa-4c82-bf99-5544b6e407dc None admin] RBAC: Adding query filter params (role.id=ea85f0a3b95b4866b3f1ec715073e153, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=642d4bef7e9c459a8d2dde636094b528) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:29.046603 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4bb8e-7baa-4c82-bf99-5544b6e407dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:29.048293 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4bb8e-7baa-4c82-bf99-5544b6e407dc None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:29.051344 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 449/910] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Sep 6 22:39:28 2022] GET /identity/v3/endpoints?service_id=96682ce65c044fe4aa0aad27b44d0d06&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:29.052451 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58203c7-c9ac-4e05-b079-b948bc281017 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:29.060607 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 462/911] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:39:28 2022] GET /identity/v3/role_assignments?user.id=642d4bef7e9c459a8d2dde636094b528&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=ea85f0a3b95b4866b3f1ec715073e153 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:29.161548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58203c7-c9ac-4e05-b079-b948bc281017 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:29.199722 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc7f75-9488-46b4-95e2-0c8490c2406b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:29.200346 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc7f75-9488-46b4-95e2-0c8490c2406b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:29.200660 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc7f75-9488-46b4-95e2-0c8490c2406b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:29.200930 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc7f75-9488-46b4-95e2-0c8490c2406b None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:29.201546 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc7f75-9488-46b4-95e2-0c8490c2406b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:29.202957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc7f75-9488-46b4-95e2-0c8490c2406b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:29.210303 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 450/912] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Sep 6 22:39:29 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:39:29.837854 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f1d3d-ae47-4783-bd38-56d77c231b97 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:29.838437 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f1d3d-ae47-4783-bd38-56d77c231b97 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:29.838437 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f1d3d-ae47-4783-bd38-56d77c231b97 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:29.840113 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 463/913] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:29.845524 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa53e3-b4ba-4812-9baf-1092415d610a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:29.845966 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa53e3-b4ba-4812-9baf-1092415d610a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:29.846057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa53e3-b4ba-4812-9baf-1092415d610a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:29.852357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:29.866178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-93aa53e3-b4ba-4812-9baf-1092415d610a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:29.867631 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-93aa53e3-b4ba-4812-9baf-1092415d610a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:29.940857 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 451/914] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:30.202361 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e5c2d-3368-4d30-8a21-a2b05150545e None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:30.202644 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e5c2d-3368-4d30-8a21-a2b05150545e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:30.202920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e5c2d-3368-4d30-8a21-a2b05150545e None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:30.204805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 464/915] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:30.209945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2afb0-4dbe-4b03-a15c-79f243de87f7 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:30.210244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2afb0-4dbe-4b03-a15c-79f243de87f7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:30.210519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2afb0-4dbe-4b03-a15c-79f243de87f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:30.225338 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e5c2d-3368-4d30-8a21-a2b05150545e None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:30.229605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-03a2afb0-4dbe-4b03-a15c-79f243de87f7 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:30.231308 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-03a2afb0-4dbe-4b03-a15c-79f243de87f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:30.293469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:30.315574 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 452/916] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:30.342322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e5c2d-3368-4d30-8a21-a2b05150545e None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:30.377900 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e11d24-41cf-4919-931a-13cb9b8d4bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:30.378993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e11d24-41cf-4919-931a-13cb9b8d4bd5 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:30.379503 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e11d24-41cf-4919-931a-13cb9b8d4bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:30.379968 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e11d24-41cf-4919-931a-13cb9b8d4bd5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:30.380767 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e11d24-41cf-4919-931a-13cb9b8d4bd5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:30.382339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e11d24-41cf-4919-931a-13cb9b8d4bd5 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:30.392278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-13e11d24-41cf-4919-931a-13cb9b8d4bd5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 22:39:30.392278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:30.392278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:30.392278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:30.392278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:30.392278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:30.392278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:30.392278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:30.392278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 22:39:30.392278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:30.392278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:30.392278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:30.392278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:30.392278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:30.392278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:30.392278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:30.392278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:30.393300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:30.393300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:30.393300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:30.393300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:30.393300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:30.393300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:30.393300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:30.393300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:30.393300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:30.393300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:30.393300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:30.393300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:30.393300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:30.393300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:30.393300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:30.393300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:30.394151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:30.394151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:30.394151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:30.394151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:30.394151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:30.394151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:30.394151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:30.394151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:30.394151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:30.394151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:30.394151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:30.394151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:30.394151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 22:39:30.394151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:30.401403 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 465/917] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:39:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:30.404024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2afb0-4dbe-4b03-a15c-79f243de87f7 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:30.466249 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:30.509702 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2afb0-4dbe-4b03-a15c-79f243de87f7 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:30.544847 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d607fe-bb2f-41b6-b681-dfbc9daf37dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:30.545457 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d607fe-bb2f-41b6-b681-dfbc9daf37dd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:30.545733 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d607fe-bb2f-41b6-b681-dfbc9daf37dd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:30.546002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d607fe-bb2f-41b6-b681-dfbc9daf37dd None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:30.546625 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d607fe-bb2f-41b6-b681-dfbc9daf37dd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:30.546923 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d607fe-bb2f-41b6-b681-dfbc9daf37dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:30.548284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d607fe-bb2f-41b6-b681-dfbc9daf37dd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:30.553354 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 453/918] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:39:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:30.558822 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e11d24-41cf-4919-931a-13cb9b8d4bd5 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:30.594023 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d607fe-bb2f-41b6-b681-dfbc9daf37dd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:30.675336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e11d24-41cf-4919-931a-13cb9b8d4bd5 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:30.702078 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:30.713202 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d607fe-bb2f-41b6-b681-dfbc9daf37dd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:30.716598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba346e-20a7-4178-8279-42bdecec3bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:30.716598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba346e-20a7-4178-8279-42bdecec3bd4 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:30.716598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba346e-20a7-4178-8279-42bdecec3bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:30.716598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba346e-20a7-4178-8279-42bdecec3bd4 None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:30.717579 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba346e-20a7-4178-8279-42bdecec3bd4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:30.718046 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba346e-20a7-4178-8279-42bdecec3bd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:30.719736 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba346e-20a7-4178-8279-42bdecec3bd4 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:30.730408 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 466/919] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Sep 6 22:39:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:30.731868 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba346e-20a7-4178-8279-42bdecec3bd4 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:30.742142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:30.753719 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d0420-55cb-488d-997a-ca28655b99e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:30.754608 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d0420-55cb-488d-997a-ca28655b99e0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:30.758044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d0420-55cb-488d-997a-ca28655b99e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:30.758044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d0420-55cb-488d-997a-ca28655b99e0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:30.758044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d0420-55cb-488d-997a-ca28655b99e0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:30.758044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d0420-55cb-488d-997a-ca28655b99e0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:30.770987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-b03d0420-55cb-488d-997a-ca28655b99e0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 22:39:30.770987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:30.770987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:30.770987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:30.770987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:30.770987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:30.770987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:30.770987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:30.770987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 22:39:30.770987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:30.770987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:30.770987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:30.770987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:30.770987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:30.770987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:30.770987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:30.770987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:30.772033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:30.772033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:30.772033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:30.772033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:30.772033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:30.772033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:30.772033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:30.772033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:30.772033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:30.772033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:30.772033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:30.772033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:30.772033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:30.772033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:30.772033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:30.772033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:30.773290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:30.773290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:30.773290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:30.773290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:30.773290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:30.773290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:30.773290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:30.773290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:30.773290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:30.773290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:30.773290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:30.773290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:30.773290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 22:39:30.773290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:30.773290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 454/920] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Sep 6 22:39:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:30.781348 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d0420-55cb-488d-997a-ca28655b99e0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:30.854949 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba346e-20a7-4178-8279-42bdecec3bd4 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:30.893808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6691fb-1230-4d36-a3c1-c1c0d72f12d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:30.894722 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6691fb-1230-4d36-a3c1-c1c0d72f12d5 None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:30.895226 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6691fb-1230-4d36-a3c1-c1c0d72f12d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:30.895692 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6691fb-1230-4d36-a3c1-c1c0d72f12d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:30.896590 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6691fb-1230-4d36-a3c1-c1c0d72f12d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:30.898308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6691fb-1230-4d36-a3c1-c1c0d72f12d5 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:30.903175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d0420-55cb-488d-997a-ca28655b99e0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:30.940246 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1676dc-df67-4220-b924-4d72ab9d04cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:30.940886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1676dc-df67-4220-b924-4d72ab9d04cc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:30.941166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1676dc-df67-4220-b924-4d72ab9d04cc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:30.941434 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1676dc-df67-4220-b924-4d72ab9d04cc None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:30.942061 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1676dc-df67-4220-b924-4d72ab9d04cc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:30.942359 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1676dc-df67-4220-b924-4d72ab9d04cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:30.943721 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1676dc-df67-4220-b924-4d72ab9d04cc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:30.949581 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 455/921] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Sep 6 22:39:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:30.955114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1676dc-df67-4220-b924-4d72ab9d04cc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:31.001825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 467/922] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:39:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:39:31.020530 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:31.078247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1676dc-df67-4220-b924-4d72ab9d04cc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:31.134032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9f585-dd86-4066-b7c0-11d0be4ccb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:31.135114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9f585-dd86-4066-b7c0-11d0be4ccb57 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:31.135600 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9f585-dd86-4066-b7c0-11d0be4ccb57 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:31.136078 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9f585-dd86-4066-b7c0-11d0be4ccb57 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:31.137040 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9f585-dd86-4066-b7c0-11d0be4ccb57 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:31.137589 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9f585-dd86-4066-b7c0-11d0be4ccb57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:31.139247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9f585-dd86-4066-b7c0-11d0be4ccb57 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:31.146244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 456/923] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Sep 6 22:39:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:31.152239 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6691fb-1230-4d36-a3c1-c1c0d72f12d5 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:31.211058 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:31.271107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ae6ad-5c0a-4f18-8994-6eba12c72e30 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:31.271478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ae6ad-5c0a-4f18-8994-6eba12c72e30 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:31.271680 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ae6ad-5c0a-4f18-8994-6eba12c72e30 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:31.272772 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6691fb-1230-4d36-a3c1-c1c0d72f12d5 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:31.273306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 457/924] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:39:31.280026 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28c9e-240a-4ef5-8f98-4224ae2153b2 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:31.280333 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28c9e-240a-4ef5-8f98-4224ae2153b2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:31.280834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28c9e-240a-4ef5-8f98-4224ae2153b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:31.305503 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-27c28c9e-240a-4ef5-8f98-4224ae2153b2 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:31.306711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-27c28c9e-240a-4ef5-8f98-4224ae2153b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:31.323573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4bda0-a884-4866-b441-eeaf2f463f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:31.324846 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4bda0-a884-4866-b441-eeaf2f463f24 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:31.325494 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4bda0-a884-4866-b441-eeaf2f463f24 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:31.325805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4bda0-a884-4866-b441-eeaf2f463f24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:31.327176 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4bda0-a884-4866-b441-eeaf2f463f24 None admin] RBAC: Adding query filter params (interface=public, service_id=26527cb460c245cd95d83d5db07f7432, region_id=RegionOne) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:31.327483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4bda0-a884-4866-b441-eeaf2f463f24 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:31.329235 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4bda0-a884-4866-b441-eeaf2f463f24 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:31.334719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 468/925] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Sep 6 22:39:31 2022] GET /identity/v3/endpoints?service_id=26527cb460c245cd95d83d5db07f7432&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:31.340192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4bda0-a884-4866-b441-eeaf2f463f24 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:31.397731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 458/926] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 22:39:31.456962 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4bda0-a884-4866-b441-eeaf2f463f24 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:31.464761 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:31.488511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b87b82-7828-4c90-bafd-becba66579ef None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:31.488825 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b87b82-7828-4c90-bafd-becba66579ef None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:31.489073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b87b82-7828-4c90-bafd-becba66579ef None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:31.490670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 459/927] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:39:31.493132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25019d86-c3f2-496e-9813-4a6b54a2384d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:31.493757 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25019d86-c3f2-496e-9813-4a6b54a2384d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:31.494029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25019d86-c3f2-496e-9813-4a6b54a2384d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:31.494383 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25019d86-c3f2-496e-9813-4a6b54a2384d None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:31.494993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25019d86-c3f2-496e-9813-4a6b54a2384d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:31.496063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1088c29-a626-4b8d-a832-a686d9e630bf None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:31.496347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25019d86-c3f2-496e-9813-4a6b54a2384d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:31.496803 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1088c29-a626-4b8d-a832-a686d9e630bf None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:31.497281 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1088c29-a626-4b8d-a832-a686d9e630bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:31.503043 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 469/928] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Sep 6 22:39:31 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:39:31.517036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d1088c29-a626-4b8d-a832-a686d9e630bf None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:31.518673 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d1088c29-a626-4b8d-a832-a686d9e630bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:31.572840 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:31.601520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 460/929] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:31.680851 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25019d86-c3f2-496e-9813-4a6b54a2384d None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:31.796860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25019d86-c3f2-496e-9813-4a6b54a2384d None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:31.835807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babfcc5-9a1e-45ef-b7d3-96126885785a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:31.836469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babfcc5-9a1e-45ef-b7d3-96126885785a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:31.836755 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babfcc5-9a1e-45ef-b7d3-96126885785a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:31.837027 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babfcc5-9a1e-45ef-b7d3-96126885785a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:31.848317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babfcc5-9a1e-45ef-b7d3-96126885785a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:39:31.853262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-3babfcc5-9a1e-45ef-b7d3-96126885785a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 22:39:31.853262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:31.853262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:31.853262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:31.853262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:31.853262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:31.853262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:31.853262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:31.853262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:31.853262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:31.853262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:31.853262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:31.853262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:39:31.853262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:39:31.853262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:39:31.853262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:39:31.854290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:39:31.854290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:39:31.854290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:39:31.854290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:39:31.854290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:31.854290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:31.854290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:31.854290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:31.854290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:31.854290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:31.854290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:31.854290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:31.854290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:31.854290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:31.854290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:31.854290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:31.855653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:31.855653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:31.855653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:31.855653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:31.855653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:39:31.855653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:39:31.855653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:39:31.855653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:39:31.855653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:39:31.855653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:39:31.855653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 22:39:31.855653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:31.855653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 470/930] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Sep 6 22:39:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:31.860596 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1088c29-a626-4b8d-a832-a686d9e630bf None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:31.879488 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babfcc5-9a1e-45ef-b7d3-96126885785a None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:31.915496 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:31.992863 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babfcc5-9a1e-45ef-b7d3-96126885785a None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:31.997428 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1088c29-a626-4b8d-a832-a686d9e630bf None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:32.038582 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34caa5-e598-4749-a0f5-70c5483d2674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:32.040265 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34caa5-e598-4749-a0f5-70c5483d2674 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:32.040970 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34caa5-e598-4749-a0f5-70c5483d2674 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:32.041585 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34caa5-e598-4749-a0f5-70c5483d2674 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:32.042583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34caa5-e598-4749-a0f5-70c5483d2674 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:32.044010 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053eb40-3c5c-4ab7-b52a-d46e2308aa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:32.044652 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053eb40-3c5c-4ab7-b52a-d46e2308aa2a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:32.044898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34caa5-e598-4749-a0f5-70c5483d2674 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:32.045002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053eb40-3c5c-4ab7-b52a-d46e2308aa2a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:32.045194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053eb40-3c5c-4ab7-b52a-d46e2308aa2a None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:32.045872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053eb40-3c5c-4ab7-b52a-d46e2308aa2a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:32.046176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053eb40-3c5c-4ab7-b52a-d46e2308aa2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:32.047639 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053eb40-3c5c-4ab7-b52a-d46e2308aa2a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:32.056865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-7e34caa5-e598-4749-a0f5-70c5483d2674 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 22:39:32.056865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:32.056865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:32.056865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:32.056865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:32.056865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:32.056865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:32.056865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:32.056865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 22:39:32.056865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:32.056865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:32.056865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:32.056865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:32.056865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:32.056865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:32.056865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:32.057938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:32.057938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:32.057938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:32.057938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:32.057938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:32.057938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:32.057938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:32.057938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:32.057938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:32.057938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:32.057938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:32.057938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:32.057938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:32.057938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:32.057938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:32.057938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:32.057938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:32.058866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:32.058866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:32.058866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:32.058866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:32.058866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:32.058866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:32.058866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:32.058866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:32.058866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:32.058866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:32.058866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:32.058866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:32.058866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 22:39:32.058866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:32.060621 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 461/931] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Sep 6 22:39:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:32.061529 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053eb40-3c5c-4ab7-b52a-d46e2308aa2a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:32.067201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 471/932] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Sep 6 22:39:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:32.067966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34caa5-e598-4749-a0f5-70c5483d2674 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:32.113378 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:32.185299 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:32.192635 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34caa5-e598-4749-a0f5-70c5483d2674 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:32.201708 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053eb40-3c5c-4ab7-b52a-d46e2308aa2a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:32.231402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a726a-fa32-4f35-9a08-8ae57a41ebc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:32.232850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a726a-fa32-4f35-9a08-8ae57a41ebc1 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:32.233595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a726a-fa32-4f35-9a08-8ae57a41ebc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:32.234090 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a726a-fa32-4f35-9a08-8ae57a41ebc1 None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:32.235203 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a726a-fa32-4f35-9a08-8ae57a41ebc1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:32.236060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a726a-fa32-4f35-9a08-8ae57a41ebc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:32.238192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a726a-fa32-4f35-9a08-8ae57a41ebc1 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:32.243751 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf7e15-7039-4541-9b6a-19c402cacc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:32.245012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf7e15-7039-4541-9b6a-19c402cacc3a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:32.245358 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf7e15-7039-4541-9b6a-19c402cacc3a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:32.245697 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf7e15-7039-4541-9b6a-19c402cacc3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:32.250708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 472/933] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Sep 6 22:39:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:32.251815 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a726a-fa32-4f35-9a08-8ae57a41ebc1 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:32.265841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf7e15-7039-4541-9b6a-19c402cacc3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:32.267820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf7e15-7039-4541-9b6a-19c402cacc3a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:32.287327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-73bf7e15-7039-4541-9b6a-19c402cacc3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:32.287327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:32.287327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:32.287327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:32.287327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:32.287327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:32.287327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:32.287327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:32.287327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:32.287327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:32.287327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:32.287327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:32.287327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:32.287327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:32.287327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:32.287327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:32.288542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:32.288542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:32.288542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:32.288542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:32.288542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:32.288542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:32.288542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:32.288542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:32.288542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:32.288542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:32.288542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:32.288542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:32.288542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:32.288542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:32.288542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:32.288542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:32.288542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:32.289766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:32.289766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:32.289766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:32.292279 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 462/934] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:32.301153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf7e15-7039-4541-9b6a-19c402cacc3a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:32.363893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a726a-fa32-4f35-9a08-8ae57a41ebc1 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:32.401530 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969bf76-4c9b-4568-8d7f-4df8e5d115bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:32.402292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969bf76-4c9b-4568-8d7f-4df8e5d115bd None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:32.402575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969bf76-4c9b-4568-8d7f-4df8e5d115bd None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:32.402848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969bf76-4c9b-4568-8d7f-4df8e5d115bd None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:32.403481 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969bf76-4c9b-4568-8d7f-4df8e5d115bd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:32.403785 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969bf76-4c9b-4568-8d7f-4df8e5d115bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:32.405279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969bf76-4c9b-4568-8d7f-4df8e5d115bd None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:32.415096 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 473/935] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Sep 6 22:39:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:32.416172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969bf76-4c9b-4568-8d7f-4df8e5d115bd None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:32.428646 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:32.445095 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:32.446794 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf7e15-7039-4541-9b6a-19c402cacc3a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:32.482949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dd64d-8ea4-4124-b919-6c04adc76d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:32.483840 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dd64d-8ea4-4124-b919-6c04adc76d69 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:32.484291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dd64d-8ea4-4124-b919-6c04adc76d69 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:32.484760 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dd64d-8ea4-4124-b919-6c04adc76d69 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:32.485568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755dd64d-8ea4-4124-b919-6c04adc76d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:32.486032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755dd64d-8ea4-4124-b919-6c04adc76d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:32.487567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755dd64d-8ea4-4124-b919-6c04adc76d69 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:32.501688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 463/936] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:32.508703 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dd64d-8ea4-4124-b919-6c04adc76d69 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:32.537009 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969bf76-4c9b-4568-8d7f-4df8e5d115bd None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:32.581481 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b471d-fc29-468a-a092-926c3d8fdd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:32.582721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b471d-fc29-468a-a092-926c3d8fdd3e None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:32.583231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b471d-fc29-468a-a092-926c3d8fdd3e None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:32.583892 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b471d-fc29-468a-a092-926c3d8fdd3e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:32.585414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b471d-fc29-468a-a092-926c3d8fdd3e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:32.587085 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b471d-fc29-468a-a092-926c3d8fdd3e None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:32.626283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dd64d-8ea4-4124-b919-6c04adc76d69 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:32.665944 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c10fea-8646-46bb-87c7-59b0db8706b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:32.667400 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c10fea-8646-46bb-87c7-59b0db8706b6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:32.667707 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c10fea-8646-46bb-87c7-59b0db8706b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:32.667990 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c10fea-8646-46bb-87c7-59b0db8706b6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:32.678385 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c10fea-8646-46bb-87c7-59b0db8706b6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:32.680720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c10fea-8646-46bb-87c7-59b0db8706b6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:32.708452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 474/937] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:39:32 2022] POST /identity/v3/endpoints => generated 347 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:39:32.711777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-d3c10fea-8646-46bb-87c7-59b0db8706b6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 22:39:32.711777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:32.711777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:32.711777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:32.711777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:32.711777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:32.711777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:32.711777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:32.711777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:32.711777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:32.711777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:32.711777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:32.711777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:39:32.711777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:39:32.711777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:39:32.711777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:39:32.712766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:32.712766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:32.712766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:39:32.712766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:32.712766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:39:32.712766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:32.712766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:32.712766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:32.712766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:32.712766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:32.712766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:32.712766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:32.712766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:32.712766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:32.712766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:32.712766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:32.712766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:32.712766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:32.713732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:32.713732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:32.713732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:39:32.713732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:39:32.713732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:39:32.713732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:39:32.713732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:39:32.713732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:39:32.713732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 22:39:32.713732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:32.713732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 464/938] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Sep 6 22:39:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:32.714882 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b471d-fc29-468a-a092-926c3d8fdd3e None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:32.807324 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:32.845462 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b471d-fc29-468a-a092-926c3d8fdd3e None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:32.886931 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f689fa-6469-4631-a014-be07123a0740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:32.887606 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f689fa-6469-4631-a014-be07123a0740 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:32.887841 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f689fa-6469-4631-a014-be07123a0740 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:32.892445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f689fa-6469-4631-a014-be07123a0740 None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:32.892445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f689fa-6469-4631-a014-be07123a0740 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:32.892445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f689fa-6469-4631-a014-be07123a0740 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:32.892445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f689fa-6469-4631-a014-be07123a0740 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:32.912727 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 475/939] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Sep 6 22:39:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:32.919170 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c10fea-8646-46bb-87c7-59b0db8706b6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:32.949167 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:33.047053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c10fea-8646-46bb-87c7-59b0db8706b6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:33.089912 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bcf34-6689-4e58-b12c-386d6be975c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:33.090557 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bcf34-6689-4e58-b12c-386d6be975c3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:33.090836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bcf34-6689-4e58-b12c-386d6be975c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:33.091109 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bcf34-6689-4e58-b12c-386d6be975c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:33.105530 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39bcf34-6689-4e58-b12c-386d6be975c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:33.106941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39bcf34-6689-4e58-b12c-386d6be975c3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:33.122024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-e39bcf34-6689-4e58-b12c-386d6be975c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:33.122024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:33.122024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:33.122024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:33.122024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:33.122024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:33.122024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:33.122024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:33.122024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:33.122024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:33.122024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:33.122024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:33.122024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:33.122024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:33.122024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:33.122024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:33.123086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:33.123086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:33.123086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:33.123086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:33.123086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:33.123086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:33.123086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:33.123086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:33.123086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:33.123086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:33.123086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:33.123086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:33.123086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:33.123086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:33.123086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:33.123086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:33.123086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:33.124048 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:33.124048 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:33.124048 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:33.126519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 465/940] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:33.137591 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f689fa-6469-4631-a014-be07123a0740 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:33.347943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f689fa-6469-4631-a014-be07123a0740 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:33.379912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:33.385652 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938fc4d-2b2d-480f-bccb-49dd95fc1c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:33.386313 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938fc4d-2b2d-480f-bccb-49dd95fc1c3e None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:33.386601 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938fc4d-2b2d-480f-bccb-49dd95fc1c3e None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:33.387134 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938fc4d-2b2d-480f-bccb-49dd95fc1c3e None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:33.387788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938fc4d-2b2d-480f-bccb-49dd95fc1c3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:33.388091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938fc4d-2b2d-480f-bccb-49dd95fc1c3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:33.389495 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938fc4d-2b2d-480f-bccb-49dd95fc1c3e None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:33.402333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 476/941] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:33.409746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bcf34-6689-4e58-b12c-386d6be975c3 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:33.422920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3b66d-6161-4332-a102-9be60c57d4ad None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:33.423202 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3b66d-6161-4332-a102-9be60c57d4ad None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:33.423624 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3b66d-6161-4332-a102-9be60c57d4ad None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:33.426256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 477/942] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:39:33.430803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74a529-cbfb-4677-a5de-9b06b1157614 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:33.431271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74a529-cbfb-4677-a5de-9b06b1157614 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:33.431556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74a529-cbfb-4677-a5de-9b06b1157614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:33.457432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-5d74a529-cbfb-4677-a5de-9b06b1157614 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:33.459308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-5d74a529-cbfb-4677-a5de-9b06b1157614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:33.483703 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:33.533542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bcf34-6689-4e58-b12c-386d6be975c3 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:33.548521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 478/943] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 22:39:33.576437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da121357-0248-4545-9885-f048d8a6410f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:33.577167 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da121357-0248-4545-9885-f048d8a6410f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:33.577519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da121357-0248-4545-9885-f048d8a6410f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:33.577867 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da121357-0248-4545-9885-f048d8a6410f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:33.585036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da121357-0248-4545-9885-f048d8a6410f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:33.586622 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da121357-0248-4545-9885-f048d8a6410f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:33.598711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-da121357-0248-4545-9885-f048d8a6410f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:33.598711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:33.598711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:33.598711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:33.598711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:33.598711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:33.598711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:33.598711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:33.598711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:33.598711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:33.598711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:33.598711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:33.598711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:39:33.598711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:39:33.598711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:39:33.599830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:39:33.599830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:33.599830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:33.599830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:33.599830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:33.599830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:33.599830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:33.599830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:33.599830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:33.599830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:33.599830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:33.599830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:33.599830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:33.599830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:33.599830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:33.599830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:33.599830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:33.600991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:39:33.600991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:39:33.600991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:39:33.600991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:39:33.600991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:39:33.600991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:39:33.600991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:33.600991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:33.604445 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 466/944] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:33.607404 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74a529-cbfb-4677-a5de-9b06b1157614 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:33.721815 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74a529-cbfb-4677-a5de-9b06b1157614 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:33.746110 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:33.757649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de330eb3-b88c-407c-a070-ed1a6ebc1e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:33.758272 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330eb3-b88c-407c-a070-ed1a6ebc1e76 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:33.758553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330eb3-b88c-407c-a070-ed1a6ebc1e76 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:33.758813 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330eb3-b88c-407c-a070-ed1a6ebc1e76 None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:33.766196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de330eb3-b88c-407c-a070-ed1a6ebc1e76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:33.766196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de330eb3-b88c-407c-a070-ed1a6ebc1e76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:33.766196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de330eb3-b88c-407c-a070-ed1a6ebc1e76 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:33.774193 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 479/945] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:33.781960 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da121357-0248-4545-9885-f048d8a6410f None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:33.805132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee2bec-1d39-4d37-be93-b5d5c658e5b9 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:33.805464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee2bec-1d39-4d37-be93-b5d5c658e5b9 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:33.805680 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee2bec-1d39-4d37-be93-b5d5c658e5b9 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:33.808627 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 480/946] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:39:33.813023 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572230c-f971-45f2-97a7-a6a497907524 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:33.813368 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572230c-f971-45f2-97a7-a6a497907524 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:33.813835 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572230c-f971-45f2-97a7-a6a497907524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:33.836873 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-4572230c-f971-45f2-97a7-a6a497907524 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:33.838092 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4572230c-f971-45f2-97a7-a6a497907524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:33.908485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da121357-0248-4545-9885-f048d8a6410f None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:33.909245 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 481/947] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 22:39:33.915133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572230c-f971-45f2-97a7-a6a497907524 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:33.934772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:33.952275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4c142-ba3f-434f-83c6-ed658f1ce5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:33.953323 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4c142-ba3f-434f-83c6-ed658f1ce5a1 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:33.953610 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4c142-ba3f-434f-83c6-ed658f1ce5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:33.954138 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4c142-ba3f-434f-83c6-ed658f1ce5a1 None admin] PATH_INFO: `/v3/projects/f5e78b142d654280b161a34cec0186cd/users/642d4bef7e9c459a8d2dde636094b528/roles/ea85f0a3b95b4866b3f1ec715073e153` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:33.957109 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4c142-ba3f-434f-83c6-ed658f1ce5a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5e78b142d654280b161a34cec0186cd, user_id=642d4bef7e9c459a8d2dde636094b528, role_id=ea85f0a3b95b4866b3f1ec715073e153)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:33.958660 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4c142-ba3f-434f-83c6-ed658f1ce5a1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:34.032452 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 467/948] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:39:33 2022] PUT /identity/v3/projects/f5e78b142d654280b161a34cec0186cd/users/642d4bef7e9c459a8d2dde636094b528/roles/ea85f0a3b95b4866b3f1ec715073e153 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:39:34.055488 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572230c-f971-45f2-97a7-a6a497907524 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:34.071575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:34.096287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f72e98-14fc-44be-a0f6-c0096dd820a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:34.097264 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f72e98-14fc-44be-a0f6-c0096dd820a7 None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:34.097732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f72e98-14fc-44be-a0f6-c0096dd820a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:34.098170 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f72e98-14fc-44be-a0f6-c0096dd820a7 None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:34.098967 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f72e98-14fc-44be-a0f6-c0096dd820a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:34.100648 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f72e98-14fc-44be-a0f6-c0096dd820a7 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:34.104338 dv-cinder-852208-20-smb devstack@keystone.service[88078]: WARNING keystone.server.flask.common [None req-a2f72e98-14fc-44be-a0f6-c0096dd820a7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 06 22:39:34.151953 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.sql.core [None req-a2f72e98-14fc-44be-a0f6-c0096dd820a7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 22:39:34.151953 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 06 22:39:34.151953 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [parameters: {'id': '4f0e056975e045639641815c7c7ec8e0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 06 22:39:34.151953 dv-cinder-852208-20-smb devstack@keystone.service[88078]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88078) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 22:39:34.170826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-a2f72e98-14fc-44be-a0f6-c0096dd820a7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4f0e056975e045639641815c7c7ec8e0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4f0e056975e045639641815c7c7ec8e0. Sep 06 22:39:34.170826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:34.170826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 22:39:34.170826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 22:39:34.170826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 22:39:34.170826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 22:39:34.170826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 22:39:34.170826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 22:39:34.170826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 22:39:34.170826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application conn.query(q) Sep 06 22:39:34.170826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 22:39:34.170826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 22:39:34.170826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 22:39:34.171833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application result.read() Sep 06 22:39:34.171833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 22:39:34.171833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 22:39:34.171833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 22:39:34.171833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 22:39:34.171833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 22:39:34.171833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 22:39:34.171833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 22:39:34.171833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 22:39:34.171833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 22:39:34.171833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:34.171833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 22:39:34.171833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:34.171833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:34.171833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 22:39:34.171833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 22:39:34.171833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 06 22:39:34.171833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 06 22:39:34.173056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 22:39:34.173056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application next(self.gen) Sep 06 22:39:34.173056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 22:39:34.173056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application yield resource Sep 06 22:39:34.173056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 22:39:34.173056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application next(self.gen) Sep 06 22:39:34.173056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 22:39:34.173056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 22:39:34.173056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 22:39:34.173056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 22:39:34.173056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 22:39:34.173056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise self.value Sep 06 22:39:34.173056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 22:39:34.173056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 22:39:34.173056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 22:39:34.173056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application session.commit() Sep 06 22:39:34.173056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 22:39:34.174169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 22:39:34.174169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 22:39:34.174169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 22:39:34.174169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 22:39:34.174169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self.session.flush() Sep 06 22:39:34.174169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 22:39:34.174169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 22:39:34.174169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 22:39:34.174169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 22:39:34.174169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 22:39:34.174169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application compat.raise_( Sep 06 22:39:34.174169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 22:39:34.174169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception Sep 06 22:39:34.174169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 22:39:34.174169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 22:39:34.174169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 22:39:34.174169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 22:39:34.175354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 22:39:34.175354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 22:39:34.175354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 22:39:34.175354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 22:39:34.175354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 06 22:39:34.175354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 06 22:39:34.175354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 22:39:34.175354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 22:39:34.175354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 22:39:34.175354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 22:39:34.175354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 22:39:34.175354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 22:39:34.175354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 22:39:34.175354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 22:39:34.175354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 22:39:34.176162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 22:39:34.176162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 22:39:34.176162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception Sep 06 22:39:34.176162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 22:39:34.176162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 22:39:34.176162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 22:39:34.176162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 22:39:34.176162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 22:39:34.176162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 22:39:34.176162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 22:39:34.176162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application conn.query(q) Sep 06 22:39:34.176162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 22:39:34.176162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 22:39:34.176162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 22:39:34.176162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application result.read() Sep 06 22:39:34.176162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 22:39:34.176162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 22:39:34.177209 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 22:39:34.177209 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 22:39:34.177209 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 22:39:34.177209 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 22:39:34.177209 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 22:39:34.177209 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 22:39:34.177209 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 22:39:34.177209 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 06 22:39:34.177209 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [parameters: {'id': '4f0e056975e045639641815c7c7ec8e0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 06 22:39:34.177209 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 22:39:34.177209 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:34.177209 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:34.177209 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:34.177209 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:34.177209 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 06 22:39:34.178184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 06 22:39:34.178184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 22:39:34.178184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 22:39:34.178184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 06 22:39:34.178184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:34.178184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:34.178184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:34.178184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:34.178184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:34.178184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:34.178184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:34.178184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:34.178184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:34.178184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:34.178184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:34.178184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:34.178184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:34.179366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:34.179366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 06 22:39:34.179366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 06 22:39:34.179366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:34.179366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:34.179366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 06 22:39:34.179366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 06 22:39:34.179366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4f0e056975e045639641815c7c7ec8e0. Sep 06 22:39:34.179366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:34.182396 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 482/949] 10.222.0.30 () {60 vars in 1140 bytes} [Tue Sep 6 22:39:33 2022] POST /identity/v3/projects => generated 262 bytes in 273 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:34.186520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4c142-ba3f-434f-83c6-ed658f1ce5a1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:34.191930 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f72e98-14fc-44be-a0f6-c0096dd820a7 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:34.309474 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4c142-ba3f-434f-83c6-ed658f1ce5a1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:34.324563 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f72e98-14fc-44be-a0f6-c0096dd820a7 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:34.352758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70437fce-424d-4911-b0a0-8dbde14c1e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:34.353943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70437fce-424d-4911-b0a0-8dbde14c1e27 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:34.354422 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70437fce-424d-4911-b0a0-8dbde14c1e27 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:34.354696 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70437fce-424d-4911-b0a0-8dbde14c1e27 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:34.355287 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70437fce-424d-4911-b0a0-8dbde14c1e27 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:34.356902 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70437fce-424d-4911-b0a0-8dbde14c1e27 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:34.366687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-70437fce-424d-4911-b0a0-8dbde14c1e27 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 22:39:34.366687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:34.366687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:34.366687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:34.366687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:34.366687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:34.366687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:34.366687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:34.366687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 22:39:34.366687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:34.366687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:34.366687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:34.366687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:34.366687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:34.366687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:34.366687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:34.366687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:34.367788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:34.367788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:34.367788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:34.367788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:34.367788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:34.367788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:34.367788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:34.367788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:34.367788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:34.367788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:34.367788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:34.367788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:34.367788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:34.367788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:34.367788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:34.367788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:34.368713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:34.368713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:34.368713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:34.368713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:34.368713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:34.368713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:34.368713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:34.368713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:34.368713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:34.368713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:34.368713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:34.368713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:34.368713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 22:39:34.368713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:34.368713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 468/950] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Sep 6 22:39:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:34.374223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70437fce-424d-4911-b0a0-8dbde14c1e27 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:34.383710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a51f0-7ec7-4810-8431-a707d298f630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:34.384375 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a51f0-7ec7-4810-8431-a707d298f630 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:34.384728 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a51f0-7ec7-4810-8431-a707d298f630 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:34.385001 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a51f0-7ec7-4810-8431-a707d298f630 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:34.392298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a51f0-7ec7-4810-8431-a707d298f630 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:34.394055 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a51f0-7ec7-4810-8431-a707d298f630 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:34.406060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-279a51f0-7ec7-4810-8431-a707d298f630 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:34.406060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:34.406060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:34.406060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:34.406060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:34.406060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:34.406060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:34.406060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:34.406060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:34.406060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:34.406060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:34.406060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:34.406060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:39:34.406060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:39:34.406060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:39:34.407021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:39:34.407021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:34.407021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:34.407021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:34.407021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:34.407021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:34.407021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:34.407021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:34.407021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:34.407021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:34.407021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:34.407021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:34.407021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:34.407021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:34.407021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:34.407021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:34.407021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:34.407993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:39:34.407993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:39:34.407993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:39:34.407993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:39:34.407993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:39:34.407993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:39:34.407993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:34.407993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:34.407993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 483/951] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:34.412989 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a51f0-7ec7-4810-8431-a707d298f630 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:34.428411 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:34.444495 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:34.486508 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70437fce-424d-4911-b0a0-8dbde14c1e27 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:34.519841 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a51f0-7ec7-4810-8431-a707d298f630 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:34.522500 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e59b0-749e-474a-b68b-0fd476b13650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:34.523394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e59b0-749e-474a-b68b-0fd476b13650 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:34.524243 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e59b0-749e-474a-b68b-0fd476b13650 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:34.525069 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e59b0-749e-474a-b68b-0fd476b13650 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:34.526452 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e59b0-749e-474a-b68b-0fd476b13650 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:34.526965 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e59b0-749e-474a-b68b-0fd476b13650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:34.528593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e59b0-749e-474a-b68b-0fd476b13650 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:34.538557 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 469/952] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Sep 6 22:39:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:34.539710 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e59b0-749e-474a-b68b-0fd476b13650 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:34.559570 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fbbb1-c816-4b55-8e37-11d8c965b6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:34.560243 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fbbb1-c816-4b55-8e37-11d8c965b6cd None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:34.561270 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fbbb1-c816-4b55-8e37-11d8c965b6cd None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:34.561270 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fbbb1-c816-4b55-8e37-11d8c965b6cd None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:34.561565 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fbbb1-c816-4b55-8e37-11d8c965b6cd None admin] RBAC: Adding query filter params (name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:34.561872 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fbbb1-c816-4b55-8e37-11d8c965b6cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:34.563364 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fbbb1-c816-4b55-8e37-11d8c965b6cd None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:34.585879 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 484/953] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Sep 6 22:39:34 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:34.658138 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e59b0-749e-474a-b68b-0fd476b13650 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:34.671802 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:34.699391 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf099c47-2b22-4e2c-96af-a360a3e0ecb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:34.699940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf099c47-2b22-4e2c-96af-a360a3e0ecb6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:34.700216 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf099c47-2b22-4e2c-96af-a360a3e0ecb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:34.700514 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf099c47-2b22-4e2c-96af-a360a3e0ecb6 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:34.701224 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf099c47-2b22-4e2c-96af-a360a3e0ecb6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:34.701524 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf099c47-2b22-4e2c-96af-a360a3e0ecb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:34.703048 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf099c47-2b22-4e2c-96af-a360a3e0ecb6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:34.709244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 470/954] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Sep 6 22:39:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:34.715286 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fbbb1-c816-4b55-8e37-11d8c965b6cd None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:34.812399 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:34.825828 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fbbb1-c816-4b55-8e37-11d8c965b6cd None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:34.864375 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974ab62-dd66-454b-8d4b-fbe6d1431559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:34.865027 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974ab62-dd66-454b-8d4b-fbe6d1431559 None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:34.865357 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974ab62-dd66-454b-8d4b-fbe6d1431559 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:34.865635 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974ab62-dd66-454b-8d4b-fbe6d1431559 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:34.866324 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974ab62-dd66-454b-8d4b-fbe6d1431559 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:34.867763 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974ab62-dd66-454b-8d4b-fbe6d1431559 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:34.947899 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 485/955] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:39:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:39:35.208622 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12853dab-eda6-4106-90c2-d7da016bc4ab None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:35.209155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12853dab-eda6-4106-90c2-d7da016bc4ab None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:35.209155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12853dab-eda6-4106-90c2-d7da016bc4ab None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:35.210681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 471/956] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:35.216150 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c293d4-fc3b-423b-aee8-0714e4e91c17 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:35.216691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c293d4-fc3b-423b-aee8-0714e4e91c17 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:35.217186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c293d4-fc3b-423b-aee8-0714e4e91c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:35.235988 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-86c293d4-fc3b-423b-aee8-0714e4e91c17 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:35.237885 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-86c293d4-fc3b-423b-aee8-0714e4e91c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:35.317194 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 486/957] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:35.589015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12853dab-eda6-4106-90c2-d7da016bc4ab None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:35.704499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12853dab-eda6-4106-90c2-d7da016bc4ab None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:35.742016 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2519d73-e7da-419e-b083-778d429fd2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:35.742660 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2519d73-e7da-419e-b083-778d429fd2b3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:35.742944 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2519d73-e7da-419e-b083-778d429fd2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:35.743222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2519d73-e7da-419e-b083-778d429fd2b3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:35.743808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2519d73-e7da-419e-b083-778d429fd2b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:35.745828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2519d73-e7da-419e-b083-778d429fd2b3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:35.756478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-a2519d73-e7da-419e-b083-778d429fd2b3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 22:39:35.756478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:35.756478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:35.756478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:35.756478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:35.756478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:35.756478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:35.756478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:35.756478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 22:39:35.756478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:35.756478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:35.756478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:35.756478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:35.756478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:35.756478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:35.756478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:35.756478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:35.757567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:35.757567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:35.757567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:35.757567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:35.757567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:35.757567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:35.757567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:35.757567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:35.757567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:35.757567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:35.757567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:35.757567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:35.757567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:35.757567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:35.757567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:35.757567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:35.758439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:35.758439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:35.758439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:35.758439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:35.758439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:35.758439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:35.758439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:35.758439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:35.758439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:35.758439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:35.758439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:35.758439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:35.758439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 22:39:35.758439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:35.758439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 472/958] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:35.765789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c293d4-fc3b-423b-aee8-0714e4e91c17 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:35.842257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:35.874689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c293d4-fc3b-423b-aee8-0714e4e91c17 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:35.910938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cb5ab-352c-4b8b-a414-b60b70882fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:35.911555 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cb5ab-352c-4b8b-a414-b60b70882fdb None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:35.911836 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cb5ab-352c-4b8b-a414-b60b70882fdb None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:35.912114 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cb5ab-352c-4b8b-a414-b60b70882fdb None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:35.912797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cb5ab-352c-4b8b-a414-b60b70882fdb None admin] RBAC: Adding query filter params (name=compute) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:35.913101 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cb5ab-352c-4b8b-a414-b60b70882fdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:35.914455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cb5ab-352c-4b8b-a414-b60b70882fdb None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:35.919834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 487/959] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Sep 6 22:39:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:35.925510 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2519d73-e7da-419e-b083-778d429fd2b3 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:35.967549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:36.037197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2519d73-e7da-419e-b083-778d429fd2b3 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:36.072970 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a927ff4-7310-47fc-be3c-fcdad84c2dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:36.073593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a927ff4-7310-47fc-be3c-fcdad84c2dd3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:36.073873 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a927ff4-7310-47fc-be3c-fcdad84c2dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:36.074145 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a927ff4-7310-47fc-be3c-fcdad84c2dd3 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:36.074782 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a927ff4-7310-47fc-be3c-fcdad84c2dd3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:36.075082 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a927ff4-7310-47fc-be3c-fcdad84c2dd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:36.076481 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a927ff4-7310-47fc-be3c-fcdad84c2dd3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:36.081792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 473/960] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Sep 6 22:39:35 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:36.348388 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e441564-9ed8-4905-90ff-579c10a231c6 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:36.348944 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e441564-9ed8-4905-90ff-579c10a231c6 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:36.348944 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e441564-9ed8-4905-90ff-579c10a231c6 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:36.350522 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 488/961] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:36.356474 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ff132-2101-40d7-884d-41356a8f3f59 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:36.356908 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ff132-2101-40d7-884d-41356a8f3f59 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:36.357010 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ff132-2101-40d7-884d-41356a8f3f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:36.377102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-498ff132-2101-40d7-884d-41356a8f3f59 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:36.378613 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-498ff132-2101-40d7-884d-41356a8f3f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:36.450686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 474/962] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:36.722744 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e441564-9ed8-4905-90ff-579c10a231c6 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:36.828914 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e441564-9ed8-4905-90ff-579c10a231c6 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:36.864635 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00105bf2-dd3a-4fbe-9a2a-5b23d1e933b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:36.865297 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00105bf2-dd3a-4fbe-9a2a-5b23d1e933b9 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:36.865578 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00105bf2-dd3a-4fbe-9a2a-5b23d1e933b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:36.865851 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00105bf2-dd3a-4fbe-9a2a-5b23d1e933b9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:36.868057 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:36.882516 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00105bf2-dd3a-4fbe-9a2a-5b23d1e933b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:39:36.890995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-00105bf2-dd3a-4fbe-9a2a-5b23d1e933b9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 22:39:36.890995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:36.890995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:36.890995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:36.890995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:36.890995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:36.890995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:36.890995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:36.890995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:36.890995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:36.890995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:36.890995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:36.890995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:39:36.890995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:39:36.890995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:39:36.890995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:39:36.892145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:39:36.892145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:39:36.892145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:39:36.892145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:39:36.892145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:36.892145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:36.892145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:36.892145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:36.892145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:36.892145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:36.892145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:36.892145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:36.892145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:36.892145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:36.892145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:36.892145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:36.893222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:36.893222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:36.893222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:36.893222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:36.893222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:39:36.893222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:39:36.893222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:39:36.893222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:39:36.893222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:39:36.893222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:39:36.893222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 22:39:36.893222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:36.893222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 489/963] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Sep 6 22:39:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:36.904483 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ff132-2101-40d7-884d-41356a8f3f59 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:36.933915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:37.007764 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af73590-6d9a-4644-b564-f9e968d4bd2e None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:37.008049 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af73590-6d9a-4644-b564-f9e968d4bd2e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:37.008321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af73590-6d9a-4644-b564-f9e968d4bd2e None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:37.008792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ff132-2101-40d7-884d-41356a8f3f59 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:37.010238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 490/964] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:39:37.015396 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258c414-0ab6-4b9b-8ccd-bffd2fe6a421 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:37.015716 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258c414-0ab6-4b9b-8ccd-bffd2fe6a421 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:37.015947 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258c414-0ab6-4b9b-8ccd-bffd2fe6a421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:37.035326 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-4258c414-0ab6-4b9b-8ccd-bffd2fe6a421 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:37.036681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4258c414-0ab6-4b9b-8ccd-bffd2fe6a421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:37.053458 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc8868-d74b-46a0-9295-2dd8ab8e3201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:37.054320 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc8868-d74b-46a0-9295-2dd8ab8e3201 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:37.054607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc8868-d74b-46a0-9295-2dd8ab8e3201 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:37.054881 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc8868-d74b-46a0-9295-2dd8ab8e3201 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:37.055943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc8868-d74b-46a0-9295-2dd8ab8e3201 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:37.056339 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc8868-d74b-46a0-9295-2dd8ab8e3201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:37.057746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc8868-d74b-46a0-9295-2dd8ab8e3201 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:37.068241 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 475/965] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Sep 6 22:39:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:37.077521 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc8868-d74b-46a0-9295-2dd8ab8e3201 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:37.126949 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 491/966] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 22:39:37.188303 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:37.198712 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc8868-d74b-46a0-9295-2dd8ab8e3201 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:37.223088 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14d88c-f8a4-437d-a244-c948c5ed5204 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:37.223588 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14d88c-f8a4-437d-a244-c948c5ed5204 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:37.224006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14d88c-f8a4-437d-a244-c948c5ed5204 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:37.225920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 492/967] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:37.233451 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e920e52-bd9f-4f83-b33c-3c9d576e218e None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:37.233732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e920e52-bd9f-4f83-b33c-3c9d576e218e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:37.233999 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e920e52-bd9f-4f83-b33c-3c9d576e218e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:37.245230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1fa1c-e9a0-439c-abac-3e20bd1fb613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:37.246183 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1fa1c-e9a0-439c-abac-3e20bd1fb613 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:37.246689 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1fa1c-e9a0-439c-abac-3e20bd1fb613 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:37.247155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1fa1c-e9a0-439c-abac-3e20bd1fb613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:37.253411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-3e920e52-bd9f-4f83-b33c-3c9d576e218e None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:37.254682 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3e920e52-bd9f-4f83-b33c-3c9d576e218e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:37.258906 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1fa1c-e9a0-439c-abac-3e20bd1fb613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:37.261174 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1fa1c-e9a0-439c-abac-3e20bd1fb613 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:37.276390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-1dc1fa1c-e9a0-439c-abac-3e20bd1fb613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:37.276390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:37.276390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:37.276390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:37.276390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:37.276390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:37.276390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:37.276390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:37.276390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:37.276390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:37.276390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:37.276390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:37.276390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:37.276390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:37.276390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:37.276390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:37.277369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:37.277369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:37.277369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:37.277369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:37.277369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:37.277369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:37.277369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:37.277369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:37.277369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:37.277369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:37.277369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:37.277369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:37.277369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:37.277369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:37.277369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:37.277369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:37.277369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:37.278321 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:37.278321 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:37.278321 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:37.280173 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 476/968] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:37.285946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1fa1c-e9a0-439c-abac-3e20bd1fb613 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:37.333361 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 493/969] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:37.402810 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1fa1c-e9a0-439c-abac-3e20bd1fb613 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:37.403418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e920e52-bd9f-4f83-b33c-3c9d576e218e None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:37.450985 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13167ca7-c961-4b62-aad3-840826de632b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:37.451602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13167ca7-c961-4b62-aad3-840826de632b None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:37.451881 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13167ca7-c961-4b62-aad3-840826de632b None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:37.452628 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13167ca7-c961-4b62-aad3-840826de632b None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:37.453279 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13167ca7-c961-4b62-aad3-840826de632b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:37.453865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13167ca7-c961-4b62-aad3-840826de632b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:37.455881 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13167ca7-c961-4b62-aad3-840826de632b None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:37.466924 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:37.473098 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 477/970] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:37.478723 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13167ca7-c961-4b62-aad3-840826de632b None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:37.483224 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:37.525338 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e920e52-bd9f-4f83-b33c-3c9d576e218e None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:37.561760 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d93b5-f36d-451a-9049-17b0a587e556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:37.562679 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d93b5-f36d-451a-9049-17b0a587e556 None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:37.563173 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d93b5-f36d-451a-9049-17b0a587e556 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:37.563642 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d93b5-f36d-451a-9049-17b0a587e556 None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:37.564499 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d93b5-f36d-451a-9049-17b0a587e556 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:37.566136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d93b5-f36d-451a-9049-17b0a587e556 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:37.600780 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13167ca7-c961-4b62-aad3-840826de632b None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:37.620742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.sql.core [None req-199d93b5-f36d-451a-9049-17b0a587e556 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 22:39:37.620742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 06 22:39:37.620742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [parameters: {'user_id': '56127754fb7749db898e17fe6064fb87', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 06 22:39:37.620742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88078) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 22:39:37.627354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-199d93b5-f36d-451a-9049-17b0a587e556 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 06 22:39:37.627354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:37.627354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 22:39:37.627354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 22:39:37.627354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 22:39:37.627354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 22:39:37.627354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 22:39:37.627354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 22:39:37.627354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 22:39:37.627354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application conn.query(q) Sep 06 22:39:37.627354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 22:39:37.627354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 22:39:37.627354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 22:39:37.627354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application result.read() Sep 06 22:39:37.627354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 22:39:37.628210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 22:39:37.628210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 22:39:37.628210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 22:39:37.628210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 22:39:37.628210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 22:39:37.628210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 22:39:37.628210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 22:39:37.628210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 22:39:37.628210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:37.628210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 22:39:37.628210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:37.628210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:37.628210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 22:39:37.628210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 22:39:37.628210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 06 22:39:37.628210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 06 22:39:37.628210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 22:39:37.628210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application next(self.gen) Sep 06 22:39:37.629449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 22:39:37.629449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application yield resource Sep 06 22:39:37.629449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 22:39:37.629449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application next(self.gen) Sep 06 22:39:37.629449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 22:39:37.629449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 22:39:37.629449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 22:39:37.629449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 22:39:37.629449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 22:39:37.629449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise self.value Sep 06 22:39:37.629449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 22:39:37.629449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 22:39:37.629449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 22:39:37.629449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application session.commit() Sep 06 22:39:37.629449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 22:39:37.629449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 22:39:37.629449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 22:39:37.630805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 22:39:37.630805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 22:39:37.630805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self.session.flush() Sep 06 22:39:37.630805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 22:39:37.630805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 22:39:37.630805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 22:39:37.630805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 22:39:37.630805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 22:39:37.630805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application compat.raise_( Sep 06 22:39:37.630805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 22:39:37.630805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception Sep 06 22:39:37.630805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 22:39:37.630805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 22:39:37.630805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 22:39:37.630805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 22:39:37.630805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 22:39:37.630805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 22:39:37.631723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 22:39:37.631723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 22:39:37.631723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 06 22:39:37.631723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 06 22:39:37.631723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 22:39:37.631723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 22:39:37.631723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 22:39:37.631723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 22:39:37.631723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 22:39:37.631723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 22:39:37.631723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 22:39:37.631723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 22:39:37.631723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 22:39:37.631723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 22:39:37.631723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 22:39:37.631723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception Sep 06 22:39:37.632619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 22:39:37.632619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 22:39:37.632619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 22:39:37.632619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 22:39:37.632619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 22:39:37.632619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 22:39:37.632619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 22:39:37.632619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application conn.query(q) Sep 06 22:39:37.632619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 22:39:37.632619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 22:39:37.632619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 22:39:37.632619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application result.read() Sep 06 22:39:37.632619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 22:39:37.632619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 22:39:37.632619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 22:39:37.632619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 22:39:37.637257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 22:39:37.637257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 22:39:37.637257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 22:39:37.637257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 22:39:37.637257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 22:39:37.637257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 06 22:39:37.637257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [parameters: {'user_id': '56127754fb7749db898e17fe6064fb87', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 06 22:39:37.637257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 22:39:37.637257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:37.637257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:37.637257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:37.637257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:37.637257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:37.637257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:37.637257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:37.639799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:37.639799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:37.639799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:37.639799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:37.639799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:37.639799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:37.639799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:37.639799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 06 22:39:37.639799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 06 22:39:37.639799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:37.639799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:37.639799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:39:37.639799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:37.639799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:39:37.639799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:37.639799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 06 22:39:37.639799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 06 22:39:37.649298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 06 22:39:37.649298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 06 22:39:37.649298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 22:39:37.649298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 22:39:37.649298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 06 22:39:37.649298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:37.649298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 494/971] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Sep 6 22:39:37 2022] POST /identity/v3/users => generated 160 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:37.649298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d93b5-f36d-451a-9049-17b0a587e556 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:37.650382 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93e0ad-b0f4-466d-bf2d-1cb983a283ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:37.650382 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93e0ad-b0f4-466d-bf2d-1cb983a283ac None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:37.650382 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93e0ad-b0f4-466d-bf2d-1cb983a283ac None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:37.650382 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93e0ad-b0f4-466d-bf2d-1cb983a283ac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:37.653319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93e0ad-b0f4-466d-bf2d-1cb983a283ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:37.654869 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93e0ad-b0f4-466d-bf2d-1cb983a283ac None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:37.668105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-3f93e0ad-b0f4-466d-bf2d-1cb983a283ac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 22:39:37.668105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:37.668105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:37.668105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:37.668105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:37.668105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:37.668105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:37.668105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:37.668105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:37.668105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:37.668105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:37.668105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:37.668105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:39:37.668105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:39:37.668105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:39:37.668105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:39:37.670036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:37.670036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:37.670036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:39:37.670036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:37.670036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:39:37.670036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:37.670036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:37.670036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:37.670036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:37.670036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:37.670036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:37.670036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:37.670036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:37.670036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:37.670036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:37.670036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:37.670036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:37.670036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:37.671668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:37.671668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:37.671668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:39:37.671668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:39:37.671668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:39:37.671668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:39:37.671668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:39:37.671668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:39:37.671668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 22:39:37.671668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:37.671668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 478/972] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Sep 6 22:39:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:37.671668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93e0ad-b0f4-466d-bf2d-1cb983a283ac None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:37.735270 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d93b5-f36d-451a-9049-17b0a587e556 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:37.741223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:37.752731 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:37.770675 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e943b-3b75-492f-ad0a-89b908372103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:37.771325 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e943b-3b75-492f-ad0a-89b908372103 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:37.771604 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e943b-3b75-492f-ad0a-89b908372103 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:37.771880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e943b-3b75-492f-ad0a-89b908372103 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:37.772489 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e943b-3b75-492f-ad0a-89b908372103 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:37.774161 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e943b-3b75-492f-ad0a-89b908372103 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:37.782443 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93e0ad-b0f4-466d-bf2d-1cb983a283ac None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:37.782748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-072e943b-3b75-492f-ad0a-89b908372103 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 22:39:37.782748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:37.782748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:37.782748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:37.782748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:37.782748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:37.782748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:37.782748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:37.782748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 22:39:37.782748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:37.782748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:37.782748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:37.782748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:37.782748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:37.782748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:37.782748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:37.782748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:37.783759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:37.783759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:37.783759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:37.783759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:37.783759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:37.783759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:37.783759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:37.783759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:37.783759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:37.783759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:37.783759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:37.783759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:37.783759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:37.783759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:37.783759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:37.783759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:37.785464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:37.785464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:37.785464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:37.785464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:37.785464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:37.785464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:37.785464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:37.785464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:37.785464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:37.785464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:37.785464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:37.785464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:37.785464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 22:39:37.785464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:37.785464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 495/973] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Sep 6 22:39:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:37.786355 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e943b-3b75-492f-ad0a-89b908372103 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:37.828431 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a304057-3700-491f-bc80-438ddd9c4f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:37.829360 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a304057-3700-491f-bc80-438ddd9c4f8e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:37.829688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a304057-3700-491f-bc80-438ddd9c4f8e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:37.829938 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a304057-3700-491f-bc80-438ddd9c4f8e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:37.838698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a304057-3700-491f-bc80-438ddd9c4f8e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:37.840220 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a304057-3700-491f-bc80-438ddd9c4f8e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:37.852305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-5a304057-3700-491f-bc80-438ddd9c4f8e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 22:39:37.852305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:37.852305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:37.852305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:37.852305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:37.852305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:37.852305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:37.852305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:37.852305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:37.852305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:37.852305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:37.852305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:37.852305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:39:37.852305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:39:37.852305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:39:37.852305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:39:37.854146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:37.854146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:37.854146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:39:37.854146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:37.854146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:39:37.854146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:37.854146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:37.854146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:37.854146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:37.854146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:37.854146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:37.854146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:37.854146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:37.854146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:37.854146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:37.854146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:37.854146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:37.854146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:37.855128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:37.855128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:37.855128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:39:37.855128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:39:37.855128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:39:37.855128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:39:37.855128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:39:37.855128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:39:37.855128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 22:39:37.855128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:37.858658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 479/974] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:39:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:37.859446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a304057-3700-491f-bc80-438ddd9c4f8e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:37.914031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e943b-3b75-492f-ad0a-89b908372103 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:37.952014 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2218be-e52f-4198-9d40-96521b3b346a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:37.952665 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2218be-e52f-4198-9d40-96521b3b346a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:37.952946 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2218be-e52f-4198-9d40-96521b3b346a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:37.953231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2218be-e52f-4198-9d40-96521b3b346a None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:37.954211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2218be-e52f-4198-9d40-96521b3b346a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:37.954516 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2218be-e52f-4198-9d40-96521b3b346a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:37.956192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2218be-e52f-4198-9d40-96521b3b346a None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:37.965253 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a304057-3700-491f-bc80-438ddd9c4f8e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:37.982850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 496/975] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Sep 6 22:39:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:37.982850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2218be-e52f-4198-9d40-96521b3b346a None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:37.995136 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:38.005945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c17dc0-6fb1-4948-be09-335e0254fc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:38.006558 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c17dc0-6fb1-4948-be09-335e0254fc52 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:38.006838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c17dc0-6fb1-4948-be09-335e0254fc52 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:38.007147 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c17dc0-6fb1-4948-be09-335e0254fc52 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:38.007740 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c17dc0-6fb1-4948-be09-335e0254fc52 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:38.008041 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c17dc0-6fb1-4948-be09-335e0254fc52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:38.009479 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c17dc0-6fb1-4948-be09-335e0254fc52 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:38.016455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 480/976] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Sep 6 22:39:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:38.016455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c17dc0-6fb1-4948-be09-335e0254fc52 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:38.025890 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:38.094920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2218be-e52f-4198-9d40-96521b3b346a None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:38.126862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c17dc0-6fb1-4948-be09-335e0254fc52 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:38.130154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7c218-e1c2-4a9c-809e-4fc96721420d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:38.130778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7c218-e1c2-4a9c-809e-4fc96721420d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:38.131060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7c218-e1c2-4a9c-809e-4fc96721420d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:38.131397 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7c218-e1c2-4a9c-809e-4fc96721420d None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:38.132101 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7c218-e1c2-4a9c-809e-4fc96721420d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:38.132483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7c218-e1c2-4a9c-809e-4fc96721420d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:38.134880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7c218-e1c2-4a9c-809e-4fc96721420d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:38.164371 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b998375-f041-4014-818c-d452bffc0c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:38.165036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b998375-f041-4014-818c-d452bffc0c2a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:38.165310 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b998375-f041-4014-818c-d452bffc0c2a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:38.165665 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b998375-f041-4014-818c-d452bffc0c2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:38.180459 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 497/977] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Sep 6 22:39:37 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:38.180459 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7c218-e1c2-4a9c-809e-4fc96721420d None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:38.240326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:38.255643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b998375-f041-4014-818c-d452bffc0c2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:38.257454 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b998375-f041-4014-818c-d452bffc0c2a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:38.296742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:38.303855 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7c218-e1c2-4a9c-809e-4fc96721420d None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:38.344664 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c91abf-c820-4187-92d7-5b3ead58dd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:38.345663 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c91abf-c820-4187-92d7-5b3ead58dd73 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:38.346241 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c91abf-c820-4187-92d7-5b3ead58dd73 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:38.346521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c91abf-c820-4187-92d7-5b3ead58dd73 None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:38.347175 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c91abf-c820-4187-92d7-5b3ead58dd73 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:38.347481 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c91abf-c820-4187-92d7-5b3ead58dd73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:38.349041 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c91abf-c820-4187-92d7-5b3ead58dd73 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:38.359615 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 498/978] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Sep 6 22:39:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:38.359615 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989f252-cd4e-454b-8750-d5f752542b28 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:38.359615 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989f252-cd4e-454b-8750-d5f752542b28 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:38.359615 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989f252-cd4e-454b-8750-d5f752542b28 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:38.359615 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 499/979] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:38.361278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989f252-cd4e-454b-8750-d5f752542b28 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:38.373719 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 481/980] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:39:38 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 22:39:38.374859 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6866b93-4ee1-4c79-9d48-e8207e424876 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:38.375153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6866b93-4ee1-4c79-9d48-e8207e424876 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:38.375429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6866b93-4ee1-4c79-9d48-e8207e424876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:38.395453 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d6866b93-4ee1-4c79-9d48-e8207e424876 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:38.396691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d6866b93-4ee1-4c79-9d48-e8207e424876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:38.477730 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 482/981] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:38.478763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6866b93-4ee1-4c79-9d48-e8207e424876 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:38.485500 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989f252-cd4e-454b-8750-d5f752542b28 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:38.501908 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:38.522766 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45aedc-c158-4a63-88ab-e371964115b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:38.523378 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45aedc-c158-4a63-88ab-e371964115b7 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:38.523654 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45aedc-c158-4a63-88ab-e371964115b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:38.523921 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45aedc-c158-4a63-88ab-e371964115b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:38.524649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45aedc-c158-4a63-88ab-e371964115b7 None admin] RBAC: Adding query filter params (interface=admin, service_id=26527cb460c245cd95d83d5db07f7432, region_id=RegionOne) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:38.525001 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45aedc-c158-4a63-88ab-e371964115b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:38.526369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45aedc-c158-4a63-88ab-e371964115b7 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:38.531488 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 500/982] 10.222.0.30 () {56 vars in 1249 bytes} [Tue Sep 6 22:39:38 2022] GET /identity/v3/endpoints?service_id=26527cb460c245cd95d83d5db07f7432&interface=admin®ion_id=RegionOne => generated 193 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:38.537269 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45aedc-c158-4a63-88ab-e371964115b7 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:38.563618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:38.590612 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6866b93-4ee1-4c79-9d48-e8207e424876 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:38.627174 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25fee3-1e09-45bf-bb3d-832f450a4eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:38.627740 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25fee3-1e09-45bf-bb3d-832f450a4eee None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:38.628026 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25fee3-1e09-45bf-bb3d-832f450a4eee None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:38.628295 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25fee3-1e09-45bf-bb3d-832f450a4eee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:38.638978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25fee3-1e09-45bf-bb3d-832f450a4eee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:38.640457 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25fee3-1e09-45bf-bb3d-832f450a4eee None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:38.648875 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45aedc-c158-4a63-88ab-e371964115b7 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:38.655532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-cb25fee3-1e09-45bf-bb3d-832f450a4eee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:38.655532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:38.655532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:38.655532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:38.655532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:38.655532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:38.655532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:38.655532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:38.655532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:38.655532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:38.655532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:38.655532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:38.655532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:38.655532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:38.655532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:38.655532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:38.656532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:38.656532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:38.656532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:38.656532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:38.656532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:38.656532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:38.656532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:38.656532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:38.656532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:38.656532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:38.656532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:38.656532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:38.656532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:38.656532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:38.656532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:38.656532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:38.656532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:38.657479 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:38.657479 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:38.657479 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:38.657479 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 483/983] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:38.662097 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25fee3-1e09-45bf-bb3d-832f450a4eee None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:38.688469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b5585-37a5-4c2b-a39b-d0792c293a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:38.689314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b5585-37a5-4c2b-a39b-d0792c293a96 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:38.689747 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b5585-37a5-4c2b-a39b-d0792c293a96 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:38.690262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b5585-37a5-4c2b-a39b-d0792c293a96 None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:38.691116 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b5585-37a5-4c2b-a39b-d0792c293a96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:38.692626 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b5585-37a5-4c2b-a39b-d0792c293a96 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:38.707600 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 501/984] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Sep 6 22:39:38 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:39:38.734482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:38.751695 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b5585-37a5-4c2b-a39b-d0792c293a96 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:38.770466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25fee3-1e09-45bf-bb3d-832f450a4eee None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:38.809877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554aa0d2-de6c-4dcb-ae39-8b7b628034b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:38.810492 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554aa0d2-de6c-4dcb-ae39-8b7b628034b0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:38.810766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554aa0d2-de6c-4dcb-ae39-8b7b628034b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:38.811043 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554aa0d2-de6c-4dcb-ae39-8b7b628034b0 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:38.811712 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554aa0d2-de6c-4dcb-ae39-8b7b628034b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:38.812014 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554aa0d2-de6c-4dcb-ae39-8b7b628034b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:38.813444 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554aa0d2-de6c-4dcb-ae39-8b7b628034b0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:38.826162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 484/985] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:38.832171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554aa0d2-de6c-4dcb-ae39-8b7b628034b0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:38.862974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:38.878179 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b5585-37a5-4c2b-a39b-d0792c293a96 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:38.919696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fedde-9195-4ef5-b0de-a0faca5890eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:38.920774 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fedde-9195-4ef5-b0de-a0faca5890eb None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:38.921260 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fedde-9195-4ef5-b0de-a0faca5890eb None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:38.921797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fedde-9195-4ef5-b0de-a0faca5890eb None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:38.922622 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fedde-9195-4ef5-b0de-a0faca5890eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:38.924270 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fedde-9195-4ef5-b0de-a0faca5890eb None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:38.939253 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554aa0d2-de6c-4dcb-ae39-8b7b628034b0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:38.967647 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:38.973124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a15b8-4992-41a3-ae6d-b2e9cb0ef7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:38.973762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a15b8-4992-41a3-ae6d-b2e9cb0ef7b8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:38.974034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a15b8-4992-41a3-ae6d-b2e9cb0ef7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:38.974303 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a15b8-4992-41a3-ae6d-b2e9cb0ef7b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:38.981644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a15b8-4992-41a3-ae6d-b2e9cb0ef7b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:38.984453 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 502/986] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Sep 6 22:39:38 2022] POST /identity/v3/services => generated 242 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:39:38.984604 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a15b8-4992-41a3-ae6d-b2e9cb0ef7b8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:38.995230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-7e8a15b8-4992-41a3-ae6d-b2e9cb0ef7b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:38.995230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:38.995230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:38.995230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:38.995230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:38.995230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:38.995230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:38.995230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:38.995230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:38.995230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:38.995230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:38.995230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:38.995230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:39:38.995230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:39:38.995230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:39:38.996247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:39:38.996247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:38.996247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:38.996247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:38.996247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:38.996247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:38.996247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:38.996247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:38.996247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:38.996247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:38.996247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:38.996247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:38.996247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:38.996247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:38.996247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:38.996247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:38.996247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:38.997550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:39:38.997550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:39:38.997550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:39:38.997550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:39:38.997550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:39:38.997550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:39:38.997550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:38.997550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:38.997550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 485/987] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:39.004559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fedde-9195-4ef5-b0de-a0faca5890eb None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:39.133789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fedde-9195-4ef5-b0de-a0faca5890eb None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:39.172476 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40863403-80e8-4228-a677-abc573a73335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:39.173098 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863403-80e8-4228-a677-abc573a73335 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:39.173379 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863403-80e8-4228-a677-abc573a73335 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:39.173647 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863403-80e8-4228-a677-abc573a73335 None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:39.174335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40863403-80e8-4228-a677-abc573a73335 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:39.174633 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40863403-80e8-4228-a677-abc573a73335 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:39.176050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40863403-80e8-4228-a677-abc573a73335 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:39.188562 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 503/988] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:39.195056 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a15b8-4992-41a3-ae6d-b2e9cb0ef7b8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:39.299690 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a15b8-4992-41a3-ae6d-b2e9cb0ef7b8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:39.335263 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04087ac-c2bd-4647-b9cf-5f507f80821c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:39.336049 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04087ac-c2bd-4647-b9cf-5f507f80821c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:39.336502 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04087ac-c2bd-4647-b9cf-5f507f80821c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:39.336836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04087ac-c2bd-4647-b9cf-5f507f80821c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:39.338279 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04087ac-c2bd-4647-b9cf-5f507f80821c None admin] RBAC: Adding query filter params (role.id=ea85f0a3b95b4866b3f1ec715073e153, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=642d4bef7e9c459a8d2dde636094b528) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:39.338689 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04087ac-c2bd-4647-b9cf-5f507f80821c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:39.340222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04087ac-c2bd-4647-b9cf-5f507f80821c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:39.346600 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 486/989] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:39:39 2022] GET /identity/v3/role_assignments?user.id=642d4bef7e9c459a8d2dde636094b528&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=ea85f0a3b95b4866b3f1ec715073e153 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:40.878326 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e6ee0-0c02-4dee-8eaf-c78b65ad5d4c None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:40.878846 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e6ee0-0c02-4dee-8eaf-c78b65ad5d4c None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:40.878846 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e6ee0-0c02-4dee-8eaf-c78b65ad5d4c None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:40.880371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 504/990] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:40.885443 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ade7c-418f-4ef4-84a7-b75414b25e63 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:40.885836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ade7c-418f-4ef4-84a7-b75414b25e63 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:40.885995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ade7c-418f-4ef4-84a7-b75414b25e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:40.904126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4f8ade7c-418f-4ef4-84a7-b75414b25e63 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:40.905346 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4f8ade7c-418f-4ef4-84a7-b75414b25e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:40.957399 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:40.975163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 487/991] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:41.152395 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11251902-c397-4d6b-82e3-7d130b3cae6b None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:41.152718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11251902-c397-4d6b-82e3-7d130b3cae6b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:41.152898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11251902-c397-4d6b-82e3-7d130b3cae6b None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:41.154378 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 505/992] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:41.159451 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8c917-c79f-4bf9-8bf1-b2d4fd00180c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:41.159741 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8c917-c79f-4bf9-8bf1-b2d4fd00180c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:41.160016 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8c917-c79f-4bf9-8bf1-b2d4fd00180c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:41.178916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-91d8c917-c79f-4bf9-8bf1-b2d4fd00180c None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:41.180100 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-91d8c917-c79f-4bf9-8bf1-b2d4fd00180c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:41.242168 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11251902-c397-4d6b-82e3-7d130b3cae6b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:41.246066 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:41.252462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 488/993] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:41 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:41.345697 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11251902-c397-4d6b-82e3-7d130b3cae6b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:41.380057 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f49816-5064-40d5-9e5e-ea4e87149f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:41.380760 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f49816-5064-40d5-9e5e-ea4e87149f17 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:41.381077 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f49816-5064-40d5-9e5e-ea4e87149f17 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:41.381343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f49816-5064-40d5-9e5e-ea4e87149f17 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:41.381909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f49816-5064-40d5-9e5e-ea4e87149f17 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:41.383258 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f49816-5064-40d5-9e5e-ea4e87149f17 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:41.392321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-55f49816-5064-40d5-9e5e-ea4e87149f17 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 22:39:41.392321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:41.392321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:41.392321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:41.392321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:41.392321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:41.392321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:41.392321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:41.392321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 22:39:41.392321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:41.392321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:41.392321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:41.392321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:41.392321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:41.392321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:41.392321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:41.392321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:41.396634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:41.396634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:41.396634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:41.396634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:41.396634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:41.396634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:41.396634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:41.396634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:41.396634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:41.396634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:41.396634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:41.396634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:41.396634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:41.396634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:41.396634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:41.396634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:41.397559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:41.397559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:41.397559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:41.397559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:41.397559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:41.397559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:41.397559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:41.397559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:41.397559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:41.397559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:41.397559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:41.397559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:41.397559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 22:39:41.397559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:41.397559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 506/994] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Sep 6 22:39:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:41.400397 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8c917-c79f-4bf9-8bf1-b2d4fd00180c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:41.508226 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8c917-c79f-4bf9-8bf1-b2d4fd00180c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:41.519943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f49816-5064-40d5-9e5e-ea4e87149f17 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:41.523670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:41.546431 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249de1a-f610-4f95-89fc-2df2a1260c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:41.547054 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249de1a-f610-4f95-89fc-2df2a1260c97 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:41.547333 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249de1a-f610-4f95-89fc-2df2a1260c97 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:41.547615 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249de1a-f610-4f95-89fc-2df2a1260c97 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:41.548296 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249de1a-f610-4f95-89fc-2df2a1260c97 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:41.548625 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249de1a-f610-4f95-89fc-2df2a1260c97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:41.550000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249de1a-f610-4f95-89fc-2df2a1260c97 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:41.555294 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 489/995] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Sep 6 22:39:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:41.556474 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49d872-888b-4cd6-9011-dcf2a2bd96e1 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:41.556764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49d872-888b-4cd6-9011-dcf2a2bd96e1 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:41.557044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49d872-888b-4cd6-9011-dcf2a2bd96e1 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:41.558351 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 490/996] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:41.561318 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49d872-888b-4cd6-9011-dcf2a2bd96e1 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:41.590373 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:41.623082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f49816-5064-40d5-9e5e-ea4e87149f17 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:41.656829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd27bf5-c45c-4500-9529-5d1ec2d90f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:41.657463 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd27bf5-c45c-4500-9529-5d1ec2d90f73 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:41.657744 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd27bf5-c45c-4500-9529-5d1ec2d90f73 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:41.658015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd27bf5-c45c-4500-9529-5d1ec2d90f73 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:41.658593 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd27bf5-c45c-4500-9529-5d1ec2d90f73 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:41.660021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd27bf5-c45c-4500-9529-5d1ec2d90f73 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:41.661965 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49d872-888b-4cd6-9011-dcf2a2bd96e1 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:41.670255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-ebd27bf5-c45c-4500-9529-5d1ec2d90f73 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 22:39:41.670255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:41.670255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:41.670255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:41.670255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:41.670255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:41.670255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:41.670255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:41.670255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 22:39:41.670255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:41.670255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:41.670255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:41.670255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:41.670255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:41.670255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:41.670255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:41.670255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:41.671336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:41.671336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:41.671336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:41.671336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:41.671336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:41.671336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:41.671336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:41.671336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:41.671336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:41.671336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:41.671336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:41.671336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:41.671336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:41.671336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:41.671336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:41.671336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:41.672189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:41.672189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:41.672189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:41.672189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:41.672189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:41.672189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:41.672189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:41.672189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:41.672189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:41.672189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:41.672189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:41.672189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:41.672189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 22:39:41.672189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:41.672189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 507/997] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:41.673024 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded899f2-2fb2-440e-ad3a-1dee92fd0b1b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:41.673024 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded899f2-2fb2-440e-ad3a-1dee92fd0b1b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:41.673211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded899f2-2fb2-440e-ad3a-1dee92fd0b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:41.690815 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-ded899f2-2fb2-440e-ad3a-1dee92fd0b1b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:41.692335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ded899f2-2fb2-440e-ad3a-1dee92fd0b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:41.696988 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafd865-2337-4f52-b3db-6e645ca33464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:41.697595 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafd865-2337-4f52-b3db-6e645ca33464 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:41.697869 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafd865-2337-4f52-b3db-6e645ca33464 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:41.698135 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafd865-2337-4f52-b3db-6e645ca33464 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:41.698751 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafd865-2337-4f52-b3db-6e645ca33464 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:41.699046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafd865-2337-4f52-b3db-6e645ca33464 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:41.700396 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafd865-2337-4f52-b3db-6e645ca33464 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:41.705345 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 491/998] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Sep 6 22:39:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:41.706097 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafd865-2337-4f52-b3db-6e645ca33464 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:41.751410 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:41.764628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 508/999] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:41 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:41.764628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded899f2-2fb2-440e-ad3a-1dee92fd0b1b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:41.812669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafd865-2337-4f52-b3db-6e645ca33464 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:41.826186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:41.849090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c21465-1326-4f0f-a7c7-fd9e0a3755a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:41.849699 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c21465-1326-4f0f-a7c7-fd9e0a3755a2 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:41.849975 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c21465-1326-4f0f-a7c7-fd9e0a3755a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:41.850247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c21465-1326-4f0f-a7c7-fd9e0a3755a2 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:41.851752 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c21465-1326-4f0f-a7c7-fd9e0a3755a2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:41.851752 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c21465-1326-4f0f-a7c7-fd9e0a3755a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:41.852520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c21465-1326-4f0f-a7c7-fd9e0a3755a2 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:41.857669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 492/1000] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Sep 6 22:39:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:41.864271 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c21465-1326-4f0f-a7c7-fd9e0a3755a2 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:41.881737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded899f2-2fb2-440e-ad3a-1dee92fd0b1b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:41.920484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68c86e-8205-4f72-a116-2d933b581897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:41.921195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68c86e-8205-4f72-a116-2d933b581897 None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:41.921481 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68c86e-8205-4f72-a116-2d933b581897 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:41.921756 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68c86e-8205-4f72-a116-2d933b581897 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:41.922418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68c86e-8205-4f72-a116-2d933b581897 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:41.923828 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68c86e-8205-4f72-a116-2d933b581897 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:41.968513 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c21465-1326-4f0f-a7c7-fd9e0a3755a2 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:41.975612 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:41.997059 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 509/1001] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:39:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:39:42.022223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9321b25-dfe2-47fe-94b7-3323f105dc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:42.022223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9321b25-dfe2-47fe-94b7-3323f105dc81 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:42.022223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9321b25-dfe2-47fe-94b7-3323f105dc81 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:42.022223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9321b25-dfe2-47fe-94b7-3323f105dc81 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:42.022654 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9321b25-dfe2-47fe-94b7-3323f105dc81 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:42.023017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9321b25-dfe2-47fe-94b7-3323f105dc81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:42.024600 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9321b25-dfe2-47fe-94b7-3323f105dc81 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:42.027348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68c86e-8205-4f72-a116-2d933b581897 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:42.031588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 493/1002] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Sep 6 22:39:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:42.037424 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9321b25-dfe2-47fe-94b7-3323f105dc81 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:42.152296 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68c86e-8205-4f72-a116-2d933b581897 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:42.154934 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9321b25-dfe2-47fe-94b7-3323f105dc81 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:42.177017 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:42.193175 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f38809-8d50-4769-adcf-8d771ba5a1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:42.193347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f38809-8d50-4769-adcf-8d771ba5a1a5 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:42.193586 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f38809-8d50-4769-adcf-8d771ba5a1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:42.193779 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f38809-8d50-4769-adcf-8d771ba5a1a5 None admin] PATH_INFO: `/v3/services/image` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:42.194368 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f38809-8d50-4769-adcf-8d771ba5a1a5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:42.196179 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f38809-8d50-4769-adcf-8d771ba5a1a5 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:42.201583 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa56984-6a46-4b0e-a50f-99e879e296bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:42.202419 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa56984-6a46-4b0e-a50f-99e879e296bc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:42.202699 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa56984-6a46-4b0e-a50f-99e879e296bc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:42.202970 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa56984-6a46-4b0e-a50f-99e879e296bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:42.203945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa56984-6a46-4b0e-a50f-99e879e296bc None admin] RBAC: Adding query filter params (interface=public, service_id=8a1b0591bbe7439f866bf42760a3d1b0, region_id=RegionOne) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:42.204249 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa56984-6a46-4b0e-a50f-99e879e296bc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:42.205662 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa56984-6a46-4b0e-a50f-99e879e296bc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:42.206484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-53f38809-8d50-4769-adcf-8d771ba5a1a5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 22:39:42.206484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:42.206484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:42.206484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:42.206484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:42.206484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:42.206484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:42.206484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:42.206484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 22:39:42.206484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:42.206484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:42.206484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:42.206484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:42.206484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:42.206484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:42.206484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:42.206484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:42.207484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:42.207484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:42.207484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:42.207484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:42.207484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:42.207484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:42.207484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:42.207484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:42.207484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:42.207484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:42.207484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:42.207484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:42.207484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:42.207484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:42.207484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:42.207484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:42.208320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:42.208320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:42.208320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:42.208320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:42.208320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:42.208320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:42.208320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:42.208320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:42.208320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:42.208320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:42.208320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:42.208320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:42.208320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 22:39:42.208320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:42.208320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 510/1003] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Sep 6 22:39:42 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:42.212590 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 494/1004] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Sep 6 22:39:42 2022] GET /identity/v3/endpoints?service_id=8a1b0591bbe7439f866bf42760a3d1b0&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:42.213093 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f38809-8d50-4769-adcf-8d771ba5a1a5 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:42.218431 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa56984-6a46-4b0e-a50f-99e879e296bc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:42.250664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:42.316748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f38809-8d50-4769-adcf-8d771ba5a1a5 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:42.325279 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa56984-6a46-4b0e-a50f-99e879e296bc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:42.351449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bc873-cffd-4aee-86e3-ee18f520c282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:42.352076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bc873-cffd-4aee-86e3-ee18f520c282 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:42.352355 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bc873-cffd-4aee-86e3-ee18f520c282 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:42.353229 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bc873-cffd-4aee-86e3-ee18f520c282 None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:42.353864 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bc873-cffd-4aee-86e3-ee18f520c282 None admin] RBAC: Adding query filter params (name=image) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:42.354169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bc873-cffd-4aee-86e3-ee18f520c282 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:42.355531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bc873-cffd-4aee-86e3-ee18f520c282 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:42.360459 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 511/1005] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:42.361751 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a069f35-0c6e-49c6-9585-d8ebf3718229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:42.362367 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a069f35-0c6e-49c6-9585-d8ebf3718229 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:42.362646 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a069f35-0c6e-49c6-9585-d8ebf3718229 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:42.362916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a069f35-0c6e-49c6-9585-d8ebf3718229 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:42.363519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a069f35-0c6e-49c6-9585-d8ebf3718229 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:42.365720 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bc873-cffd-4aee-86e3-ee18f520c282 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:42.366132 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a069f35-0c6e-49c6-9585-d8ebf3718229 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:42.380449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 495/1006] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Sep 6 22:39:42 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:39:42.428853 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:42.483741 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bc873-cffd-4aee-86e3-ee18f520c282 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:42.524946 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee87a2c-70a9-409f-8826-9082aa6c55ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:42.525954 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee87a2c-70a9-409f-8826-9082aa6c55ea None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:42.526442 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee87a2c-70a9-409f-8826-9082aa6c55ea None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:42.526922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee87a2c-70a9-409f-8826-9082aa6c55ea None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:42.527772 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee87a2c-70a9-409f-8826-9082aa6c55ea None admin] RBAC: Adding query filter params (type=image) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:42.528313 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee87a2c-70a9-409f-8826-9082aa6c55ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:42.529950 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee87a2c-70a9-409f-8826-9082aa6c55ea None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:42.535835 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 512/1007] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:44.192260 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1099c-17b7-479f-8e26-f21f5a2fdcc4 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:44.192800 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1099c-17b7-479f-8e26-f21f5a2fdcc4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:44.192877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1099c-17b7-479f-8e26-f21f5a2fdcc4 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:44.194343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 496/1008] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:44.199994 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe9b53-af8a-4b69-8f61-c6d04e201169 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:44.200404 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe9b53-af8a-4b69-8f61-c6d04e201169 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:44.200605 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe9b53-af8a-4b69-8f61-c6d04e201169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:44.219493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-e3fe9b53-af8a-4b69-8f61-c6d04e201169 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:44.220726 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e3fe9b53-af8a-4b69-8f61-c6d04e201169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:44.287645 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 513/1009] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:44 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:44.551227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002446ce-223c-4ef9-b689-832ed3c1f737 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:44.551652 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002446ce-223c-4ef9-b689-832ed3c1f737 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:44.551768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002446ce-223c-4ef9-b689-832ed3c1f737 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:44.553192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 497/1010] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:44.556559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe9b53-af8a-4b69-8f61-c6d04e201169 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:44.559581 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f3b33-a0e2-407b-8c38-ba9028591a2d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:44.559857 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f3b33-a0e2-407b-8c38-ba9028591a2d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:44.560119 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f3b33-a0e2-407b-8c38-ba9028591a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:44.579244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-be4f3b33-a0e2-407b-8c38-ba9028591a2d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:44.580502 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-be4f3b33-a0e2-407b-8c38-ba9028591a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:44.608042 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:44.655461 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 498/1011] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:44 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 22:39:44.664629 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe9b53-af8a-4b69-8f61-c6d04e201169 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:44.676958 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7679079-7657-4541-8967-531e4c2ca83e None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:44.677255 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7679079-7657-4541-8967-531e4c2ca83e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:44.677531 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7679079-7657-4541-8967-531e4c2ca83e None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:44.678983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 499/1012] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:39:44.684235 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bf62e-6cd1-4c27-9475-24df8f5d32a2 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:44.684547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bf62e-6cd1-4c27-9475-24df8f5d32a2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:44.684822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bf62e-6cd1-4c27-9475-24df8f5d32a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:44.702053 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fbc5b-2d18-4ed0-9d1c-4e4c184ac868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:44.702919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4e1bf62e-6cd1-4c27-9475-24df8f5d32a2 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:44.703065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fbc5b-2d18-4ed0-9d1c-4e4c184ac868 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:44.703557 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fbc5b-2d18-4ed0-9d1c-4e4c184ac868 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:44.703839 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fbc5b-2d18-4ed0-9d1c-4e4c184ac868 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:44.704367 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4e1bf62e-6cd1-4c27-9475-24df8f5d32a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:44.704991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fbc5b-2d18-4ed0-9d1c-4e4c184ac868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:44.706533 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fbc5b-2d18-4ed0-9d1c-4e4c184ac868 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:44.712843 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 514/1013] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:44.713943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fbc5b-2d18-4ed0-9d1c-4e4c184ac868 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:44.723863 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:44.777626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 500/1014] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:44 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 22:39:44.818095 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fbc5b-2d18-4ed0-9d1c-4e4c184ac868 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:44.831450 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:44.853244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4007f-bfda-48a1-912e-595947b11591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:44.853855 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4007f-bfda-48a1-912e-595947b11591 None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:44.854133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4007f-bfda-48a1-912e-595947b11591 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:44.854403 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4007f-bfda-48a1-912e-595947b11591 None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:44.855108 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4007f-bfda-48a1-912e-595947b11591 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:44.856663 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4007f-bfda-48a1-912e-595947b11591 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:44.921324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bf62e-6cd1-4c27-9475-24df8f5d32a2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:44.947349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 515/1015] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Sep 6 22:39:44 2022] POST /identity/v3/projects => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:39:45.032726 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bf62e-6cd1-4c27-9475-24df8f5d32a2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:45.045806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4007f-bfda-48a1-912e-595947b11591 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:45.073146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417fea9-da82-4909-a6ba-1f05317ad333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:45.073765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417fea9-da82-4909-a6ba-1f05317ad333 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:45.073998 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417fea9-da82-4909-a6ba-1f05317ad333 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:45.074269 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417fea9-da82-4909-a6ba-1f05317ad333 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:45.074877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417fea9-da82-4909-a6ba-1f05317ad333 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:45.076364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417fea9-da82-4909-a6ba-1f05317ad333 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:45.086083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-c417fea9-da82-4909-a6ba-1f05317ad333 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 22:39:45.086083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:45.086083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:45.086083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:45.086083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:45.086083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:45.086083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:45.086083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:45.086083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 22:39:45.086083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:45.086083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:45.086083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:45.086083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:45.086083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:45.086083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:45.086083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:45.086083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:45.087791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:45.087791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:45.087791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:45.087791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:45.087791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:45.087791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:45.087791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:45.087791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:45.087791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:45.087791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:45.087791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:45.087791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:45.087791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:45.087791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:45.087791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:45.087791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:45.088686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:45.088686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:45.088686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:45.088686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:45.088686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:45.088686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:45.088686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:45.088686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:45.088686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:45.088686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:45.088686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:45.088686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:45.088686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 22:39:45.088686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:45.093042 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 501/1016] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:45.097008 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417fea9-da82-4909-a6ba-1f05317ad333 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:45.114897 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:45.167694 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4007f-bfda-48a1-912e-595947b11591 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:45.204714 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0da24-ed8d-4c4c-8cae-4c704c44dd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:45.205438 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0da24-ed8d-4c4c-8cae-4c704c44dd9e None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:45.205793 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0da24-ed8d-4c4c-8cae-4c704c44dd9e None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:45.206074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0da24-ed8d-4c4c-8cae-4c704c44dd9e None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:45.206777 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0da24-ed8d-4c4c-8cae-4c704c44dd9e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:45.208137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0da24-ed8d-4c4c-8cae-4c704c44dd9e None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:45.209205 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417fea9-da82-4909-a6ba-1f05317ad333 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:45.244792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a8b72-a268-4a73-9630-ddb959a9605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:45.245499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a8b72-a268-4a73-9630-ddb959a9605d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:45.245846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a8b72-a268-4a73-9630-ddb959a9605d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:45.246127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a8b72-a268-4a73-9630-ddb959a9605d None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:45.246760 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a8b72-a268-4a73-9630-ddb959a9605d None admin] RBAC: Adding query filter params (name=compute) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:45.247065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a8b72-a268-4a73-9630-ddb959a9605d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:45.248465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a8b72-a268-4a73-9630-ddb959a9605d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:45.253366 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 502/1017] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Sep 6 22:39:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:45.259193 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a8b72-a268-4a73-9630-ddb959a9605d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:45.307311 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 516/1018] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Sep 6 22:39:45 2022] POST /identity/v3/services => generated 242 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:39:45.348985 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:45.369227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a8b72-a268-4a73-9630-ddb959a9605d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:45.413952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff50b6-b68f-4886-8258-34de4d19dd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:45.414594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff50b6-b68f-4886-8258-34de4d19dd90 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:45.414897 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff50b6-b68f-4886-8258-34de4d19dd90 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:45.415171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff50b6-b68f-4886-8258-34de4d19dd90 None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:45.415807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff50b6-b68f-4886-8258-34de4d19dd90 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:45.416108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff50b6-b68f-4886-8258-34de4d19dd90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:45.417535 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff50b6-b68f-4886-8258-34de4d19dd90 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:45.429329 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 503/1019] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Sep 6 22:39:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:45.429532 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0da24-ed8d-4c4c-8cae-4c704c44dd9e None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:45.458898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:45.538295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0da24-ed8d-4c4c-8cae-4c704c44dd9e None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:45.572445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6e0cf-9d4a-497f-aed9-69f490137643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:45.573088 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6e0cf-9d4a-497f-aed9-69f490137643 None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:45.573365 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6e0cf-9d4a-497f-aed9-69f490137643 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:45.573633 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6e0cf-9d4a-497f-aed9-69f490137643 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:45.574292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6e0cf-9d4a-497f-aed9-69f490137643 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:45.575638 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6e0cf-9d4a-497f-aed9-69f490137643 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:45.660384 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 517/1020] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:39:45 2022] POST /identity/v3/endpoints => generated 334 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:39:47.159130 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c8886-b8cf-4e16-9e56-4a625e0f2e72 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:47.159643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c8886-b8cf-4e16-9e56-4a625e0f2e72 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:47.159753 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c8886-b8cf-4e16-9e56-4a625e0f2e72 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:47.161200 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 504/1021] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:47.166198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1932f9-ddd7-4811-847e-5f48aea795f2 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:47.166580 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1932f9-ddd7-4811-847e-5f48aea795f2 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:47.166755 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1932f9-ddd7-4811-847e-5f48aea795f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:47.185104 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-fc1932f9-ddd7-4811-847e-5f48aea795f2 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:47.186294 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-fc1932f9-ddd7-4811-847e-5f48aea795f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:47.261103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 518/1022] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:47.500135 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a9447-003a-4d34-8bf3-d24835bf8f03 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:47.500481 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a9447-003a-4d34-8bf3-d24835bf8f03 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:47.500714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a9447-003a-4d34-8bf3-d24835bf8f03 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:47.502185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 505/1023] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:47.507135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89317c-a324-4460-9df0-30e0114a4183 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:47.507424 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89317c-a324-4460-9df0-30e0114a4183 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:47.507699 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89317c-a324-4460-9df0-30e0114a4183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:47.521589 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:47.527484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-2b89317c-a324-4460-9df0-30e0114a4183 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:47.528416 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a9447-003a-4d34-8bf3-d24835bf8f03 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:47.528556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-2b89317c-a324-4460-9df0-30e0114a4183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:47.604070 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 519/1024] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:47.633916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a9447-003a-4d34-8bf3-d24835bf8f03 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:47.667869 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffd89c-3f59-4ff5-8489-0b4f5371f14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:47.668526 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffd89c-3f59-4ff5-8489-0b4f5371f14c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:47.668807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffd89c-3f59-4ff5-8489-0b4f5371f14c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:47.669080 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffd89c-3f59-4ff5-8489-0b4f5371f14c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:47.670187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffd89c-3f59-4ff5-8489-0b4f5371f14c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:47.671628 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffd89c-3f59-4ff5-8489-0b4f5371f14c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:47.676467 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 506/1025] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:47.678864 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89317c-a324-4460-9df0-30e0114a4183 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:47.787310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89317c-a324-4460-9df0-30e0114a4183 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:47.825638 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e304bb-c66c-4f52-812d-60d9517135b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:47.826282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e304bb-c66c-4f52-812d-60d9517135b1 None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:47.826561 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e304bb-c66c-4f52-812d-60d9517135b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:47.826835 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e304bb-c66c-4f52-812d-60d9517135b1 None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:47.827511 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e304bb-c66c-4f52-812d-60d9517135b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:47.829256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e304bb-c66c-4f52-812d-60d9517135b1 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:47.838784 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:47.865176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffd89c-3f59-4ff5-8489-0b4f5371f14c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:47.878467 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:47.934250 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 520/1026] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Sep 6 22:39:47 2022] POST /identity/v3/users => generated 285 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:39:47.935472 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366e149-413c-40c6-b5a8-15d2e78e2754 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:47.935754 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366e149-413c-40c6-b5a8-15d2e78e2754 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:47.936029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366e149-413c-40c6-b5a8-15d2e78e2754 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:47.937412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 521/1027] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:47.943019 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d93fc-55a3-4625-b6c8-c63ad2227f94 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:47.943334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d93fc-55a3-4625-b6c8-c63ad2227f94 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:47.943578 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d93fc-55a3-4625-b6c8-c63ad2227f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:47.964052 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-aa8d93fc-55a3-4625-b6c8-c63ad2227f94 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:47.965461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-aa8d93fc-55a3-4625-b6c8-c63ad2227f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:47.971929 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffd89c-3f59-4ff5-8489-0b4f5371f14c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:48.011604 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1bcb3-fb16-48c1-8ce1-9bc4bf39958a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:48.012258 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1bcb3-fb16-48c1-8ce1-9bc4bf39958a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:48.012620 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1bcb3-fb16-48c1-8ce1-9bc4bf39958a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:48.012984 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1bcb3-fb16-48c1-8ce1-9bc4bf39958a None admin] PATH_INFO: `/v3/services/image` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:48.013579 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1bcb3-fb16-48c1-8ce1-9bc4bf39958a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:48.014983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1bcb3-fb16-48c1-8ce1-9bc4bf39958a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:48.025317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ebe1bcb3-fb16-48c1-8ce1-9bc4bf39958a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 22:39:48.025317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:48.025317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:48.025317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:48.025317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:48.025317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:48.025317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:48.025317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:48.025317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 22:39:48.025317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:48.025317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:48.025317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:48.025317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:48.025317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:48.025317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:48.025317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:48.025317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:48.026446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:48.026446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:48.026446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:48.026446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:48.026446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:48.026446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:48.026446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:48.026446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:48.026446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:48.026446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:48.026446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:48.026446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:48.026446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:48.026446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:48.026446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:48.026446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:48.027315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:48.027315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:48.027315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:48.027315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:48.027315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:48.027315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:48.027315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:48.027315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:48.027315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:48.027315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:48.027315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:48.027315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:48.027315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 22:39:48.027315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:48.027315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 507/1028] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Sep 6 22:39:47 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:48.032707 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1bcb3-fb16-48c1-8ce1-9bc4bf39958a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:48.049765 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 522/1029] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 22:39:48.122938 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:48.148747 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1bcb3-fb16-48c1-8ce1-9bc4bf39958a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:48.188282 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae12fae-9708-4acb-aa81-154a6ab2b5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:48.188942 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae12fae-9708-4acb-aa81-154a6ab2b5ce None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:48.189271 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae12fae-9708-4acb-aa81-154a6ab2b5ce None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:48.189537 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae12fae-9708-4acb-aa81-154a6ab2b5ce None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:48.190177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae12fae-9708-4acb-aa81-154a6ab2b5ce None admin] RBAC: Adding query filter params (name=image) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:48.190477 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae12fae-9708-4acb-aa81-154a6ab2b5ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:48.191852 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae12fae-9708-4acb-aa81-154a6ab2b5ce None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:48.197422 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 508/1030] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:48.203837 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d93fc-55a3-4625-b6c8-c63ad2227f94 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:48.306530 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d93fc-55a3-4625-b6c8-c63ad2227f94 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:48.311943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae12fae-9708-4acb-aa81-154a6ab2b5ce None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:48.330340 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:48.342126 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03ede5-9a17-4c0e-b348-bf4976875056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:48.343915 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03ede5-9a17-4c0e-b348-bf4976875056 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:48.343915 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03ede5-9a17-4c0e-b348-bf4976875056 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:48.343915 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03ede5-9a17-4c0e-b348-bf4976875056 None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:48.343915 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03ede5-9a17-4c0e-b348-bf4976875056 None admin] RBAC: Adding query filter params (type=image) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:48.344232 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03ede5-9a17-4c0e-b348-bf4976875056 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:48.345524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03ede5-9a17-4c0e-b348-bf4976875056 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:48.350192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 523/1031] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:48.356129 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03ede5-9a17-4c0e-b348-bf4976875056 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:48.481315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae12fae-9708-4acb-aa81-154a6ab2b5ce None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:48.484879 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03ede5-9a17-4c0e-b348-bf4976875056 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:48.523622 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a9542-a5e8-4981-a0bf-339a13ce33ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:48.524894 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a9542-a5e8-4981-a0bf-339a13ce33ce None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:48.525175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a9542-a5e8-4981-a0bf-339a13ce33ce None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:48.525461 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a9542-a5e8-4981-a0bf-339a13ce33ce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:48.528797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f1d1d-f834-4ebf-968a-eb25b3b3c500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:48.529540 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1d1d-f834-4ebf-968a-eb25b3b3c500 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:48.529816 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1d1d-f834-4ebf-968a-eb25b3b3c500 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:48.530086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1d1d-f834-4ebf-968a-eb25b3b3c500 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:48.530787 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f1d1d-f834-4ebf-968a-eb25b3b3c500 None admin] RBAC: Adding query filter params (interface=public, service_id=783ec9ca9994486eae8975421e97e46e, region_id=RegionOne) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:48.531088 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f1d1d-f834-4ebf-968a-eb25b3b3c500 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:48.532464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f1d1d-f834-4ebf-968a-eb25b3b3c500 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:48.534590 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:48.543029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 524/1032] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Sep 6 22:39:48 2022] GET /identity/v3/endpoints?service_id=783ec9ca9994486eae8975421e97e46e&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:48.543183 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a9542-a5e8-4981-a0bf-339a13ce33ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:39:48.544048 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f1d1d-f834-4ebf-968a-eb25b3b3c500 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:48.545804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-673a9542-a5e8-4981-a0bf-339a13ce33ce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 22:39:48.545804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:48.545804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:48.545804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:48.545804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:48.545804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:48.545804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:48.545804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:48.545804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:48.545804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:48.545804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:48.545804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:48.545804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:39:48.545804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:39:48.545804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:39:48.545804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:39:48.555274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:39:48.555274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:39:48.555274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:39:48.555274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:39:48.555274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:48.555274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:48.555274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:48.555274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:48.555274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:48.555274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:48.555274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:48.555274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:48.555274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:48.555274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:48.555274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:48.555274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:48.556180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:48.556180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:48.556180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:48.556180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:48.556180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:39:48.556180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:39:48.556180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:39:48.556180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:39:48.556180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:39:48.556180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:39:48.556180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 22:39:48.556180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:48.556180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 509/1033] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Sep 6 22:39:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:48.556180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a9542-a5e8-4981-a0bf-339a13ce33ce None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:48.599917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:48.653179 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f1d1d-f834-4ebf-968a-eb25b3b3c500 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:48.656850 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a9542-a5e8-4981-a0bf-339a13ce33ce None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:48.687382 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e86bde-3dba-4dc3-896f-f5e341b536f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:48.688003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e86bde-3dba-4dc3-896f-f5e341b536f1 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:48.688284 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e86bde-3dba-4dc3-896f-f5e341b536f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:48.688592 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e86bde-3dba-4dc3-896f-f5e341b536f1 None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:48.689215 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e86bde-3dba-4dc3-896f-f5e341b536f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:48.690551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e86bde-3dba-4dc3-896f-f5e341b536f1 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:48.690765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01aed1-904b-4f38-a7b8-224d56e6f324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:48.691371 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01aed1-904b-4f38-a7b8-224d56e6f324 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:48.691658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01aed1-904b-4f38-a7b8-224d56e6f324 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:48.691927 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01aed1-904b-4f38-a7b8-224d56e6f324 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:48.692626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01aed1-904b-4f38-a7b8-224d56e6f324 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:48.692929 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01aed1-904b-4f38-a7b8-224d56e6f324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:48.694282 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01aed1-904b-4f38-a7b8-224d56e6f324 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:48.698267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 525/1034] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Sep 6 22:39:48 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:39:48.706326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 510/1035] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Sep 6 22:39:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:48.712152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e86bde-3dba-4dc3-896f-f5e341b536f1 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:48.828471 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e86bde-3dba-4dc3-896f-f5e341b536f1 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:48.844142 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:48.865272 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9062514-97ce-48f8-96a4-7071c28e13a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:48.865831 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9062514-97ce-48f8-96a4-7071c28e13a5 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:48.866106 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9062514-97ce-48f8-96a4-7071c28e13a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:48.866373 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9062514-97ce-48f8-96a4-7071c28e13a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:48.878510 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9062514-97ce-48f8-96a4-7071c28e13a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:48.879978 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9062514-97ce-48f8-96a4-7071c28e13a5 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:48.896959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-f9062514-97ce-48f8-96a4-7071c28e13a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:48.896959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:48.896959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:48.896959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:48.896959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:48.896959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:48.896959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:48.896959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:48.896959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:48.896959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:48.896959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:48.896959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:48.896959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:48.896959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:48.896959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:48.896959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:48.897974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:48.897974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:48.897974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:48.897974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:48.897974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:48.897974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:48.897974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:48.897974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:48.897974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:48.897974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:48.897974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:48.897974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:48.897974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:48.897974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:48.897974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:48.897974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:48.897974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:48.898898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:48.898898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:48.898898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:48.898898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 526/1036] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:48.904078 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01aed1-904b-4f38-a7b8-224d56e6f324 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:48.968795 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:49.010108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01aed1-904b-4f38-a7b8-224d56e6f324 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:49.043420 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d614bdc-7584-48a4-bb11-dd2f3b3d7a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:49.044147 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d614bdc-7584-48a4-bb11-dd2f3b3d7a55 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:49.044437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d614bdc-7584-48a4-bb11-dd2f3b3d7a55 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:49.044716 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d614bdc-7584-48a4-bb11-dd2f3b3d7a55 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:49.045347 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d614bdc-7584-48a4-bb11-dd2f3b3d7a55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:49.045646 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d614bdc-7584-48a4-bb11-dd2f3b3d7a55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:49.047001 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d614bdc-7584-48a4-bb11-dd2f3b3d7a55 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:49.064636 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 511/1037] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:49.066178 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9062514-97ce-48f8-96a4-7071c28e13a5 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:49.179769 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9062514-97ce-48f8-96a4-7071c28e13a5 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:49.213778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6a048-2081-4fff-b33e-db4b0b89d7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:49.214399 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6a048-2081-4fff-b33e-db4b0b89d7aa None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:49.214670 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6a048-2081-4fff-b33e-db4b0b89d7aa None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:49.214937 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6a048-2081-4fff-b33e-db4b0b89d7aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:49.223734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6a048-2081-4fff-b33e-db4b0b89d7aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:49.223967 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6a048-2081-4fff-b33e-db4b0b89d7aa None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:49.235669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-54a6a048-2081-4fff-b33e-db4b0b89d7aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 22:39:49.235669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:49.235669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:49.235669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:49.235669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:49.235669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:49.235669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:49.235669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:49.235669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:49.235669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:49.235669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:49.235669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:49.235669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:39:49.235669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:39:49.235669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:39:49.235669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:39:49.236687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:49.236687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:49.236687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:39:49.236687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:49.236687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:39:49.236687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:49.236687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:49.236687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:49.236687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:49.236687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:49.236687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:49.236687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:49.236687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:49.236687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:49.236687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:49.236687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:49.236687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:49.236687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:49.237650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:49.237650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:49.237650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:39:49.237650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:39:49.237650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:39:49.237650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:39:49.237650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:39:49.237650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:39:49.237650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 22:39:49.237650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:49.237650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 527/1038] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Sep 6 22:39:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:49.242522 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d614bdc-7584-48a4-bb11-dd2f3b3d7a55 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:49.345722 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d614bdc-7584-48a4-bb11-dd2f3b3d7a55 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:49.366061 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:49.380802 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca9d92-5a5e-4e4a-a34b-eb2fe490cdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:49.383424 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca9d92-5a5e-4e4a-a34b-eb2fe490cdde None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:49.383424 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca9d92-5a5e-4e4a-a34b-eb2fe490cdde None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:49.383424 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca9d92-5a5e-4e4a-a34b-eb2fe490cdde None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:49.383424 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca9d92-5a5e-4e4a-a34b-eb2fe490cdde None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:49.383424 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca9d92-5a5e-4e4a-a34b-eb2fe490cdde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:49.384502 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca9d92-5a5e-4e4a-a34b-eb2fe490cdde None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:49.406797 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 512/1039] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Sep 6 22:39:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:49.408799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6a048-2081-4fff-b33e-db4b0b89d7aa None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:49.437723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:49.514997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6a048-2081-4fff-b33e-db4b0b89d7aa None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:49.549863 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf05f9a-b67c-4f25-bbe2-1204741c40e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:49.550474 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf05f9a-b67c-4f25-bbe2-1204741c40e3 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:49.550752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf05f9a-b67c-4f25-bbe2-1204741c40e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:49.551025 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf05f9a-b67c-4f25-bbe2-1204741c40e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:49.617906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf05f9a-b67c-4f25-bbe2-1204741c40e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:49.619521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf05f9a-b67c-4f25-bbe2-1204741c40e3 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:49.647567 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:49.721894 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 528/1040] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:39:49 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 22:39:49.728195 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca9d92-5a5e-4e4a-a34b-eb2fe490cdde None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:49.840133 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca9d92-5a5e-4e4a-a34b-eb2fe490cdde None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:49.875450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3d4b1-b46c-4629-a1b5-dac1f820e8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:49.876090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3d4b1-b46c-4629-a1b5-dac1f820e8e1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:49.876372 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3d4b1-b46c-4629-a1b5-dac1f820e8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:49.876674 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3d4b1-b46c-4629-a1b5-dac1f820e8e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:49.887314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3d4b1-b46c-4629-a1b5-dac1f820e8e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:49.888799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3d4b1-b46c-4629-a1b5-dac1f820e8e1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:49.903865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-0fb3d4b1-b46c-4629-a1b5-dac1f820e8e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:49.903865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:49.903865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:49.903865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:49.903865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:49.903865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:49.903865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:49.903865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:49.903865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:49.903865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:49.903865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:49.903865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:49.903865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:49.903865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:49.903865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:49.903865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:49.904848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:49.904848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:49.904848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:49.904848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:49.904848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:49.904848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:49.904848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:49.904848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:49.904848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:49.904848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:49.904848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:49.904848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:49.904848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:49.904848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:49.904848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:49.904848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:49.904848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:49.910660 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:49.910660 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:49.910660 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:49.910660 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 513/1041] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:49.912060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf05f9a-b67c-4f25-bbe2-1204741c40e3 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:50.018445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf05f9a-b67c-4f25-bbe2-1204741c40e3 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:50.045745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:50.054939 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6f97c-5493-4573-a0ee-b8b4845b7eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:50.056128 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6f97c-5493-4573-a0ee-b8b4845b7eaa None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:50.060771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6f97c-5493-4573-a0ee-b8b4845b7eaa None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:50.060771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6f97c-5493-4573-a0ee-b8b4845b7eaa None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:50.060771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6f97c-5493-4573-a0ee-b8b4845b7eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:50.060771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6f97c-5493-4573-a0ee-b8b4845b7eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:50.060771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6f97c-5493-4573-a0ee-b8b4845b7eaa None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:50.072730 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 529/1042] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:50.078555 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3d4b1-b46c-4629-a1b5-dac1f820e8e1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:50.116098 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:50.194195 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3d4b1-b46c-4629-a1b5-dac1f820e8e1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:50.220067 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8ba5c-e6d1-426f-b24c-c98623ee81e6 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:50.220621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8ba5c-e6d1-426f-b24c-c98623ee81e6 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:50.220790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8ba5c-e6d1-426f-b24c-c98623ee81e6 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:50.222145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 530/1043] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:50.228485 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0f9a4-2e63-43f8-8ae7-35f2cf8596e0 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:50.228958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0f9a4-2e63-43f8-8ae7-35f2cf8596e0 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:50.229424 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0f9a4-2e63-43f8-8ae7-35f2cf8596e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:50.231261 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbd14f-06af-4c65-b2bc-727ad763c35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:50.231894 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbd14f-06af-4c65-b2bc-727ad763c35a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:50.232175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbd14f-06af-4c65-b2bc-727ad763c35a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:50.232472 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbd14f-06af-4c65-b2bc-727ad763c35a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:50.239153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbd14f-06af-4c65-b2bc-727ad763c35a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:50.240628 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbd14f-06af-4c65-b2bc-727ad763c35a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:50.248529 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-29a0f9a4-2e63-43f8-8ae7-35f2cf8596e0 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:50.249894 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-29a0f9a4-2e63-43f8-8ae7-35f2cf8596e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:50.251926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-cbdbd14f-06af-4c65-b2bc-727ad763c35a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:50.251926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:50.251926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:50.251926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:50.251926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:50.251926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:50.251926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:50.251926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:50.251926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:50.251926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:50.251926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:50.251926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:50.251926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:39:50.251926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:39:50.251926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:39:50.253197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:39:50.253197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:50.253197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:50.253197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:50.253197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:50.253197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:50.253197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:50.253197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:50.253197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:50.253197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:50.253197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:50.253197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:50.253197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:50.253197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:50.253197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:50.253197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:50.253197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:50.254547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:39:50.254547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:39:50.254547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:39:50.254547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:39:50.254547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:39:50.254547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:39:50.254547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:50.254547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:50.254547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 514/1044] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:50.258706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbd14f-06af-4c65-b2bc-727ad763c35a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:50.329244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 531/1045] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 22:39:50.359808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:50.369633 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbd14f-06af-4c65-b2bc-727ad763c35a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:50.405572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37e4c9-4139-4ae5-962d-ca10d7efb235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:50.406184 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37e4c9-4139-4ae5-962d-ca10d7efb235 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:50.406465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37e4c9-4139-4ae5-962d-ca10d7efb235 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:50.406739 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37e4c9-4139-4ae5-962d-ca10d7efb235 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:50.407434 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37e4c9-4139-4ae5-962d-ca10d7efb235 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:50.407741 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37e4c9-4139-4ae5-962d-ca10d7efb235 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:50.409220 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37e4c9-4139-4ae5-962d-ca10d7efb235 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:50.426124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 515/1046] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:39:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:50.427854 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0f9a4-2e63-43f8-8ae7-35f2cf8596e0 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:50.528868 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0f9a4-2e63-43f8-8ae7-35f2cf8596e0 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:50.545242 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:50.563519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674e054-b249-4238-b01d-b0aa7f23d973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:50.564138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674e054-b249-4238-b01d-b0aa7f23d973 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:50.564433 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674e054-b249-4238-b01d-b0aa7f23d973 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:50.564719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674e054-b249-4238-b01d-b0aa7f23d973 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:50.565444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674e054-b249-4238-b01d-b0aa7f23d973 None admin] RBAC: Adding query filter params (role.id=ea85f0a3b95b4866b3f1ec715073e153, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=b18fd296138349408613004929144e70) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:50.565756 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674e054-b249-4238-b01d-b0aa7f23d973 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:50.567428 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674e054-b249-4238-b01d-b0aa7f23d973 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:50.580577 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 532/1047] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:39:50 2022] GET /identity/v3/role_assignments?user.id=b18fd296138349408613004929144e70&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=ea85f0a3b95b4866b3f1ec715073e153 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:50.603227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37e4c9-4139-4ae5-962d-ca10d7efb235 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:50.713923 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37e4c9-4139-4ae5-962d-ca10d7efb235 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:50.750578 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe51b5-68c1-4571-b7b7-87caa2b73575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:50.751227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe51b5-68c1-4571-b7b7-87caa2b73575 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:50.751507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe51b5-68c1-4571-b7b7-87caa2b73575 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:50.751779 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe51b5-68c1-4571-b7b7-87caa2b73575 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:50.763690 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe51b5-68c1-4571-b7b7-87caa2b73575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:39:50.768460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-6efe51b5-68c1-4571-b7b7-87caa2b73575 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:39:50.768460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:50.768460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:50.768460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:50.768460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:50.768460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:50.768460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:50.768460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:50.768460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:50.768460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:50.768460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:50.768460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:50.768460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:39:50.768460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:39:50.768460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:39:50.768460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:39:50.769412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:39:50.769412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:39:50.769412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:39:50.769412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:39:50.769412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:50.769412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:50.769412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:50.769412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:50.769412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:50.769412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:50.769412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:50.769412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:50.769412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:50.769412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:50.769412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:50.769412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:50.770293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:50.770293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:50.770293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:50.770293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:50.770293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:39:50.770293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:39:50.770293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:39:50.770293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:39:50.770293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:39:50.770293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:39:50.770293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:39:50.770293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:50.772510 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 516/1048] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:39:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:50.776191 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674e054-b249-4238-b01d-b0aa7f23d973 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:50.880856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674e054-b249-4238-b01d-b0aa7f23d973 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:50.915314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eadd0-3ecf-46e5-a58f-d5cc665b1dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:50.915933 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eadd0-3ecf-46e5-a58f-d5cc665b1dbd None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:50.916212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eadd0-3ecf-46e5-a58f-d5cc665b1dbd None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:50.916510 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eadd0-3ecf-46e5-a58f-d5cc665b1dbd None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:50.917181 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229eadd0-3ecf-46e5-a58f-d5cc665b1dbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:50.917482 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229eadd0-3ecf-46e5-a58f-d5cc665b1dbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:50.918839 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229eadd0-3ecf-46e5-a58f-d5cc665b1dbd None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:50.927831 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 533/1049] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:39:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:50.928174 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9931b-96f4-4b46-a169-d98bbcb2922a None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:50.928498 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9931b-96f4-4b46-a169-d98bbcb2922a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:50.928778 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9931b-96f4-4b46-a169-d98bbcb2922a None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:50.930750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 517/1050] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:50.933977 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eadd0-3ecf-46e5-a58f-d5cc665b1dbd None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:50.935565 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c16db0-a437-43a0-9378-36ae67be69d0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:50.935846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c16db0-a437-43a0-9378-36ae67be69d0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:50.936117 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c16db0-a437-43a0-9378-36ae67be69d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:50.954584 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-76c16db0-a437-43a0-9378-36ae67be69d0 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:50.955773 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-76c16db0-a437-43a0-9378-36ae67be69d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:50.958685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:50.981511 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:51.027026 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 518/1051] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 22:39:51.047744 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eadd0-3ecf-46e5-a58f-d5cc665b1dbd None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:51.090321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb44db-8470-41c7-a452-ec7583d6e460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:51.090563 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb44db-8470-41c7-a452-ec7583d6e460 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:51.090772 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb44db-8470-41c7-a452-ec7583d6e460 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:51.091049 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb44db-8470-41c7-a452-ec7583d6e460 None admin] PATH_INFO: `/v3/users/a76bb92ad8424a7c82390aa1e9606777` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:51.105326 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb44db-8470-41c7-a452-ec7583d6e460 None admin] RBAC: Authorizing `identity:get_user(user_id=a76bb92ad8424a7c82390aa1e9606777)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:51.106877 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb44db-8470-41c7-a452-ec7583d6e460 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:51.108691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 534/1052] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:39:50 2022] GET /identity/v3/users/a76bb92ad8424a7c82390aa1e9606777 => generated 285 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:51.116490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c16db0-a437-43a0-9378-36ae67be69d0 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:51.213796 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c16db0-a437-43a0-9378-36ae67be69d0 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:51.247455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82273450-ddc9-4c6e-a42a-2c0e98b49b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:51.248068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82273450-ddc9-4c6e-a42a-2c0e98b49b26 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:51.248346 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82273450-ddc9-4c6e-a42a-2c0e98b49b26 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:51.248642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82273450-ddc9-4c6e-a42a-2c0e98b49b26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:51.259630 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:51.298395 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb44db-8470-41c7-a452-ec7583d6e460 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:51.322000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82273450-ddc9-4c6e-a42a-2c0e98b49b26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:51.323476 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82273450-ddc9-4c6e-a42a-2c0e98b49b26 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:51.401650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:51.405688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb44db-8470-41c7-a452-ec7583d6e460 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:51.427516 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 519/1053] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:39:51 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 22:39:51.433730 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82273450-ddc9-4c6e-a42a-2c0e98b49b26 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:51.450149 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35a80d-b99a-41ce-9354-3f46164707fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:51.450802 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35a80d-b99a-41ce-9354-3f46164707fb None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:51.451083 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35a80d-b99a-41ce-9354-3f46164707fb None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:51.451358 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35a80d-b99a-41ce-9354-3f46164707fb None admin] PATH_INFO: `/v3/services/image` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:51.451978 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35a80d-b99a-41ce-9354-3f46164707fb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:51.453636 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35a80d-b99a-41ce-9354-3f46164707fb None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:51.462668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-3c35a80d-b99a-41ce-9354-3f46164707fb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 22:39:51.462668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:51.462668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:39:51.462668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:39:51.462668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:39:51.462668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:39:51.462668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:39:51.462668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:51.462668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 22:39:51.462668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:51.462668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:39:51.462668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:51.462668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:51.462668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:51.462668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:51.462668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:51.462668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:51.463681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:51.463681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:51.463681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:51.463681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:51.463681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:51.463681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:51.463681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:39:51.463681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:39:51.463681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:39:51.463681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:39:51.463681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:51.463681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:51.463681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:51.463681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:51.463681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:51.463681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:51.464618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:51.464618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:51.464618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:51.464618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:51.464618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:51.464618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:51.464618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:51.464618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:51.464618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:51.464618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:51.464618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:39:51.464618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:39:51.464618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 22:39:51.464618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:51.464618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 535/1054] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Sep 6 22:39:51 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:51.469426 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35a80d-b99a-41ce-9354-3f46164707fb None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:51.484491 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:51.545141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82273450-ddc9-4c6e-a42a-2c0e98b49b26 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:51.572323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35a80d-b99a-41ce-9354-3f46164707fb None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:51.582901 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376d2be-082e-4aa7-8655-506c21bc42d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:51.583523 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376d2be-082e-4aa7-8655-506c21bc42d1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:51.583798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376d2be-082e-4aa7-8655-506c21bc42d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:51.584063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376d2be-082e-4aa7-8655-506c21bc42d1 None admin] PATH_INFO: `/v3/projects/fb37b725ef3248f7a6968f7888c9e00f` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:51.585286 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376d2be-082e-4aa7-8655-506c21bc42d1 None admin] RBAC: Authorizing `identity:get_project(project_id=fb37b725ef3248f7a6968f7888c9e00f)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:51.586864 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376d2be-082e-4aa7-8655-506c21bc42d1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:51.593627 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 520/1055] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:39:51 2022] GET /identity/v3/projects/fb37b725ef3248f7a6968f7888c9e00f => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:51.594591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376d2be-082e-4aa7-8655-506c21bc42d1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:51.611464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723b439-df81-4e04-9cc7-7389031b798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:51.612082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723b439-df81-4e04-9cc7-7389031b798d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:51.612363 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723b439-df81-4e04-9cc7-7389031b798d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:51.612662 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723b439-df81-4e04-9cc7-7389031b798d None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:51.613295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723b439-df81-4e04-9cc7-7389031b798d None admin] RBAC: Adding query filter params (name=image) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:51.613567 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723b439-df81-4e04-9cc7-7389031b798d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:51.614916 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723b439-df81-4e04-9cc7-7389031b798d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:51.620747 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 536/1056] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:51.625893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723b439-df81-4e04-9cc7-7389031b798d None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:51.655984 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:51.705663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376d2be-082e-4aa7-8655-506c21bc42d1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:51.715654 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:51.729686 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723b439-df81-4e04-9cc7-7389031b798d None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:51.741023 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffc2de-ae7a-468e-8b05-f9c81d92d0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:51.741623 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffc2de-ae7a-468e-8b05-f9c81d92d0ea None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:51.741898 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffc2de-ae7a-468e-8b05-f9c81d92d0ea None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:51.742167 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffc2de-ae7a-468e-8b05-f9c81d92d0ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:51.742916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffc2de-ae7a-468e-8b05-f9c81d92d0ea None admin] RBAC: Adding query filter params (role.id=aa2332d1bdb74e48a88ed7c2a7ed2990, scope.project.id=fb37b725ef3248f7a6968f7888c9e00f, user.id=a76bb92ad8424a7c82390aa1e9606777) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:51.743267 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffc2de-ae7a-468e-8b05-f9c81d92d0ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:51.744708 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffc2de-ae7a-468e-8b05-f9c81d92d0ea None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:51.750292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 521/1057] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:39:51 2022] GET /identity/v3/role_assignments?user.id=a76bb92ad8424a7c82390aa1e9606777&scope.project.id=fb37b725ef3248f7a6968f7888c9e00f&role.id=aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:51.768281 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a08bc4-1d71-4f90-a6ae-dfc29c7042cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:51.768962 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a08bc4-1d71-4f90-a6ae-dfc29c7042cf None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:51.769241 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a08bc4-1d71-4f90-a6ae-dfc29c7042cf None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:51.769511 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a08bc4-1d71-4f90-a6ae-dfc29c7042cf None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:51.770155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a08bc4-1d71-4f90-a6ae-dfc29c7042cf None admin] RBAC: Adding query filter params (type=image) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:51.770456 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a08bc4-1d71-4f90-a6ae-dfc29c7042cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:51.771850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a08bc4-1d71-4f90-a6ae-dfc29c7042cf None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:51.778301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 537/1058] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:51.783800 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffc2de-ae7a-468e-8b05-f9c81d92d0ea None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:51.891068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffc2de-ae7a-468e-8b05-f9c81d92d0ea None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:51.932178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e58194-3a88-44ae-bd82-9e481c85692f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:51.932826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e58194-3a88-44ae-bd82-9e481c85692f None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:51.933108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e58194-3a88-44ae-bd82-9e481c85692f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:51.933379 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e58194-3a88-44ae-bd82-9e481c85692f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:51.934067 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e58194-3a88-44ae-bd82-9e481c85692f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:51.935447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e58194-3a88-44ae-bd82-9e481c85692f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:52.043085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 522/1059] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:39:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:39:52.728229 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2e404-eed0-49d5-94f0-377afe801787 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:52.728773 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2e404-eed0-49d5-94f0-377afe801787 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:52.728887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2e404-eed0-49d5-94f0-377afe801787 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:52.730321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 538/1060] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:52.735238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cdeef-45f7-4f62-831f-ba09cd1053e5 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:52.735612 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cdeef-45f7-4f62-831f-ba09cd1053e5 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:52.735792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cdeef-45f7-4f62-831f-ba09cd1053e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:52.754366 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-762cdeef-45f7-4f62-831f-ba09cd1053e5 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:52.755552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-762cdeef-45f7-4f62-831f-ba09cd1053e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:52.778976 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:52.835439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 523/1061] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:53.101120 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2e404-eed0-49d5-94f0-377afe801787 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:53.193659 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:53.204107 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2e404-eed0-49d5-94f0-377afe801787 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:53.238829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135f6bb-d21a-4e49-9ec8-1ca7f3186edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:53.239465 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135f6bb-d21a-4e49-9ec8-1ca7f3186edb None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:53.239747 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135f6bb-d21a-4e49-9ec8-1ca7f3186edb None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:53.240024 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135f6bb-d21a-4e49-9ec8-1ca7f3186edb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:53.250245 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135f6bb-d21a-4e49-9ec8-1ca7f3186edb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:39:53.255072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-0135f6bb-d21a-4e49-9ec8-1ca7f3186edb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 22:39:53.255072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:53.255072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:53.255072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:53.255072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:53.255072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:53.255072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:53.255072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:53.255072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:53.255072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:53.255072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:53.255072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:53.255072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:39:53.255072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:39:53.255072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:39:53.255072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:39:53.256039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:39:53.256039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:39:53.256039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:39:53.256039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:39:53.256039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:53.256039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:53.256039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:53.256039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:53.256039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:53.256039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:53.256039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:53.256039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:53.256039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:53.256039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:53.256039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:53.256039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:53.256973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:53.256973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:53.256973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:53.256973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:53.256973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:39:53.256973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:39:53.256973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:39:53.256973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:39:53.256973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:39:53.256973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:39:53.256973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 22:39:53.256973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:53.256973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 539/1062] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Sep 6 22:39:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:53.262221 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cdeef-45f7-4f62-831f-ba09cd1053e5 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:53.363495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cdeef-45f7-4f62-831f-ba09cd1053e5 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:53.397167 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ed408-1d6d-4775-bc48-3064f95bc6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:53.397704 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ed408-1d6d-4775-bc48-3064f95bc6c9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:53.398026 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ed408-1d6d-4775-bc48-3064f95bc6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:53.398310 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ed408-1d6d-4775-bc48-3064f95bc6c9 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:53.399517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ed408-1d6d-4775-bc48-3064f95bc6c9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:53.399825 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ed408-1d6d-4775-bc48-3064f95bc6c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:53.401229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ed408-1d6d-4775-bc48-3064f95bc6c9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:53.409450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 524/1063] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Sep 6 22:39:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:53.415558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135f6bb-d21a-4e49-9ec8-1ca7f3186edb None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:53.517334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135f6bb-d21a-4e49-9ec8-1ca7f3186edb None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:53.551933 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e72deb-67dc-41ec-9127-4cc1282fa849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:53.552927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e72deb-67dc-41ec-9127-4cc1282fa849 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:53.553368 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e72deb-67dc-41ec-9127-4cc1282fa849 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:53.553801 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e72deb-67dc-41ec-9127-4cc1282fa849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:53.564609 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e72deb-67dc-41ec-9127-4cc1282fa849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:53.566224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e72deb-67dc-41ec-9127-4cc1282fa849 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:53.581339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-08e72deb-67dc-41ec-9127-4cc1282fa849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:53.581339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:53.581339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:53.581339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:53.581339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:53.581339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:53.581339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:53.581339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:53.581339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:53.581339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:53.581339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:53.581339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:53.581339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:53.581339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:53.581339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:53.581339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:53.582575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:53.582575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:53.582575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:53.582575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:53.582575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:53.582575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:53.582575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:53.582575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:53.582575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:53.582575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:53.582575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:53.582575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:53.582575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:53.582575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:53.582575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:53.582575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:53.582575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:53.583701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:53.583701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:53.583701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:53.590237 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 540/1064] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:53.591435 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ed408-1d6d-4775-bc48-3064f95bc6c9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:53.610819 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:53.693777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ed408-1d6d-4775-bc48-3064f95bc6c9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:53.728879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aeea61-01b9-4f31-b36a-2381e8f24599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:53.729776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeea61-01b9-4f31-b36a-2381e8f24599 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:53.730268 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeea61-01b9-4f31-b36a-2381e8f24599 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:53.730726 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeea61-01b9-4f31-b36a-2381e8f24599 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:53.731548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aeea61-01b9-4f31-b36a-2381e8f24599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:53.732034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aeea61-01b9-4f31-b36a-2381e8f24599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:53.733677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aeea61-01b9-4f31-b36a-2381e8f24599 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:53.750563 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 525/1065] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:53.751536 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e72deb-67dc-41ec-9127-4cc1282fa849 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:53.755515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:53.867157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e72deb-67dc-41ec-9127-4cc1282fa849 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:53.902775 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87db3e-1e89-419f-8bae-8a0f334c4669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:53.903769 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87db3e-1e89-419f-8bae-8a0f334c4669 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:53.904295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87db3e-1e89-419f-8bae-8a0f334c4669 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:53.904775 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87db3e-1e89-419f-8bae-8a0f334c4669 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:53.906856 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc8b85-0181-4493-8429-c107615ccc5a None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:53.907146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc8b85-0181-4493-8429-c107615ccc5a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:53.907419 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc8b85-0181-4493-8429-c107615ccc5a None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:53.908796 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 526/1066] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:39:53.913848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7b8f5-5b20-492a-bb38-032f6f4b6447 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:53.914127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7b8f5-5b20-492a-bb38-032f6f4b6447 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:53.914399 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7b8f5-5b20-492a-bb38-032f6f4b6447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:53.918051 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87db3e-1e89-419f-8bae-8a0f334c4669 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:53.919736 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87db3e-1e89-419f-8bae-8a0f334c4669 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:53.933359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-2d87db3e-1e89-419f-8bae-8a0f334c4669 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 22:39:53.933359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:53.933359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:53.933359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:53.933359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:53.933359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:53.933359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:53.933359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:53.933359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:53.933359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:53.933359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:53.933359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:53.933359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:39:53.933359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:39:53.933359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:39:53.933359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:39:53.934521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:53.934521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:53.934521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:39:53.934521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:53.934521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:39:53.934521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:53.934521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:53.934521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:53.934521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:53.934521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:53.934521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:53.934521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:53.934521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:53.934521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:53.934521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:53.934521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:53.934521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:53.934521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:53.935707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:53.935707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:53.935707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:39:53.935707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:39:53.935707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:39:53.935707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:39:53.935707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:39:53.935707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:39:53.935707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 22:39:53.935707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:53.936368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-90c7b8f5-5b20-492a-bb38-032f6f4b6447 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:53.936368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-90c7b8f5-5b20-492a-bb38-032f6f4b6447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:53.937739 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 541/1067] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Sep 6 22:39:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:53.943298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87db3e-1e89-419f-8bae-8a0f334c4669 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:54.012465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 527/1068] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:39:54.019161 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:54.058345 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87db3e-1e89-419f-8bae-8a0f334c4669 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:54.097982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182816d4-cc3e-46a4-a827-780bd261b48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:54.098670 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182816d4-cc3e-46a4-a827-780bd261b48e None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:54.098959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182816d4-cc3e-46a4-a827-780bd261b48e None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:54.099228 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182816d4-cc3e-46a4-a827-780bd261b48e None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:54.100044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182816d4-cc3e-46a4-a827-780bd261b48e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:54.100429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182816d4-cc3e-46a4-a827-780bd261b48e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:54.101996 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182816d4-cc3e-46a4-a827-780bd261b48e None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:54.127476 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 542/1069] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Sep 6 22:39:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:54.128815 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7b8f5-5b20-492a-bb38-032f6f4b6447 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:54.138476 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:54.227348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7a5cc-141e-4a1f-8cc1-55a3ecf5ad5e None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:54.227641 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7a5cc-141e-4a1f-8cc1-55a3ecf5ad5e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:54.227921 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7a5cc-141e-4a1f-8cc1-55a3ecf5ad5e None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:54.229302 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 543/1070] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:39:54.234079 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167f91b-c3d7-48a6-9bf9-14475f0f8b13 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:54.234359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167f91b-c3d7-48a6-9bf9-14475f0f8b13 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:54.234632 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167f91b-c3d7-48a6-9bf9-14475f0f8b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:54.238598 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7b8f5-5b20-492a-bb38-032f6f4b6447 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:54.252826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-1167f91b-c3d7-48a6-9bf9-14475f0f8b13 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:54.254015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1167f91b-c3d7-48a6-9bf9-14475f0f8b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:54.275860 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0111e-a9b0-4ec5-a472-cb3e2df72a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:54.276744 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0111e-a9b0-4ec5-a472-cb3e2df72a4d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:54.277178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0111e-a9b0-4ec5-a472-cb3e2df72a4d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:54.277601 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0111e-a9b0-4ec5-a472-cb3e2df72a4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:54.288034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0111e-a9b0-4ec5-a472-cb3e2df72a4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:54.290073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0111e-a9b0-4ec5-a472-cb3e2df72a4d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:54.304412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-10e0111e-a9b0-4ec5-a472-cb3e2df72a4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:54.304412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:54.304412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:54.304412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:54.304412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:54.304412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:54.304412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:54.304412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:54.304412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:54.304412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:54.304412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:54.304412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:54.304412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:54.304412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:54.304412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:54.304412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:54.310808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:54.310808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:54.310808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:54.310808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:54.310808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:54.310808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:54.310808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:54.310808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:54.310808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:54.310808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:54.310808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:54.310808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:54.310808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:54.310808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:54.310808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:54.310808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:54.310808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:54.311949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:54.311949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:54.311949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:54.311949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 528/1071] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:54.311949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0111e-a9b0-4ec5-a472-cb3e2df72a4d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:54.323349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 544/1072] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 22:39:54.324344 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167f91b-c3d7-48a6-9bf9-14475f0f8b13 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:54.373183 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:54.379078 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:54.417527 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0111e-a9b0-4ec5-a472-cb3e2df72a4d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:54.426015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167f91b-c3d7-48a6-9bf9-14475f0f8b13 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:54.455184 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b3279-30b1-4f8b-9467-51fda0d896f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:54.456171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b3279-30b1-4f8b-9467-51fda0d896f5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:54.456549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b3279-30b1-4f8b-9467-51fda0d896f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:54.456831 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b3279-30b1-4f8b-9467-51fda0d896f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:54.463102 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62243988-eecf-4277-b5d8-ef91c7d6c675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:54.463710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62243988-eecf-4277-b5d8-ef91c7d6c675 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:54.464053 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62243988-eecf-4277-b5d8-ef91c7d6c675 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:54.464335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62243988-eecf-4277-b5d8-ef91c7d6c675 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:54.465025 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62243988-eecf-4277-b5d8-ef91c7d6c675 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:54.465335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62243988-eecf-4277-b5d8-ef91c7d6c675 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:54.466697 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62243988-eecf-4277-b5d8-ef91c7d6c675 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:54.467831 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b3279-30b1-4f8b-9467-51fda0d896f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:39:54.473065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-c12b3279-30b1-4f8b-9467-51fda0d896f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:39:54.473065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:54.473065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:54.473065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:54.473065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:54.473065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:54.473065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:54.473065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:54.473065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:54.473065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:54.473065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:54.473065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:54.473065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:39:54.473065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:39:54.473065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:39:54.473065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:39:54.474052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:39:54.474052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:39:54.474052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:39:54.474052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:39:54.474052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:54.474052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:54.474052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:54.474052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:54.474052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:54.474052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:54.474052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:54.474052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:54.474052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:54.474052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:54.474052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:54.474052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:54.474932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:54.474932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:54.474932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:54.474932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:54.474932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:39:54.474932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:39:54.474932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:39:54.474932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:39:54.474932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:39:54.474932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:39:54.474932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:39:54.474932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:54.474932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 529/1073] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:39:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:54.480561 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b3279-30b1-4f8b-9467-51fda0d896f5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:54.486154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 545/1074] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:54.486983 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62243988-eecf-4277-b5d8-ef91c7d6c675 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:54.591181 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b3279-30b1-4f8b-9467-51fda0d896f5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:54.591648 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62243988-eecf-4277-b5d8-ef91c7d6c675 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:54.604805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:54.608689 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:54.625297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af5a48-a083-4bee-928a-59d1dc2dca70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:54.625532 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59663290-fd3b-4e00-ad55-245a0ca69219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:54.625906 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af5a48-a083-4bee-928a-59d1dc2dca70 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:54.626165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59663290-fd3b-4e00-ad55-245a0ca69219 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:54.626263 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af5a48-a083-4bee-928a-59d1dc2dca70 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:54.626447 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59663290-fd3b-4e00-ad55-245a0ca69219 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:54.626539 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af5a48-a083-4bee-928a-59d1dc2dca70 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:54.626721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59663290-fd3b-4e00-ad55-245a0ca69219 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:54.627103 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af5a48-a083-4bee-928a-59d1dc2dca70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:54.627404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af5a48-a083-4bee-928a-59d1dc2dca70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:54.628791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af5a48-a083-4bee-928a-59d1dc2dca70 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:54.633369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59663290-fd3b-4e00-ad55-245a0ca69219 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:54.634825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59663290-fd3b-4e00-ad55-245a0ca69219 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:54.637210 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 530/1075] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:39:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:54.637984 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af5a48-a083-4bee-928a-59d1dc2dca70 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:54.652551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-59663290-fd3b-4e00-ad55-245a0ca69219 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:54.652551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:54.652551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:54.652551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:54.652551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:54.652551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:54.652551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:54.652551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:54.652551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:54.652551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:54.652551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:54.652551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:54.652551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:39:54.652551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:39:54.652551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:39:54.653515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:39:54.653515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:54.653515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:54.653515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:54.653515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:54.653515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:54.653515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:54.653515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:54.653515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:54.653515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:54.653515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:54.653515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:54.653515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:54.653515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:54.653515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:54.653515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:54.653515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:54.655004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:39:54.655004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:39:54.655004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:39:54.655004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:39:54.655004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:39:54.655004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:39:54.655004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:54.655004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:54.655004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 546/1076] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:54.655004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59663290-fd3b-4e00-ad55-245a0ca69219 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:54.743886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af5a48-a083-4bee-928a-59d1dc2dca70 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:54.753575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59663290-fd3b-4e00-ad55-245a0ca69219 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:54.778069 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ec70f-5f87-456f-ad14-a28d53d56923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:54.778667 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ec70f-5f87-456f-ad14-a28d53d56923 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:54.778941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ec70f-5f87-456f-ad14-a28d53d56923 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:54.779210 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ec70f-5f87-456f-ad14-a28d53d56923 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:54.787692 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8e8e1-a326-48e0-8650-a334503b5dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:54.788324 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e8e1-a326-48e0-8650-a334503b5dbc None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:54.788635 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e8e1-a326-48e0-8650-a334503b5dbc None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:54.788913 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e8e1-a326-48e0-8650-a334503b5dbc None admin] PATH_INFO: `/v3/users/a76bb92ad8424a7c82390aa1e9606777` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:54.790611 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8e8e1-a326-48e0-8650-a334503b5dbc None admin] RBAC: Authorizing `identity:get_user(user_id=a76bb92ad8424a7c82390aa1e9606777)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:54.792046 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8e8e1-a326-48e0-8650-a334503b5dbc None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:54.798233 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 547/1077] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:39:54 2022] GET /identity/v3/users/a76bb92ad8424a7c82390aa1e9606777 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:54.798233 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8e8e1-a326-48e0-8650-a334503b5dbc None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:54.826219 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:54.839725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:54.846106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ec70f-5f87-456f-ad14-a28d53d56923 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:54.847489 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ec70f-5f87-456f-ad14-a28d53d56923 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:54.897348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8e8e1-a326-48e0-8650-a334503b5dbc None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:54.931142 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9844e68-34de-498d-9e21-c8d90d651f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:54.931748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9844e68-34de-498d-9e21-c8d90d651f64 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:54.932031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9844e68-34de-498d-9e21-c8d90d651f64 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:54.932303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9844e68-34de-498d-9e21-c8d90d651f64 None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:54.933017 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9844e68-34de-498d-9e21-c8d90d651f64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:54.933331 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9844e68-34de-498d-9e21-c8d90d651f64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:54.934741 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9844e68-34de-498d-9e21-c8d90d651f64 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:54.943333 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 531/1078] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:39:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 22:39:54.944157 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ec70f-5f87-456f-ad14-a28d53d56923 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:54.949523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 548/1079] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:54.949523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9844e68-34de-498d-9e21-c8d90d651f64 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:55.026917 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:55.045281 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ec70f-5f87-456f-ad14-a28d53d56923 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:55.045625 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:55.048667 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9844e68-34de-498d-9e21-c8d90d651f64 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:55.081246 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26640609-df36-40e0-9784-aef7cbb58665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:55.081876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26640609-df36-40e0-9784-aef7cbb58665 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:55.082154 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26640609-df36-40e0-9784-aef7cbb58665 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:55.082248 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28427e-24f6-406f-87aa-cc13f00a615c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:55.082424 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26640609-df36-40e0-9784-aef7cbb58665 None admin] PATH_INFO: `/v3/projects/fb37b725ef3248f7a6968f7888c9e00f` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:55.082893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28427e-24f6-406f-87aa-cc13f00a615c None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:55.083170 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28427e-24f6-406f-87aa-cc13f00a615c None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:55.084514 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28427e-24f6-406f-87aa-cc13f00a615c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:55.084639 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26640609-df36-40e0-9784-aef7cbb58665 None admin] RBAC: Authorizing `identity:get_project(project_id=fb37b725ef3248f7a6968f7888c9e00f)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:55.086699 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26640609-df36-40e0-9784-aef7cbb58665 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:55.087220 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 532/1080] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:39:54 2022] GET /identity/v3/projects/fb37b725ef3248f7a6968f7888c9e00f => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:55.087953 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26640609-df36-40e0-9784-aef7cbb58665 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:55.100519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28427e-24f6-406f-87aa-cc13f00a615c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:55.101930 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28427e-24f6-406f-87aa-cc13f00a615c None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:55.116352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-3b28427e-24f6-406f-87aa-cc13f00a615c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:55.116352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:55.116352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:55.116352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:55.116352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:55.116352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:55.116352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:55.116352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:55.116352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:55.116352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:55.116352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:55.116352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:55.116352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:55.116352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:55.116352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:55.116352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:55.117524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:55.117524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:55.117524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:55.117524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:55.117524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:55.117524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:55.117524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:55.117524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:55.117524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:55.117524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:55.117524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:55.117524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:55.117524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:55.117524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:55.117524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:55.117524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:55.117524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:55.118631 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:55.118631 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:55.118631 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:55.118631 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 549/1081] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:55.118631 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28427e-24f6-406f-87aa-cc13f00a615c None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:55.188430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26640609-df36-40e0-9784-aef7cbb58665 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:55.218279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28427e-24f6-406f-87aa-cc13f00a615c None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:55.223558 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47364168-627b-4ad9-bb39-34f2279c226c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:55.224209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47364168-627b-4ad9-bb39-34f2279c226c None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:55.224514 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47364168-627b-4ad9-bb39-34f2279c226c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:55.224787 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47364168-627b-4ad9-bb39-34f2279c226c None admin] PATH_INFO: `/v3/projects/f5e78b142d654280b161a34cec0186cd/users/b18fd296138349408613004929144e70/roles/ea85f0a3b95b4866b3f1ec715073e153` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:55.226936 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47364168-627b-4ad9-bb39-34f2279c226c None admin] RBAC: Authorizing `identity:create_grant(project_id=f5e78b142d654280b161a34cec0186cd, user_id=b18fd296138349408613004929144e70, role_id=ea85f0a3b95b4866b3f1ec715073e153)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:55.228370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47364168-627b-4ad9-bb39-34f2279c226c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:55.250755 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43552f59-6bc0-4df5-89fe-155f75addbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:55.251408 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43552f59-6bc0-4df5-89fe-155f75addbd9 None admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:55.251684 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43552f59-6bc0-4df5-89fe-155f75addbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:55.251955 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43552f59-6bc0-4df5-89fe-155f75addbd9 None admin] PATH_INFO: `/v3/projects/fb37b725ef3248f7a6968f7888c9e00f/users/a76bb92ad8424a7c82390aa1e9606777/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:55.253980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43552f59-6bc0-4df5-89fe-155f75addbd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb37b725ef3248f7a6968f7888c9e00f, user_id=a76bb92ad8424a7c82390aa1e9606777, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:55.255391 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43552f59-6bc0-4df5-89fe-155f75addbd9 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:55.298739 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 533/1082] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:39:55 2022] PUT /identity/v3/projects/f5e78b142d654280b161a34cec0186cd/users/b18fd296138349408613004929144e70/roles/ea85f0a3b95b4866b3f1ec715073e153 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:39:55.299540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47364168-627b-4ad9-bb39-34f2279c226c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:55.311150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:55.324469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 550/1083] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:39:55 2022] PUT /identity/v3/projects/fb37b725ef3248f7a6968f7888c9e00f/users/a76bb92ad8424a7c82390aa1e9606777/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:39:55.421374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47364168-627b-4ad9-bb39-34f2279c226c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:55.462531 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73c885-a8c3-4772-bf9a-4373e66bcdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:55.463469 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c885-a8c3-4772-bf9a-4373e66bcdec None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:55.463895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c885-a8c3-4772-bf9a-4373e66bcdec None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:55.464313 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c885-a8c3-4772-bf9a-4373e66bcdec None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:55.465202 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73c885-a8c3-4772-bf9a-4373e66bcdec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:55.465678 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73c885-a8c3-4772-bf9a-4373e66bcdec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:55.467389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73c885-a8c3-4772-bf9a-4373e66bcdec None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:55.480878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 534/1084] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:57.481728 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65787e-b4bb-4a10-81ec-e22b7aa77c00 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:57.482330 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400060a6-0475-4c6e-92dd-3bce8b796b01 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:57.482330 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400060a6-0475-4c6e-92dd-3bce8b796b01 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:57.482750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65787e-b4bb-4a10-81ec-e22b7aa77c00 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:57.482835 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400060a6-0475-4c6e-92dd-3bce8b796b01 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:57.482940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65787e-b4bb-4a10-81ec-e22b7aa77c00 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:57.483539 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 551/1086] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:57.483789 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 535/1086] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:39:57.488526 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4caf5b-68b8-48ef-aec4-cb9aff2a8908 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:57.488656 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bcc1f-66d2-4ee6-8791-715545ae48a2 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:57.488810 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4caf5b-68b8-48ef-aec4-cb9aff2a8908 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:57.488918 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bcc1f-66d2-4ee6-8791-715545ae48a2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:57.489090 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4caf5b-68b8-48ef-aec4-cb9aff2a8908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:57.489191 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bcc1f-66d2-4ee6-8791-715545ae48a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:57.507699 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-bc4caf5b-68b8-48ef-aec4-cb9aff2a8908 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:57.507896 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-056bcc1f-66d2-4ee6-8791-715545ae48a2 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:39:57.508909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-bc4caf5b-68b8-48ef-aec4-cb9aff2a8908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:57.509008 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-056bcc1f-66d2-4ee6-8791-715545ae48a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:39:57.516319 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:57.571276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:57.575558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 552/1087] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 22:39:57.576598 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 536/1088] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:39:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 22:39:57.841643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4caf5b-68b8-48ef-aec4-cb9aff2a8908 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:57.846573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bcc1f-66d2-4ee6-8791-715545ae48a2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:57.938145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4caf5b-68b8-48ef-aec4-cb9aff2a8908 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:57.945431 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bcc1f-66d2-4ee6-8791-715545ae48a2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:57.971554 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576f177-9354-4f73-a7c0-399b68c74c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:57.972195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576f177-9354-4f73-a7c0-399b68c74c7d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:57.972484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576f177-9354-4f73-a7c0-399b68c74c7d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:57.972792 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576f177-9354-4f73-a7c0-399b68c74c7d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:57.979501 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b399a8-aadc-4656-8a74-bcaf84b2d1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:57.980127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b399a8-aadc-4656-8a74-bcaf84b2d1a8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:57.980397 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b399a8-aadc-4656-8a74-bcaf84b2d1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:57.980706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b399a8-aadc-4656-8a74-bcaf84b2d1a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:57.983747 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576f177-9354-4f73-a7c0-399b68c74c7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:39:57.988691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-6576f177-9354-4f73-a7c0-399b68c74c7d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 22:39:57.988691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:57.988691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:57.988691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:57.988691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:57.988691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:57.988691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:57.988691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:57.988691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:57.988691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:57.988691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:57.988691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:57.988691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:39:57.988691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:39:57.988691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:39:57.988691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:39:57.990341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:39:57.990341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:39:57.990341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:39:57.990341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:39:57.990341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:57.990341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:57.990341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:57.990341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:57.990341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:57.990341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:57.990341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:57.990341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:57.990341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:57.990341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:57.990341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:57.990341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:57.991262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:57.991262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:57.991262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:57.991262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:57.991262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:39:57.991262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:39:57.991262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:39:57.991262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:39:57.991262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:39:57.991262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:39:57.991262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 22:39:57.991262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:57.991262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 553/1089] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Sep 6 22:39:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:57.992877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b399a8-aadc-4656-8a74-bcaf84b2d1a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:39:57.995782 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576f177-9354-4f73-a7c0-399b68c74c7d None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:57.998096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-60b399a8-aadc-4656-8a74-bcaf84b2d1a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:39:57.998096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:57.998096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:57.998096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:57.998096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:57.998096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:57.998096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:57.998096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:57.998096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:57.998096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:57.998096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:57.998096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:57.998096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:39:57.998096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:39:57.998096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:39:57.998096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:39:58.000624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:39:58.000624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:39:58.000624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:39:58.000624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:39:58.000624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:58.000624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:58.000624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:58.000624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:58.000624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:58.000624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:58.000624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:58.000624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:58.000624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:58.000624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:58.000624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:58.000624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:58.001684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:58.001684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:58.001684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:58.001684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:58.001684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:39:58.001684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:39:58.001684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:39:58.001684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:39:58.001684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:39:58.001684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:39:58.001684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:39:58.001684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:58.001684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 537/1090] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:39:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:58.004882 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:58.005000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b399a8-aadc-4656-8a74-bcaf84b2d1a8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:58.063763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:58.098517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576f177-9354-4f73-a7c0-399b68c74c7d None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:58.108456 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b399a8-aadc-4656-8a74-bcaf84b2d1a8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:58.133957 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f101f-6152-454c-bd9f-f824af212429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:58.134569 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f101f-6152-454c-bd9f-f824af212429 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:58.134850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f101f-6152-454c-bd9f-f824af212429 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:58.135128 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f101f-6152-454c-bd9f-f824af212429 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:58.135788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f101f-6152-454c-bd9f-f824af212429 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:58.136096 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f101f-6152-454c-bd9f-f824af212429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:58.137483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f101f-6152-454c-bd9f-f824af212429 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:58.141668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab7be0-7981-43c3-a657-f3e98038009e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:58.142268 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab7be0-7981-43c3-a657-f3e98038009e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:58.142544 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab7be0-7981-43c3-a657-f3e98038009e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:58.142813 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab7be0-7981-43c3-a657-f3e98038009e None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:58.143466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab7be0-7981-43c3-a657-f3e98038009e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:58.143763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab7be0-7981-43c3-a657-f3e98038009e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:58.145149 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab7be0-7981-43c3-a657-f3e98038009e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:58.150633 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 554/1091] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Sep 6 22:39:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:58.151666 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f101f-6152-454c-bd9f-f824af212429 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:58.154150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 538/1092] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:39:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:58.159842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab7be0-7981-43c3-a657-f3e98038009e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:58.213259 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:58.250168 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f101f-6152-454c-bd9f-f824af212429 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:58.256821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab7be0-7981-43c3-a657-f3e98038009e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:58.276904 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:58.283820 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e103d2-f567-4b28-a7ad-84a273dfbb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:58.287866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e103d2-f567-4b28-a7ad-84a273dfbb8b None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:58.287866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e103d2-f567-4b28-a7ad-84a273dfbb8b None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:58.287866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e103d2-f567-4b28-a7ad-84a273dfbb8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:58.290208 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d91679-023c-479d-8fe4-0a584254113a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:58.290825 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d91679-023c-479d-8fe4-0a584254113a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:58.291101 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d91679-023c-479d-8fe4-0a584254113a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:58.291378 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d91679-023c-479d-8fe4-0a584254113a None admin] PATH_INFO: `/v3/users/a76bb92ad8424a7c82390aa1e9606777` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:58.292544 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d91679-023c-479d-8fe4-0a584254113a None admin] RBAC: Authorizing `identity:get_user(user_id=a76bb92ad8424a7c82390aa1e9606777)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:58.293976 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d91679-023c-479d-8fe4-0a584254113a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:58.295536 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 539/1093] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:39:58 2022] GET /identity/v3/users/a76bb92ad8424a7c82390aa1e9606777 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:58.295661 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e103d2-f567-4b28-a7ad-84a273dfbb8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:58.297112 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e103d2-f567-4b28-a7ad-84a273dfbb8b None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:58.301250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d91679-023c-479d-8fe4-0a584254113a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:58.312995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-d3e103d2-f567-4b28-a7ad-84a273dfbb8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:58.312995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:58.312995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:58.312995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:58.312995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:58.312995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:58.312995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:58.312995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:58.312995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:58.312995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:58.312995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:58.312995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:58.312995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:58.312995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:58.312995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:58.312995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:58.314132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:58.314132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:58.314132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:58.314132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:58.314132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:58.314132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:58.314132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:58.314132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:58.314132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:58.314132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:58.314132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:58.314132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:58.314132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:58.314132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:58.314132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:58.314132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:58.314132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:58.315230 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:58.315230 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:58.315230 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:58.316911 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 555/1094] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:58.323176 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e103d2-f567-4b28-a7ad-84a273dfbb8b None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:58.402077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d91679-023c-479d-8fe4-0a584254113a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:58.420577 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e103d2-f567-4b28-a7ad-84a273dfbb8b None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:58.434897 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19779b93-6316-4cbb-a6ec-01d6c8f12634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:58.435495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19779b93-6316-4cbb-a6ec-01d6c8f12634 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:58.435771 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19779b93-6316-4cbb-a6ec-01d6c8f12634 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:58.436041 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19779b93-6316-4cbb-a6ec-01d6c8f12634 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:58.436565 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:58.454422 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af09f7-6d24-4e45-b652-fccfe5304931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:58.455028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af09f7-6d24-4e45-b652-fccfe5304931 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:58.455306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af09f7-6d24-4e45-b652-fccfe5304931 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:58.455579 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af09f7-6d24-4e45-b652-fccfe5304931 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:58.456214 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af09f7-6d24-4e45-b652-fccfe5304931 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:58.456607 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af09f7-6d24-4e45-b652-fccfe5304931 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:58.458029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af09f7-6d24-4e45-b652-fccfe5304931 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:58.470071 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 556/1095] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:58.475596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af09f7-6d24-4e45-b652-fccfe5304931 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:58.490149 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:58.502712 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19779b93-6316-4cbb-a6ec-01d6c8f12634 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:58.504167 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19779b93-6316-4cbb-a6ec-01d6c8f12634 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:58.579495 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af09f7-6d24-4e45-b652-fccfe5304931 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:58.602498 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 540/1096] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:39:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 22:39:58.608470 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19779b93-6316-4cbb-a6ec-01d6c8f12634 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:58.612655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670733c8-792e-4300-bea5-dbd25ecc082d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:58.613288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670733c8-792e-4300-bea5-dbd25ecc082d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:58.613564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670733c8-792e-4300-bea5-dbd25ecc082d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:58.613832 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670733c8-792e-4300-bea5-dbd25ecc082d None admin] PATH_INFO: `/v3/users/nova` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:58.621674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670733c8-792e-4300-bea5-dbd25ecc082d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:58.623098 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670733c8-792e-4300-bea5-dbd25ecc082d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:58.635008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-670733c8-792e-4300-bea5-dbd25ecc082d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 22:39:58.635008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:58.635008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:58.635008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:58.635008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:58.635008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:58.635008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:58.635008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:58.635008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:58.635008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:58.635008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:58.635008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:58.635008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:39:58.635008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:39:58.635008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:39:58.635008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:39:58.636409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:58.636409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:58.636409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:39:58.636409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:58.636409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:39:58.636409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:39:58.636409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:58.636409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:58.636409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:58.636409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:58.636409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:58.636409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:58.636409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:58.636409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:58.636409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:58.636409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:58.636409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:58.636409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:58.639288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:58.639288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:58.639288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:39:58.639288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:39:58.639288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:39:58.639288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:39:58.639288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:39:58.639288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:39:58.639288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 22:39:58.639288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:39:58.639288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 557/1097] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Sep 6 22:39:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:39:58.643729 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670733c8-792e-4300-bea5-dbd25ecc082d None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:58.677247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:58.697230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:58.708731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19779b93-6316-4cbb-a6ec-01d6c8f12634 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:58.740478 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670733c8-792e-4300-bea5-dbd25ecc082d None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:58.741593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a0867-b866-4c93-978d-9cc0f3a202e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:58.742753 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a0867-b866-4c93-978d-9cc0f3a202e4 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:58.743029 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a0867-b866-4c93-978d-9cc0f3a202e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:58.743301 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a0867-b866-4c93-978d-9cc0f3a202e4 None admin] PATH_INFO: `/v3/projects/fb37b725ef3248f7a6968f7888c9e00f` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:58.744439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a0867-b866-4c93-978d-9cc0f3a202e4 None admin] RBAC: Authorizing `identity:get_project(project_id=fb37b725ef3248f7a6968f7888c9e00f)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:58.745954 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a0867-b866-4c93-978d-9cc0f3a202e4 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:58.747726 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 541/1098] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:39:58 2022] GET /identity/v3/projects/fb37b725ef3248f7a6968f7888c9e00f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:58.753545 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a0867-b866-4c93-978d-9cc0f3a202e4 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:58.775971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987df23-034a-4615-a80c-27781cad46b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:58.776722 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987df23-034a-4615-a80c-27781cad46b1 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:58.777003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987df23-034a-4615-a80c-27781cad46b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:58.777276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987df23-034a-4615-a80c-27781cad46b1 None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:58.777993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987df23-034a-4615-a80c-27781cad46b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:58.778294 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987df23-034a-4615-a80c-27781cad46b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:58.779704 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987df23-034a-4615-a80c-27781cad46b1 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:58.796665 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 558/1099] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Sep 6 22:39:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:58.802278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987df23-034a-4615-a80c-27781cad46b1 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:58.852793 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a0867-b866-4c93-978d-9cc0f3a202e4 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:58.886167 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88404626-c1d1-46ec-b15a-07339bdde0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:58.886769 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88404626-c1d1-46ec-b15a-07339bdde0f8 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:58.887046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88404626-c1d1-46ec-b15a-07339bdde0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:58.887317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88404626-c1d1-46ec-b15a-07339bdde0f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:58.888040 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88404626-c1d1-46ec-b15a-07339bdde0f8 None admin] RBAC: Adding query filter params (role.id=aa2332d1bdb74e48a88ed7c2a7ed2990, scope.project.id=fb37b725ef3248f7a6968f7888c9e00f, user.id=a76bb92ad8424a7c82390aa1e9606777) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:58.888343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88404626-c1d1-46ec-b15a-07339bdde0f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:58.889802 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88404626-c1d1-46ec-b15a-07339bdde0f8 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:58.893013 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:58.895808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 542/1100] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:39:58 2022] GET /identity/v3/role_assignments?user.id=a76bb92ad8424a7c82390aa1e9606777&scope.project.id=fb37b725ef3248f7a6968f7888c9e00f&role.id=aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:39:58.899582 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987df23-034a-4615-a80c-27781cad46b1 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:58.937466 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ac885-79da-4acf-b6d9-ed2c425e557f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:58.938016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ac885-79da-4acf-b6d9-ed2c425e557f None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:58.938299 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ac885-79da-4acf-b6d9-ed2c425e557f None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:58.938574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ac885-79da-4acf-b6d9-ed2c425e557f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:59.010208 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ac885-79da-4acf-b6d9-ed2c425e557f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:59.011688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ac885-79da-4acf-b6d9-ed2c425e557f None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:59.107137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:59.114991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 559/1101] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:39:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 22:39:59.121537 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88404626-c1d1-46ec-b15a-07339bdde0f8 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:59.143475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:59.219752 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88404626-c1d1-46ec-b15a-07339bdde0f8 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:59.252061 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343a318-223c-4b2f-a1ba-eeb2f281de15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:59.252714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343a318-223c-4b2f-a1ba-eeb2f281de15 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:59.252993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343a318-223c-4b2f-a1ba-eeb2f281de15 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:59.253259 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343a318-223c-4b2f-a1ba-eeb2f281de15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:59.263668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343a318-223c-4b2f-a1ba-eeb2f281de15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:59.265151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343a318-223c-4b2f-a1ba-eeb2f281de15 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:59.279309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-b343a318-223c-4b2f-a1ba-eeb2f281de15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:59.279309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:59.279309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:59.279309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:59.279309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:59.279309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:59.279309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:59.279309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:59.279309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:59.279309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:59.279309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:59.279309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:59.279309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:39:59.279309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:39:59.279309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:39:59.279309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:39:59.280280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:59.280280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:59.280280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:59.280280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:59.280280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:59.280280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:59.280280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:59.280280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:59.280280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:59.280280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:59.280280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:59.280280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:59.280280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:59.280280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:59.280280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:59.280280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:59.280280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:39:59.281703 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:39:59.281703 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:39:59.281703 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:59.281703 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 543/1102] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:59.286238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ac885-79da-4acf-b6d9-ed2c425e557f None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:59.386209 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ac885-79da-4acf-b6d9-ed2c425e557f None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:59.419904 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fb742-c666-4632-ae0c-24f7d96b23cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:59.420544 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fb742-c666-4632-ae0c-24f7d96b23cb None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:59.420822 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fb742-c666-4632-ae0c-24f7d96b23cb None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:59.421088 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fb742-c666-4632-ae0c-24f7d96b23cb None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:59.421719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fb742-c666-4632-ae0c-24f7d96b23cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:59.422016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fb742-c666-4632-ae0c-24f7d96b23cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:59.423351 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fb742-c666-4632-ae0c-24f7d96b23cb None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:59.434139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 560/1103] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:59.439872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343a318-223c-4b2f-a1ba-eeb2f281de15 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:59.508481 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:59.537846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343a318-223c-4b2f-a1ba-eeb2f281de15 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:59.571063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff349e45-2d94-4418-9007-06359f9c01d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:59.571690 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff349e45-2d94-4418-9007-06359f9c01d5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:59.571970 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff349e45-2d94-4418-9007-06359f9c01d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:59.572242 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff349e45-2d94-4418-9007-06359f9c01d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:59.579069 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff349e45-2d94-4418-9007-06359f9c01d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:59.580560 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff349e45-2d94-4418-9007-06359f9c01d5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:59.592178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ff349e45-2d94-4418-9007-06359f9c01d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:59.592178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:39:59.592178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:39:59.592178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:39:59.592178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:39:59.592178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:39:59.592178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:39:59.592178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:39:59.592178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:39:59.592178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:39:59.592178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:39:59.592178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:39:59.592178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:39:59.592178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:39:59.592178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:39:59.593114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:39:59.593114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:39:59.593114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:39:59.593114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:39:59.593114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:39:59.593114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:39:59.593114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:39:59.593114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:39:59.593114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:39:59.593114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:39:59.593114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:39:59.593114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:39:59.593114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:39:59.593114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:39:59.593114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:39:59.593114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:39:59.593114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:39:59.594028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:39:59.594028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:39:59.594028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:39:59.594028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:39:59.594028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:39:59.594028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:39:59.594028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:39:59.594028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:39:59.596597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 544/1104] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:39:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:39:59.599092 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fb742-c666-4632-ae0c-24f7d96b23cb None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:59.654180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:59.697297 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fb742-c666-4632-ae0c-24f7d96b23cb None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:59.730576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a6094-cbd4-496e-bf26-6d3f91bd1487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:59.731186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a6094-cbd4-496e-bf26-6d3f91bd1487 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:59.731465 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a6094-cbd4-496e-bf26-6d3f91bd1487 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:59.731735 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a6094-cbd4-496e-bf26-6d3f91bd1487 None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:59.732432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a6094-cbd4-496e-bf26-6d3f91bd1487 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:59.732753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a6094-cbd4-496e-bf26-6d3f91bd1487 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:59.734176 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a6094-cbd4-496e-bf26-6d3f91bd1487 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:59.745822 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 561/1105] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:39:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:39:59.751762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff349e45-2d94-4418-9007-06359f9c01d5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:39:59.852520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff349e45-2d94-4418-9007-06359f9c01d5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:39:59.880089 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:39:59.885328 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8c297-59f7-4b65-b790-00109b24caa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:39:59.885928 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8c297-59f7-4b65-b790-00109b24caa1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:39:59.891185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8c297-59f7-4b65-b790-00109b24caa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:39:59.891185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8c297-59f7-4b65-b790-00109b24caa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:39:59.891185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8c297-59f7-4b65-b790-00109b24caa1 None admin] RBAC: Adding query filter params (role.id=ea85f0a3b95b4866b3f1ec715073e153, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=b18fd296138349408613004929144e70) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:39:59.891185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8c297-59f7-4b65-b790-00109b24caa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:39:59.891185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8c297-59f7-4b65-b790-00109b24caa1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:39:59.894588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 545/1106] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:39:59 2022] GET /identity/v3/role_assignments?user.id=b18fd296138349408613004929144e70&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=ea85f0a3b95b4866b3f1ec715073e153 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:40:01.097700 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446a6d3-02b2-49e7-8fcf-4bad5cf36111 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:01.098115 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446a6d3-02b2-49e7-8fcf-4bad5cf36111 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:01.098272 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446a6d3-02b2-49e7-8fcf-4bad5cf36111 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:01.099625 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 562/1107] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:40:01.104839 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f847643-1a7f-42f8-a240-bd0acbd54cca None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:01.105240 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f847643-1a7f-42f8-a240-bd0acbd54cca None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:01.105396 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f847643-1a7f-42f8-a240-bd0acbd54cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:01.124061 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3f847643-1a7f-42f8-a240-bd0acbd54cca None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:40:01.125297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3f847643-1a7f-42f8-a240-bd0acbd54cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:40:01.189243 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 546/1108] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:40:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:40:01.453851 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446a6d3-02b2-49e7-8fcf-4bad5cf36111 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:01.550660 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446a6d3-02b2-49e7-8fcf-4bad5cf36111 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:01.564510 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:01.584083 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2afa15-3dd9-4712-959f-f6ea44b2b825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:01.584732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2afa15-3dd9-4712-959f-f6ea44b2b825 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:01.585012 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2afa15-3dd9-4712-959f-f6ea44b2b825 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:01.585305 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2afa15-3dd9-4712-959f-f6ea44b2b825 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:01.586399 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2afa15-3dd9-4712-959f-f6ea44b2b825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:01.587822 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2afa15-3dd9-4712-959f-f6ea44b2b825 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:01.589393 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 563/1109] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:40:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:01.595170 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f847643-1a7f-42f8-a240-bd0acbd54cca None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:01.690857 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f847643-1a7f-42f8-a240-bd0acbd54cca None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:01.716081 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:01.724320 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff97dae-b418-4102-baab-5cf312a0c9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:01.724947 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff97dae-b418-4102-baab-5cf312a0c9fb None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:01.725226 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff97dae-b418-4102-baab-5cf312a0c9fb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:01.725496 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff97dae-b418-4102-baab-5cf312a0c9fb None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:01.726178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff97dae-b418-4102-baab-5cf312a0c9fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:01.727611 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff97dae-b418-4102-baab-5cf312a0c9fb None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:01.812489 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 547/1110] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Sep 6 22:40:01 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:40:03.989288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f7272-48cf-4cb2-ab7f-1a13a2c84052 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:03.989878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f7272-48cf-4cb2-ab7f-1a13a2c84052 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:03.989878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f7272-48cf-4cb2-ab7f-1a13a2c84052 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:03.991173 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 564/1111] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:40:03.996383 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae19728-4ffd-461d-9954-16399acb4fb2 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:03.996839 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae19728-4ffd-461d-9954-16399acb4fb2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:03.996953 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae19728-4ffd-461d-9954-16399acb4fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:04.019215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2ae19728-4ffd-461d-9954-16399acb4fb2 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:40:04.021045 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2ae19728-4ffd-461d-9954-16399acb4fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:40:04.090337 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 548/1112] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:40:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:40:04.372731 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f7272-48cf-4cb2-ab7f-1a13a2c84052 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:04.470323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f7272-48cf-4cb2-ab7f-1a13a2c84052 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:04.502266 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840f30e-20c7-44f8-adcf-02384efb5e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:04.502886 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840f30e-20c7-44f8-adcf-02384efb5e9b None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:04.503162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840f30e-20c7-44f8-adcf-02384efb5e9b None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:04.503428 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840f30e-20c7-44f8-adcf-02384efb5e9b None admin] PATH_INFO: `/v3/roles/01a26dc2b1034e33af13752c154d24f4` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:04.504869 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840f30e-20c7-44f8-adcf-02384efb5e9b None admin] RBAC: Authorizing `identity:get_role(role_id=01a26dc2b1034e33af13752c154d24f4)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:04.506206 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840f30e-20c7-44f8-adcf-02384efb5e9b None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:04.508233 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 565/1113] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:40:04 2022] GET /identity/v3/roles/01a26dc2b1034e33af13752c154d24f4 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:04.513866 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae19728-4ffd-461d-9954-16399acb4fb2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:04.613620 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae19728-4ffd-461d-9954-16399acb4fb2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:04.626722 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:04.647211 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181effb-1380-4dac-8cbe-58f2a77058d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:04.655433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181effb-1380-4dac-8cbe-58f2a77058d3 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:04.655433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181effb-1380-4dac-8cbe-58f2a77058d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:04.655433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181effb-1380-4dac-8cbe-58f2a77058d3 None admin] PATH_INFO: `/v3/users/d537245b28c74ec8a4b9ec1fb0d68bbb` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:04.660858 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181effb-1380-4dac-8cbe-58f2a77058d3 None admin] RBAC: Authorizing `identity:get_user(user_id=d537245b28c74ec8a4b9ec1fb0d68bbb)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:04.662346 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181effb-1380-4dac-8cbe-58f2a77058d3 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:04.663956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 549/1114] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:40:04 2022] GET /identity/v3/users/d537245b28c74ec8a4b9ec1fb0d68bbb => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:04.669711 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840f30e-20c7-44f8-adcf-02384efb5e9b None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:04.718670 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:04.766194 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840f30e-20c7-44f8-adcf-02384efb5e9b None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:04.798499 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14496f21-006b-47bb-bc6c-97d6af86943f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:04.799093 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14496f21-006b-47bb-bc6c-97d6af86943f None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:04.799368 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14496f21-006b-47bb-bc6c-97d6af86943f None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:04.799637 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14496f21-006b-47bb-bc6c-97d6af86943f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:04.865441 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14496f21-006b-47bb-bc6c-97d6af86943f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:04.869904 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14496f21-006b-47bb-bc6c-97d6af86943f None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:04.919252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:04.967903 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 566/1115] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:40:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 22:40:04.973784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181effb-1380-4dac-8cbe-58f2a77058d3 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:05.068974 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181effb-1380-4dac-8cbe-58f2a77058d3 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:05.102477 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760bbdb-3101-4a1e-9097-e10745c88def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:05.103096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760bbdb-3101-4a1e-9097-e10745c88def None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:05.103373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760bbdb-3101-4a1e-9097-e10745c88def None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:05.103643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760bbdb-3101-4a1e-9097-e10745c88def None admin] PATH_INFO: `/v3/projects/fb37b725ef3248f7a6968f7888c9e00f` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:05.104770 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760bbdb-3101-4a1e-9097-e10745c88def None admin] RBAC: Authorizing `identity:get_project(project_id=fb37b725ef3248f7a6968f7888c9e00f)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:05.106209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760bbdb-3101-4a1e-9097-e10745c88def None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:05.107816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 550/1116] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:40:04 2022] GET /identity/v3/projects/fb37b725ef3248f7a6968f7888c9e00f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:05.113796 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14496f21-006b-47bb-bc6c-97d6af86943f None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:05.215121 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14496f21-006b-47bb-bc6c-97d6af86943f None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:05.247600 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73df98-24b1-4ed8-8e83-ee28e6b4f6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:05.248196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73df98-24b1-4ed8-8e83-ee28e6b4f6de None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:05.248494 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73df98-24b1-4ed8-8e83-ee28e6b4f6de None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:05.248763 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73df98-24b1-4ed8-8e83-ee28e6b4f6de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:05.249589 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73df98-24b1-4ed8-8e83-ee28e6b4f6de None admin] RBAC: Adding query filter params (role.id=01a26dc2b1034e33af13752c154d24f4, scope.project.id=fb37b725ef3248f7a6968f7888c9e00f, user.id=d537245b28c74ec8a4b9ec1fb0d68bbb) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:40:05.249897 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73df98-24b1-4ed8-8e83-ee28e6b4f6de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:05.251308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73df98-24b1-4ed8-8e83-ee28e6b4f6de None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:05.256465 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 567/1117] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:40:05 2022] GET /identity/v3/role_assignments?user.id=d537245b28c74ec8a4b9ec1fb0d68bbb&scope.project.id=fb37b725ef3248f7a6968f7888c9e00f&role.id=01a26dc2b1034e33af13752c154d24f4 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:07.352517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5785f44-76e4-49a5-a046-9f85a0ff4706 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:07.353032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5785f44-76e4-49a5-a046-9f85a0ff4706 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:07.353032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5785f44-76e4-49a5-a046-9f85a0ff4706 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:07.354327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 551/1118] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:40:07.359352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78881d00-5733-4d29-b4b9-b2a1ae2569e0 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:07.359728 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78881d00-5733-4d29-b4b9-b2a1ae2569e0 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:07.359906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78881d00-5733-4d29-b4b9-b2a1ae2569e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:07.377863 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-78881d00-5733-4d29-b4b9-b2a1ae2569e0 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:40:07.379043 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-78881d00-5733-4d29-b4b9-b2a1ae2569e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:40:07.388569 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:07.443585 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 568/1119] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:40:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:40:07.714674 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5785f44-76e4-49a5-a046-9f85a0ff4706 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:07.754459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:07.812710 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5785f44-76e4-49a5-a046-9f85a0ff4706 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:07.846081 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cebcb-a354-43dd-a70e-07586599ab2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:07.846706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cebcb-a354-43dd-a70e-07586599ab2e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:07.846982 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cebcb-a354-43dd-a70e-07586599ab2e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:07.847252 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cebcb-a354-43dd-a70e-07586599ab2e None admin] PATH_INFO: `/v3/roles/01a26dc2b1034e33af13752c154d24f4` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:07.848668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cebcb-a354-43dd-a70e-07586599ab2e None admin] RBAC: Authorizing `identity:get_role(role_id=01a26dc2b1034e33af13752c154d24f4)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:07.850036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cebcb-a354-43dd-a70e-07586599ab2e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:07.851867 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 552/1120] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:40:07 2022] GET /identity/v3/roles/01a26dc2b1034e33af13752c154d24f4 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:07.857651 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78881d00-5733-4d29-b4b9-b2a1ae2569e0 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:07.951612 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78881d00-5733-4d29-b4b9-b2a1ae2569e0 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:07.984123 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9db7ff-3a23-48f6-ad39-96a4b242c9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:07.984704 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9db7ff-3a23-48f6-ad39-96a4b242c9ff None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:07.984979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9db7ff-3a23-48f6-ad39-96a4b242c9ff None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:07.985246 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9db7ff-3a23-48f6-ad39-96a4b242c9ff None admin] PATH_INFO: `/v3/users/d537245b28c74ec8a4b9ec1fb0d68bbb` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:07.986335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9db7ff-3a23-48f6-ad39-96a4b242c9ff None admin] RBAC: Authorizing `identity:get_user(user_id=d537245b28c74ec8a4b9ec1fb0d68bbb)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:07.987756 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9db7ff-3a23-48f6-ad39-96a4b242c9ff None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:07.989332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 569/1121] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:40:07 2022] GET /identity/v3/users/d537245b28c74ec8a4b9ec1fb0d68bbb => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:07.995629 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cebcb-a354-43dd-a70e-07586599ab2e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:08.093517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cebcb-a354-43dd-a70e-07586599ab2e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:08.101207 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:08.126970 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180e712-c820-49fb-8585-6e151ccb2187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:08.127594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180e712-c820-49fb-8585-6e151ccb2187 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:08.127872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180e712-c820-49fb-8585-6e151ccb2187 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:08.128150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180e712-c820-49fb-8585-6e151ccb2187 None admin] PATH_INFO: `/v3/projects/fb37b725ef3248f7a6968f7888c9e00f` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:08.129283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180e712-c820-49fb-8585-6e151ccb2187 None admin] RBAC: Authorizing `identity:get_project(project_id=fb37b725ef3248f7a6968f7888c9e00f)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:08.130706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180e712-c820-49fb-8585-6e151ccb2187 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:08.132776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 553/1122] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:40:07 2022] GET /identity/v3/projects/fb37b725ef3248f7a6968f7888c9e00f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:08.138288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9db7ff-3a23-48f6-ad39-96a4b242c9ff None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:08.153160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:08.239657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9db7ff-3a23-48f6-ad39-96a4b242c9ff None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:08.272090 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d321cc-fbdf-42ff-86fd-10b210323856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:08.273267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d321cc-fbdf-42ff-86fd-10b210323856 None admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:08.273549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d321cc-fbdf-42ff-86fd-10b210323856 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:08.273826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d321cc-fbdf-42ff-86fd-10b210323856 None admin] PATH_INFO: `/v3/projects/fb37b725ef3248f7a6968f7888c9e00f/users/d537245b28c74ec8a4b9ec1fb0d68bbb/roles/01a26dc2b1034e33af13752c154d24f4` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:08.275952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d321cc-fbdf-42ff-86fd-10b210323856 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb37b725ef3248f7a6968f7888c9e00f, user_id=d537245b28c74ec8a4b9ec1fb0d68bbb, role_id=01a26dc2b1034e33af13752c154d24f4)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:08.277414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d321cc-fbdf-42ff-86fd-10b210323856 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:08.348178 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 570/1123] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:40:08 2022] PUT /identity/v3/projects/fb37b725ef3248f7a6968f7888c9e00f/users/d537245b28c74ec8a4b9ec1fb0d68bbb/roles/01a26dc2b1034e33af13752c154d24f4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:40:10.440331 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed8418-b6e9-4038-be19-aed360d55aee None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:10.440879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed8418-b6e9-4038-be19-aed360d55aee None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:10.440879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed8418-b6e9-4038-be19-aed360d55aee None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:10.442160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 554/1124] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:40:10.447796 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159bb13-7efd-4105-bb8d-f3be5b938b1e None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:10.448242 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159bb13-7efd-4105-bb8d-f3be5b938b1e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:10.448336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159bb13-7efd-4105-bb8d-f3be5b938b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:10.466487 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-b159bb13-7efd-4105-bb8d-f3be5b938b1e None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:40:10.467684 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b159bb13-7efd-4105-bb8d-f3be5b938b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:40:10.531988 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 571/1125] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:40:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:40:10.800775 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed8418-b6e9-4038-be19-aed360d55aee None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:10.898912 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed8418-b6e9-4038-be19-aed360d55aee None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:10.931965 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c3f94-9aa6-4959-adc9-87dc7f554dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:10.932609 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c3f94-9aa6-4959-adc9-87dc7f554dfa None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:10.932889 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c3f94-9aa6-4959-adc9-87dc7f554dfa None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:10.933161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c3f94-9aa6-4959-adc9-87dc7f554dfa None admin] PATH_INFO: `/v3/roles/01a26dc2b1034e33af13752c154d24f4` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:10.934537 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c3f94-9aa6-4959-adc9-87dc7f554dfa None admin] RBAC: Authorizing `identity:get_role(role_id=01a26dc2b1034e33af13752c154d24f4)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:10.935904 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c3f94-9aa6-4959-adc9-87dc7f554dfa None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:10.937214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 555/1126] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:40:10 2022] GET /identity/v3/roles/01a26dc2b1034e33af13752c154d24f4 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:10.942898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159bb13-7efd-4105-bb8d-f3be5b938b1e None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:10.945124 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:11.040262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159bb13-7efd-4105-bb8d-f3be5b938b1e None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:11.073253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60787117-3566-4290-9b6f-3b162c98ad69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:11.073829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60787117-3566-4290-9b6f-3b162c98ad69 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:11.074110 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60787117-3566-4290-9b6f-3b162c98ad69 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:11.074386 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60787117-3566-4290-9b6f-3b162c98ad69 None admin] PATH_INFO: `/v3/users/d537245b28c74ec8a4b9ec1fb0d68bbb` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:11.075496 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60787117-3566-4290-9b6f-3b162c98ad69 None admin] RBAC: Authorizing `identity:get_user(user_id=d537245b28c74ec8a4b9ec1fb0d68bbb)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:11.076963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60787117-3566-4290-9b6f-3b162c98ad69 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:11.078801 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 572/1127] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:40:10 2022] GET /identity/v3/users/d537245b28c74ec8a4b9ec1fb0d68bbb => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:11.084691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c3f94-9aa6-4959-adc9-87dc7f554dfa None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:11.127431 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:11.181102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c3f94-9aa6-4959-adc9-87dc7f554dfa None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:11.214188 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61533f-452f-42a3-95ad-cebc01890aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:11.214785 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61533f-452f-42a3-95ad-cebc01890aaa None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:11.215066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61533f-452f-42a3-95ad-cebc01890aaa None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:11.215340 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61533f-452f-42a3-95ad-cebc01890aaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:11.279151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61533f-452f-42a3-95ad-cebc01890aaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:11.280609 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61533f-452f-42a3-95ad-cebc01890aaa None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:11.319859 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:11.374609 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 556/1128] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:40:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 22:40:11.380397 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60787117-3566-4290-9b6f-3b162c98ad69 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:11.446383 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:11.474904 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60787117-3566-4290-9b6f-3b162c98ad69 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:11.508168 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b868d-5e30-476d-9fbc-7fef6f4181a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:11.508810 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b868d-5e30-476d-9fbc-7fef6f4181a8 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:11.509086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b868d-5e30-476d-9fbc-7fef6f4181a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:11.509353 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b868d-5e30-476d-9fbc-7fef6f4181a8 None admin] PATH_INFO: `/v3/projects/fb37b725ef3248f7a6968f7888c9e00f` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:11.510452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b868d-5e30-476d-9fbc-7fef6f4181a8 None admin] RBAC: Authorizing `identity:get_project(project_id=fb37b725ef3248f7a6968f7888c9e00f)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:11.511951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b868d-5e30-476d-9fbc-7fef6f4181a8 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:11.513674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 573/1129] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:40:11 2022] GET /identity/v3/projects/fb37b725ef3248f7a6968f7888c9e00f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:11.520303 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61533f-452f-42a3-95ad-cebc01890aaa None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:11.615480 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61533f-452f-42a3-95ad-cebc01890aaa None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:11.648496 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6502dc-5957-4827-992b-a9c7ce97e969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:11.649046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6502dc-5957-4827-992b-a9c7ce97e969 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:11.649319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6502dc-5957-4827-992b-a9c7ce97e969 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:11.649588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6502dc-5957-4827-992b-a9c7ce97e969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:11.650296 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6502dc-5957-4827-992b-a9c7ce97e969 None admin] RBAC: Adding query filter params (role.id=01a26dc2b1034e33af13752c154d24f4, scope.project.id=fb37b725ef3248f7a6968f7888c9e00f, user.id=d537245b28c74ec8a4b9ec1fb0d68bbb) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:40:11.650596 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6502dc-5957-4827-992b-a9c7ce97e969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:11.652013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6502dc-5957-4827-992b-a9c7ce97e969 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:11.657554 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 557/1130] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:40:11 2022] GET /identity/v3/role_assignments?user.id=d537245b28c74ec8a4b9ec1fb0d68bbb&scope.project.id=fb37b725ef3248f7a6968f7888c9e00f&role.id=01a26dc2b1034e33af13752c154d24f4 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:13.843683 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ba29a-1e58-4afc-935d-91f7c4a18b2f None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:13.844217 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ba29a-1e58-4afc-935d-91f7c4a18b2f None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:13.844217 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ba29a-1e58-4afc-935d-91f7c4a18b2f None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:13.845614 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 574/1131] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:40:13.850867 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe1e08-971e-4f88-b8af-553eff899e21 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:13.851279 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe1e08-971e-4f88-b8af-553eff899e21 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:13.851425 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe1e08-971e-4f88-b8af-553eff899e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:13.866275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:13.871823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-adfe1e08-971e-4f88-b8af-553eff899e21 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:40:13.873055 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-adfe1e08-971e-4f88-b8af-553eff899e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:40:13.943472 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 558/1132] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:40:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:40:14.240124 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ba29a-1e58-4afc-935d-91f7c4a18b2f None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:14.352557 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ba29a-1e58-4afc-935d-91f7c4a18b2f None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:14.384927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8b1ff-289c-45ff-ac54-19e73720e350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:14.385578 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8b1ff-289c-45ff-ac54-19e73720e350 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:14.385854 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8b1ff-289c-45ff-ac54-19e73720e350 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:14.386125 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8b1ff-289c-45ff-ac54-19e73720e350 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:14.387217 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8b1ff-289c-45ff-ac54-19e73720e350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:14.388688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8b1ff-289c-45ff-ac54-19e73720e350 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:14.390256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 575/1133] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:40:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:14.396059 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe1e08-971e-4f88-b8af-553eff899e21 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:14.492035 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe1e08-971e-4f88-b8af-553eff899e21 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:14.525104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4135b7-a11f-4c92-9a10-531ee4009c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:14.525702 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4135b7-a11f-4c92-9a10-531ee4009c92 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:14.525981 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4135b7-a11f-4c92-9a10-531ee4009c92 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:14.526254 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4135b7-a11f-4c92-9a10-531ee4009c92 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:14.526903 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4135b7-a11f-4c92-9a10-531ee4009c92 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:14.528333 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4135b7-a11f-4c92-9a10-531ee4009c92 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:14.533529 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:14.653276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 559/1134] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Sep 6 22:40:14 2022] POST /identity/v3/projects => generated 311 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:40:16.783234 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4ebff-fbc1-4140-a4bd-33b4e6c9171c None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:16.783767 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4ebff-fbc1-4140-a4bd-33b4e6c9171c None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:16.783767 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4ebff-fbc1-4140-a4bd-33b4e6c9171c None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:16.785155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 576/1135] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:40:16.790775 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e486db-1ebb-4375-9bad-6543bba147b8 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:16.791193 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e486db-1ebb-4375-9bad-6543bba147b8 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:16.791320 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e486db-1ebb-4375-9bad-6543bba147b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:16.809571 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-84e486db-1ebb-4375-9bad-6543bba147b8 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:40:16.810743 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-84e486db-1ebb-4375-9bad-6543bba147b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:40:16.874551 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 560/1136] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:40:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:40:17.140760 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4ebff-fbc1-4140-a4bd-33b4e6c9171c None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:17.150489 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:17.242421 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4ebff-fbc1-4140-a4bd-33b4e6c9171c None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:17.275420 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d196d9-192c-41fe-8d8f-445ff79ec6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:17.276045 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d196d9-192c-41fe-8d8f-445ff79ec6e1 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:17.276321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d196d9-192c-41fe-8d8f-445ff79ec6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:17.276618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d196d9-192c-41fe-8d8f-445ff79ec6e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:17.277711 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d196d9-192c-41fe-8d8f-445ff79ec6e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:17.279129 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d196d9-192c-41fe-8d8f-445ff79ec6e1 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:17.280812 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 577/1137] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:40:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:17.286702 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e486db-1ebb-4375-9bad-6543bba147b8 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:17.382631 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e486db-1ebb-4375-9bad-6543bba147b8 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:17.399570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:17.415937 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f1fca-3924-466d-809d-e2b19dfb6db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:17.416565 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f1fca-3924-466d-809d-e2b19dfb6db0 None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:17.416843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f1fca-3924-466d-809d-e2b19dfb6db0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:17.417112 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f1fca-3924-466d-809d-e2b19dfb6db0 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:17.417745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f1fca-3924-466d-809d-e2b19dfb6db0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:17.419175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f1fca-3924-466d-809d-e2b19dfb6db0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:17.515654 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 561/1138] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Sep 6 22:40:17 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:40:19.684857 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e4e51-8e51-4e30-8024-383d5d105771 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:19.685460 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e4e51-8e51-4e30-8024-383d5d105771 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:19.685460 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e4e51-8e51-4e30-8024-383d5d105771 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:19.686734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 578/1139] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:40:19.692013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa6341-a284-4eef-8f49-58fd1981c361 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:19.692462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa6341-a284-4eef-8f49-58fd1981c361 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:19.692578 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa6341-a284-4eef-8f49-58fd1981c361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:19.711284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e1fa6341-a284-4eef-8f49-58fd1981c361 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:40:19.712495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e1fa6341-a284-4eef-8f49-58fd1981c361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:40:19.777332 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 562/1140] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:40:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:40:20.045607 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e4e51-8e51-4e30-8024-383d5d105771 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:20.124589 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:20.149790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e4e51-8e51-4e30-8024-383d5d105771 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:20.183363 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841731d-8df9-4999-885f-883abf23f525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:20.183999 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841731d-8df9-4999-885f-883abf23f525 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:20.184277 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841731d-8df9-4999-885f-883abf23f525 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:20.184581 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841731d-8df9-4999-885f-883abf23f525 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:20.195060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841731d-8df9-4999-885f-883abf23f525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:40:20.199909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-d841731d-8df9-4999-885f-883abf23f525 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:40:20.199909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:40:20.199909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:40:20.199909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:40:20.199909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:40:20.199909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:40:20.199909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:40:20.199909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:40:20.199909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:40:20.199909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:40:20.199909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:40:20.199909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:40:20.199909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:40:20.199909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:40:20.199909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:40:20.199909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:40:20.201135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:40:20.201135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:40:20.201135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:40:20.201135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:40:20.201135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:40:20.201135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:40:20.201135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:40:20.201135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:40:20.201135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:40:20.201135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:40:20.201135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:40:20.201135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:40:20.201135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:40:20.201135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:40:20.201135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:40:20.201135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:40:20.202480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:40:20.202480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:40:20.202480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:40:20.202480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:40:20.202480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:40:20.202480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:40:20.202480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:40:20.202480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:40:20.202480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:40:20.202480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:40:20.202480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:40:20.202480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:40:20.202480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 579/1141] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:40:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:40:20.207673 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa6341-a284-4eef-8f49-58fd1981c361 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:20.310480 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa6341-a284-4eef-8f49-58fd1981c361 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:20.312715 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:20.345547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001fd9b-0b3b-4c38-b44c-3b4e7ac700ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:20.346153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001fd9b-0b3b-4c38-b44c-3b4e7ac700ec None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:20.346433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001fd9b-0b3b-4c38-b44c-3b4e7ac700ec None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:20.346706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001fd9b-0b3b-4c38-b44c-3b4e7ac700ec None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:20.347369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001fd9b-0b3b-4c38-b44c-3b4e7ac700ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:40:20.347673 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001fd9b-0b3b-4c38-b44c-3b4e7ac700ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:20.349136 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001fd9b-0b3b-4c38-b44c-3b4e7ac700ec None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:20.357118 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 563/1142] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:40:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:20.363111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841731d-8df9-4999-885f-883abf23f525 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:20.460865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841731d-8df9-4999-885f-883abf23f525 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:20.494313 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4d759-fa18-4085-8273-afe30576f3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:20.494935 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4d759-fa18-4085-8273-afe30576f3fa None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:20.495219 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4d759-fa18-4085-8273-afe30576f3fa None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:20.495492 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4d759-fa18-4085-8273-afe30576f3fa None admin] PATH_INFO: `/v3/users/7381dc1265a24f6c8f7b6c1f98aeed28` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:20.497465 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:20.512299 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4d759-fa18-4085-8273-afe30576f3fa None admin] RBAC: Authorizing `identity:get_user(user_id=7381dc1265a24f6c8f7b6c1f98aeed28)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:20.514419 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4d759-fa18-4085-8273-afe30576f3fa None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:20.517702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 580/1143] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:40:20 2022] GET /identity/v3/users/7381dc1265a24f6c8f7b6c1f98aeed28 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:20.523433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001fd9b-0b3b-4c38-b44c-3b4e7ac700ec None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:20.622523 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001fd9b-0b3b-4c38-b44c-3b4e7ac700ec None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:20.654129 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba89ac-daa3-4769-aec4-8ce45a36c262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:20.654725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba89ac-daa3-4769-aec4-8ce45a36c262 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:20.655000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba89ac-daa3-4769-aec4-8ce45a36c262 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:20.655270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba89ac-daa3-4769-aec4-8ce45a36c262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:20.687772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:20.719772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba89ac-daa3-4769-aec4-8ce45a36c262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:20.721245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba89ac-daa3-4769-aec4-8ce45a36c262 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:20.817678 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 564/1144] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:40:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 22:40:20.823892 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4d759-fa18-4085-8273-afe30576f3fa None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:20.922629 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4d759-fa18-4085-8273-afe30576f3fa None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:20.955084 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1ada3-58bb-4ff2-b5ac-c4fbfb47c0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:20.955706 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1ada3-58bb-4ff2-b5ac-c4fbfb47c0b6 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:20.955987 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1ada3-58bb-4ff2-b5ac-c4fbfb47c0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:20.956259 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1ada3-58bb-4ff2-b5ac-c4fbfb47c0b6 None admin] PATH_INFO: `/v3/projects/e3069a3ab3f946a0aa8d693753580fbb` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:20.957386 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1ada3-58bb-4ff2-b5ac-c4fbfb47c0b6 None admin] RBAC: Authorizing `identity:get_project(project_id=e3069a3ab3f946a0aa8d693753580fbb)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:20.959373 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1ada3-58bb-4ff2-b5ac-c4fbfb47c0b6 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:20.961041 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 581/1145] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:40:20 2022] GET /identity/v3/projects/e3069a3ab3f946a0aa8d693753580fbb => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:20.967228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba89ac-daa3-4769-aec4-8ce45a36c262 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:21.029420 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:21.062258 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba89ac-daa3-4769-aec4-8ce45a36c262 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:21.095828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359a540-6747-4445-b875-6418cc99fd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:21.096451 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359a540-6747-4445-b875-6418cc99fd61 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:21.096727 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359a540-6747-4445-b875-6418cc99fd61 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:21.096992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359a540-6747-4445-b875-6418cc99fd61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:21.097706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359a540-6747-4445-b875-6418cc99fd61 None admin] RBAC: Adding query filter params (role.id=aa2332d1bdb74e48a88ed7c2a7ed2990, scope.project.id=e3069a3ab3f946a0aa8d693753580fbb, user.id=7381dc1265a24f6c8f7b6c1f98aeed28) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:40:21.098009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359a540-6747-4445-b875-6418cc99fd61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:21.100048 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359a540-6747-4445-b875-6418cc99fd61 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:21.105247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 565/1146] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:40:20 2022] GET /identity/v3/role_assignments?user.id=7381dc1265a24f6c8f7b6c1f98aeed28&scope.project.id=e3069a3ab3f946a0aa8d693753580fbb&role.id=aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:23.205411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41bcb1-e7af-4467-9317-bc91973f5913 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:23.205930 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41bcb1-e7af-4467-9317-bc91973f5913 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:23.205930 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41bcb1-e7af-4467-9317-bc91973f5913 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:23.207293 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 582/1147] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:40:23.212846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09052868-5855-4158-8835-afd64d0c8eb0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:23.213252 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09052868-5855-4158-8835-afd64d0c8eb0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:23.213389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09052868-5855-4158-8835-afd64d0c8eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:23.231748 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-09052868-5855-4158-8835-afd64d0c8eb0 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:40:23.232990 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-09052868-5855-4158-8835-afd64d0c8eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:40:23.296745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 566/1148] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:40:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:40:23.560302 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41bcb1-e7af-4467-9317-bc91973f5913 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:23.619160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:23.658619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41bcb1-e7af-4467-9317-bc91973f5913 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:23.691488 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e57250-c04d-4748-83da-37058327e18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:23.692104 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e57250-c04d-4748-83da-37058327e18d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:23.692393 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e57250-c04d-4748-83da-37058327e18d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:23.693221 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e57250-c04d-4748-83da-37058327e18d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:23.703083 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e57250-c04d-4748-83da-37058327e18d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:40:23.707786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-49e57250-c04d-4748-83da-37058327e18d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:40:23.707786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:40:23.707786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:40:23.707786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:40:23.707786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:40:23.707786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:40:23.707786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:40:23.707786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:40:23.707786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:40:23.707786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:40:23.707786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:40:23.707786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:40:23.707786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:40:23.707786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:40:23.707786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:40:23.707786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:40:23.709439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:40:23.709439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:40:23.709439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:40:23.709439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:40:23.709439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:40:23.709439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:40:23.709439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:40:23.709439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:40:23.709439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:40:23.709439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:40:23.709439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:40:23.709439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:40:23.709439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:40:23.709439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:40:23.709439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:40:23.709439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:40:23.710443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:40:23.710443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:40:23.710443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:40:23.710443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:40:23.710443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:40:23.710443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:40:23.710443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:40:23.710443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:40:23.710443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:40:23.710443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:40:23.710443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:40:23.710443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:40:23.710443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 583/1149] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:40:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:40:23.715315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09052868-5855-4158-8835-afd64d0c8eb0 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:23.771662 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:23.809797 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09052868-5855-4158-8835-afd64d0c8eb0 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:23.843001 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeee09-ff50-464e-bec2-7b402e4658c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:23.843532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeee09-ff50-464e-bec2-7b402e4658c0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:23.843809 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeee09-ff50-464e-bec2-7b402e4658c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:23.844077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeee09-ff50-464e-bec2-7b402e4658c0 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:23.844756 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aeee09-ff50-464e-bec2-7b402e4658c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:40:23.845055 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aeee09-ff50-464e-bec2-7b402e4658c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:23.846414 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aeee09-ff50-464e-bec2-7b402e4658c0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:23.854081 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 567/1150] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:40:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:23.859698 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e57250-c04d-4748-83da-37058327e18d None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:23.956235 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e57250-c04d-4748-83da-37058327e18d None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:23.976315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:23.989542 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43af25-f3a4-4132-9f32-fd5cb15a7348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:23.990155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43af25-f3a4-4132-9f32-fd5cb15a7348 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:23.990435 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43af25-f3a4-4132-9f32-fd5cb15a7348 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:23.990709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43af25-f3a4-4132-9f32-fd5cb15a7348 None admin] PATH_INFO: `/v3/users/7381dc1265a24f6c8f7b6c1f98aeed28` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:23.991813 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43af25-f3a4-4132-9f32-fd5cb15a7348 None admin] RBAC: Authorizing `identity:get_user(user_id=7381dc1265a24f6c8f7b6c1f98aeed28)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:23.993258 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43af25-f3a4-4132-9f32-fd5cb15a7348 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:23.994810 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 584/1151] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:40:23 2022] GET /identity/v3/users/7381dc1265a24f6c8f7b6c1f98aeed28 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:24.000315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeee09-ff50-464e-bec2-7b402e4658c0 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:24.096772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeee09-ff50-464e-bec2-7b402e4658c0 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:24.118333 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:24.130143 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b28ab-103e-4f9d-97b6-74a422e71a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:24.130772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b28ab-103e-4f9d-97b6-74a422e71a36 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:24.131047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b28ab-103e-4f9d-97b6-74a422e71a36 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:24.131318 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b28ab-103e-4f9d-97b6-74a422e71a36 None admin] PATH_INFO: `/v3/projects/e3069a3ab3f946a0aa8d693753580fbb` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:24.132415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b28ab-103e-4f9d-97b6-74a422e71a36 None admin] RBAC: Authorizing `identity:get_project(project_id=e3069a3ab3f946a0aa8d693753580fbb)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:24.133881 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b28ab-103e-4f9d-97b6-74a422e71a36 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:24.135541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 568/1152] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:40:23 2022] GET /identity/v3/projects/e3069a3ab3f946a0aa8d693753580fbb => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:24.141475 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43af25-f3a4-4132-9f32-fd5cb15a7348 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:24.239999 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43af25-f3a4-4132-9f32-fd5cb15a7348 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:24.272939 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17811d03-b9b3-49ad-8631-bea5e2d24393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:24.273584 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17811d03-b9b3-49ad-8631-bea5e2d24393 None admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:24.273864 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17811d03-b9b3-49ad-8631-bea5e2d24393 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:24.274135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17811d03-b9b3-49ad-8631-bea5e2d24393 None admin] PATH_INFO: `/v3/projects/e3069a3ab3f946a0aa8d693753580fbb/users/7381dc1265a24f6c8f7b6c1f98aeed28/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:24.276000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17811d03-b9b3-49ad-8631-bea5e2d24393 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3069a3ab3f946a0aa8d693753580fbb, user_id=7381dc1265a24f6c8f7b6c1f98aeed28, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:24.277443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17811d03-b9b3-49ad-8631-bea5e2d24393 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:24.371696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 585/1153] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:40:24 2022] PUT /identity/v3/projects/e3069a3ab3f946a0aa8d693753580fbb/users/7381dc1265a24f6c8f7b6c1f98aeed28/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:40:26.454582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aad1a5-ef84-4e8f-8989-9545a0a95ec6 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:26.455098 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aad1a5-ef84-4e8f-8989-9545a0a95ec6 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:26.455098 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aad1a5-ef84-4e8f-8989-9545a0a95ec6 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:26.456370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 569/1154] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:40:26.461662 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390a57b-d002-4b49-a874-3bc81c1bc99e None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:26.462061 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390a57b-d002-4b49-a874-3bc81c1bc99e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:26.462216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390a57b-d002-4b49-a874-3bc81c1bc99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:26.479941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-9390a57b-d002-4b49-a874-3bc81c1bc99e None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:40:26.481156 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9390a57b-d002-4b49-a874-3bc81c1bc99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:40:26.524110 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:26.546334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 586/1155] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:40:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:40:26.816149 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aad1a5-ef84-4e8f-8989-9545a0a95ec6 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:26.915927 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aad1a5-ef84-4e8f-8989-9545a0a95ec6 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:26.947959 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf743b-41f5-4703-a601-6a3caeab2be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:26.948607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf743b-41f5-4703-a601-6a3caeab2be5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:26.948888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf743b-41f5-4703-a601-6a3caeab2be5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:26.949159 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf743b-41f5-4703-a601-6a3caeab2be5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:26.960113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf743b-41f5-4703-a601-6a3caeab2be5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:40:26.964877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-8aaf743b-41f5-4703-a601-6a3caeab2be5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:40:26.964877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:40:26.964877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:40:26.964877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:40:26.964877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:40:26.964877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:40:26.964877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:40:26.964877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:40:26.964877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:40:26.964877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:40:26.964877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:40:26.964877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:40:26.964877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:40:26.964877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:40:26.964877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:40:26.964877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:40:26.965993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:40:26.965993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:40:26.965993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:40:26.965993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:40:26.965993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:40:26.965993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:40:26.965993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:40:26.965993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:40:26.965993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:40:26.965993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:40:26.965993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:40:26.965993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:40:26.965993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:40:26.965993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:40:26.965993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:40:26.965993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:40:26.967194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:40:26.967194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:40:26.967194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:40:26.967194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:40:26.967194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:40:26.967194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:40:26.967194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:40:26.967194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:40:26.967194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:40:26.967194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:40:26.967194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:40:26.967194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:40:26.967194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 570/1156] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:40:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:40:26.972045 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390a57b-d002-4b49-a874-3bc81c1bc99e None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:27.066722 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390a57b-d002-4b49-a874-3bc81c1bc99e None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:27.100873 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2588e47-086d-49bb-ba14-299c45e0098b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:27.101488 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2588e47-086d-49bb-ba14-299c45e0098b None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:27.101763 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2588e47-086d-49bb-ba14-299c45e0098b None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:27.102033 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2588e47-086d-49bb-ba14-299c45e0098b None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:27.102691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2588e47-086d-49bb-ba14-299c45e0098b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:40:27.102992 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2588e47-086d-49bb-ba14-299c45e0098b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:27.104339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2588e47-086d-49bb-ba14-299c45e0098b None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:27.112132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 587/1157] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:40:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:27.118041 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf743b-41f5-4703-a601-6a3caeab2be5 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:27.167576 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:27.215889 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf743b-41f5-4703-a601-6a3caeab2be5 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:27.248473 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f128ab9-8238-49aa-a702-a39346f889d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:27.249098 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f128ab9-8238-49aa-a702-a39346f889d7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:27.249376 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f128ab9-8238-49aa-a702-a39346f889d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:27.249648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f128ab9-8238-49aa-a702-a39346f889d7 None admin] PATH_INFO: `/v3/users/7381dc1265a24f6c8f7b6c1f98aeed28` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:27.250749 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f128ab9-8238-49aa-a702-a39346f889d7 None admin] RBAC: Authorizing `identity:get_user(user_id=7381dc1265a24f6c8f7b6c1f98aeed28)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:27.252180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f128ab9-8238-49aa-a702-a39346f889d7 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:27.253776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 571/1158] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:40:27 2022] GET /identity/v3/users/7381dc1265a24f6c8f7b6c1f98aeed28 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:27.260169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2588e47-086d-49bb-ba14-299c45e0098b None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:27.300911 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:27.356553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2588e47-086d-49bb-ba14-299c45e0098b None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:27.388493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb42a38-a961-4afe-a2e9-82495e82f5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:27.389090 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb42a38-a961-4afe-a2e9-82495e82f5f0 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:27.389365 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb42a38-a961-4afe-a2e9-82495e82f5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:27.389638 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb42a38-a961-4afe-a2e9-82495e82f5f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:27.453418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb42a38-a961-4afe-a2e9-82495e82f5f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:27.454832 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb42a38-a961-4afe-a2e9-82495e82f5f0 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:27.492721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:27.553244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 588/1159] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:40:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 22:40:27.559252 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f128ab9-8238-49aa-a702-a39346f889d7 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:27.656027 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f128ab9-8238-49aa-a702-a39346f889d7 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:27.671885 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:27.688171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e9409-6d07-4962-86e8-922c6a8656d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:27.697254 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e9409-6d07-4962-86e8-922c6a8656d0 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:27.697254 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e9409-6d07-4962-86e8-922c6a8656d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:27.697254 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e9409-6d07-4962-86e8-922c6a8656d0 None admin] PATH_INFO: `/v3/projects/e3069a3ab3f946a0aa8d693753580fbb` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:27.697254 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e9409-6d07-4962-86e8-922c6a8656d0 None admin] RBAC: Authorizing `identity:get_project(project_id=e3069a3ab3f946a0aa8d693753580fbb)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:27.697254 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e9409-6d07-4962-86e8-922c6a8656d0 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:27.697254 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 572/1160] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:40:27 2022] GET /identity/v3/projects/e3069a3ab3f946a0aa8d693753580fbb => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:27.700090 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb42a38-a961-4afe-a2e9-82495e82f5f0 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:27.795844 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb42a38-a961-4afe-a2e9-82495e82f5f0 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:27.829293 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120bf2a-67fd-4873-8c6f-af054bc46d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:27.829893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120bf2a-67fd-4873-8c6f-af054bc46d91 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:27.830175 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120bf2a-67fd-4873-8c6f-af054bc46d91 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:27.830446 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120bf2a-67fd-4873-8c6f-af054bc46d91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:27.831160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120bf2a-67fd-4873-8c6f-af054bc46d91 None admin] RBAC: Adding query filter params (role.id=aa2332d1bdb74e48a88ed7c2a7ed2990, scope.project.id=e3069a3ab3f946a0aa8d693753580fbb, user.id=7381dc1265a24f6c8f7b6c1f98aeed28) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:40:27.831467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120bf2a-67fd-4873-8c6f-af054bc46d91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:27.832929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120bf2a-67fd-4873-8c6f-af054bc46d91 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:27.838512 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 589/1161] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:40:27 2022] GET /identity/v3/role_assignments?user.id=7381dc1265a24f6c8f7b6c1f98aeed28&scope.project.id=e3069a3ab3f946a0aa8d693753580fbb&role.id=aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:30.036757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491c4d8-2395-4795-ba86-c9f4bff91085 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:30.037308 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491c4d8-2395-4795-ba86-c9f4bff91085 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:30.037308 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491c4d8-2395-4795-ba86-c9f4bff91085 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:30.038627 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 573/1162] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:40:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:40:30.043761 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac61a4-2dcf-4397-aa7c-acfbfd4e4a9b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:30.044167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac61a4-2dcf-4397-aa7c-acfbfd4e4a9b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:30.044318 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac61a4-2dcf-4397-aa7c-acfbfd4e4a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:30.051701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:30.062092 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-85ac61a4-2dcf-4397-aa7c-acfbfd4e4a9b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:40:30.063279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-85ac61a4-2dcf-4397-aa7c-acfbfd4e4a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:40:30.128764 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 590/1163] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:40:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:40:30.398445 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491c4d8-2395-4795-ba86-c9f4bff91085 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:30.498375 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491c4d8-2395-4795-ba86-c9f4bff91085 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:30.531151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8dd0f-d73f-4d29-9d12-0b9ac693b7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:30.531749 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8dd0f-d73f-4d29-9d12-0b9ac693b7fe None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:30.532028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8dd0f-d73f-4d29-9d12-0b9ac693b7fe None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:30.532300 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8dd0f-d73f-4d29-9d12-0b9ac693b7fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:30.584602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:30.596961 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8dd0f-d73f-4d29-9d12-0b9ac693b7fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:30.598481 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8dd0f-d73f-4d29-9d12-0b9ac693b7fe None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:30.693884 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 574/1164] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:40:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 22:40:30.700251 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac61a4-2dcf-4397-aa7c-acfbfd4e4a9b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:30.795724 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac61a4-2dcf-4397-aa7c-acfbfd4e4a9b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:30.829040 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c45c4-c032-47df-954f-505548dfbba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:30.829666 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c45c4-c032-47df-954f-505548dfbba2 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:30.829944 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c45c4-c032-47df-954f-505548dfbba2 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:30.830217 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c45c4-c032-47df-954f-505548dfbba2 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:30.832054 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:30.837156 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c45c4-c032-47df-954f-505548dfbba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:30.841126 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c45c4-c032-47df-954f-505548dfbba2 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:30.849656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-267c45c4-c032-47df-954f-505548dfbba2 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 06 22:40:30.849656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:40:30.849656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 22:40:30.849656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 22:40:30.849656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:40:30.849656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:40:30.849656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:40:30.849656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:40:30.849656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 06 22:40:30.849656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:40:30.849656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:40:30.849656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:40:30.849656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:40:30.849656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:40:30.849656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:40:30.849656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:40:30.849656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:40:30.850881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:40:30.850881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:40:30.850881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:40:30.850881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:40:30.850881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:40:30.850881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:40:30.850881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:40:30.850881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:40:30.850881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:40:30.850881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:40:30.850881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:40:30.850881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:40:30.850881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:40:30.850881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:40:30.850881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:40:30.850881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:40:30.851958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:40:30.851958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:40:30.851958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:40:30.851958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:40:30.851958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:40:30.851958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:40:30.851958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:40:30.851958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:40:30.851958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:40:30.851958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:40:30.851958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 22:40:30.851958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:40:30.851958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 06 22:40:30.851958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:40:30.851958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 591/1165] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Sep 6 22:40:30 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:40:30.857084 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8dd0f-d73f-4d29-9d12-0b9ac693b7fe None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:30.939036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:30.954462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8dd0f-d73f-4d29-9d12-0b9ac693b7fe None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:30.988192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02d0c1-765c-4d21-ae0e-5180bb98a45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:30.988837 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02d0c1-765c-4d21-ae0e-5180bb98a45f None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:30.989275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02d0c1-765c-4d21-ae0e-5180bb98a45f None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:30.989553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02d0c1-765c-4d21-ae0e-5180bb98a45f None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:30.990189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02d0c1-765c-4d21-ae0e-5180bb98a45f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:40:30.990492 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02d0c1-765c-4d21-ae0e-5180bb98a45f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:30.991850 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02d0c1-765c-4d21-ae0e-5180bb98a45f None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:30.998732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 575/1166] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Sep 6 22:40:30 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:33.117981 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae6dfd-96be-4c03-b652-db7a69191993 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:33.118454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae6dfd-96be-4c03-b652-db7a69191993 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:33.118556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae6dfd-96be-4c03-b652-db7a69191993 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:33.119875 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 592/1167] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:40:33.125236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0f7aa-7281-43a9-988e-1cf14268a2bc None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:33.125635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0f7aa-7281-43a9-988e-1cf14268a2bc None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:33.125805 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0f7aa-7281-43a9-988e-1cf14268a2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:33.143667 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d6e0f7aa-7281-43a9-988e-1cf14268a2bc None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:40:33.145389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d6e0f7aa-7281-43a9-988e-1cf14268a2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:40:33.209256 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 576/1168] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:40:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:40:33.481175 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae6dfd-96be-4c03-b652-db7a69191993 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:33.584052 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae6dfd-96be-4c03-b652-db7a69191993 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:33.623919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987f41d-9c85-47e6-b849-101c58eceec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:33.624739 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987f41d-9c85-47e6-b849-101c58eceec1 None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:33.625041 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987f41d-9c85-47e6-b849-101c58eceec1 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:33.625315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987f41d-9c85-47e6-b849-101c58eceec1 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:33.626165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987f41d-9c85-47e6-b849-101c58eceec1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:33.627605 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987f41d-9c85-47e6-b849-101c58eceec1 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:33.712394 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 593/1169] 10.222.0.30 () {60 vars in 1138 bytes} [Tue Sep 6 22:40:33 2022] POST /identity/v3/domains => generated 267 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:40:35.896013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27387d-76b1-4edb-aca1-d87899f4701e None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:35.896594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27387d-76b1-4edb-aca1-d87899f4701e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:35.896594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27387d-76b1-4edb-aca1-d87899f4701e None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:35.897959 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 577/1170] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:40:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:40:35.903049 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a7916-5a4e-48bd-bf4d-f38c3e6ae5b8 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:35.903480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a7916-5a4e-48bd-bf4d-f38c3e6ae5b8 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:35.903613 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a7916-5a4e-48bd-bf4d-f38c3e6ae5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:35.922078 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-6a4a7916-5a4e-48bd-bf4d-f38c3e6ae5b8 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:40:35.923273 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-6a4a7916-5a4e-48bd-bf4d-f38c3e6ae5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:40:35.971155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:35.988488 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 594/1171] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:40:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:40:36.261884 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27387d-76b1-4edb-aca1-d87899f4701e None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:36.341644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:36.362984 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27387d-76b1-4edb-aca1-d87899f4701e None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:36.399087 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379be0a-4637-4834-bd94-fe3bd1da3f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:36.399717 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379be0a-4637-4834-bd94-fe3bd1da3f77 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:36.400001 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379be0a-4637-4834-bd94-fe3bd1da3f77 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:36.400271 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379be0a-4637-4834-bd94-fe3bd1da3f77 None admin] PATH_INFO: `/v3/domains/9250450c7237468c8c3864bf354d6d4d` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:36.410848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379be0a-4637-4834-bd94-fe3bd1da3f77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9250450c7237468c8c3864bf354d6d4d)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:36.412294 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379be0a-4637-4834-bd94-fe3bd1da3f77 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:36.413910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 578/1172] 10.222.0.30 () {56 vars in 1183 bytes} [Tue Sep 6 22:40:36 2022] GET /identity/v3/domains/9250450c7237468c8c3864bf354d6d4d => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:36.419744 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a7916-5a4e-48bd-bf4d-f38c3e6ae5b8 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:36.514666 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a7916-5a4e-48bd-bf4d-f38c3e6ae5b8 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:36.547624 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a3d47-060c-4b94-ac6c-bd1aca6bc50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:36.548224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a3d47-060c-4b94-ac6c-bd1aca6bc50a None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:36.548529 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a3d47-060c-4b94-ac6c-bd1aca6bc50a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:36.548804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a3d47-060c-4b94-ac6c-bd1aca6bc50a None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:36.549458 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a3d47-060c-4b94-ac6c-bd1aca6bc50a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:36.551427 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a3d47-060c-4b94-ac6c-bd1aca6bc50a None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:36.651636 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 595/1173] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Sep 6 22:40:36 2022] POST /identity/v3/projects => generated 361 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:40:38.831271 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54f216-5d6f-4671-81bb-d4d2cf9ea7e7 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:38.831822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54f216-5d6f-4671-81bb-d4d2cf9ea7e7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:38.831822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54f216-5d6f-4671-81bb-d4d2cf9ea7e7 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:38.833716 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 579/1174] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:40:38.838874 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d01f2c-5174-4549-93c6-3ef08e4887b6 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:38.839306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d01f2c-5174-4549-93c6-3ef08e4887b6 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:38.839406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d01f2c-5174-4549-93c6-3ef08e4887b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:38.857239 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-d0d01f2c-5174-4549-93c6-3ef08e4887b6 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:40:38.858416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d0d01f2c-5174-4549-93c6-3ef08e4887b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:40:38.886469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:38.922758 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 596/1175] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:40:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:40:39.194042 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54f216-5d6f-4671-81bb-d4d2cf9ea7e7 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:39.292340 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54f216-5d6f-4671-81bb-d4d2cf9ea7e7 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:39.324791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b37d42-3644-419a-a591-27e1ab950f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:39.325403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b37d42-3644-419a-a591-27e1ab950f67 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:39.325679 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b37d42-3644-419a-a591-27e1ab950f67 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:39.325949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b37d42-3644-419a-a591-27e1ab950f67 None admin] PATH_INFO: `/v3/domains/9250450c7237468c8c3864bf354d6d4d` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:39.327289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b37d42-3644-419a-a591-27e1ab950f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9250450c7237468c8c3864bf354d6d4d)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:39.328740 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b37d42-3644-419a-a591-27e1ab950f67 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:39.330266 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 580/1176] 10.222.0.30 () {56 vars in 1183 bytes} [Tue Sep 6 22:40:39 2022] GET /identity/v3/domains/9250450c7237468c8c3864bf354d6d4d => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:39.335825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d01f2c-5174-4549-93c6-3ef08e4887b6 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:39.433178 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d01f2c-5174-4549-93c6-3ef08e4887b6 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:39.465398 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e672add-77ac-4d7b-948c-64b3ee59db23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:39.466004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e672add-77ac-4d7b-948c-64b3ee59db23 None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:39.466287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e672add-77ac-4d7b-948c-64b3ee59db23 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:39.466560 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e672add-77ac-4d7b-948c-64b3ee59db23 None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:39.467198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e672add-77ac-4d7b-948c-64b3ee59db23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:39.468645 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e672add-77ac-4d7b-948c-64b3ee59db23 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:39.570586 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 597/1177] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Sep 6 22:40:39 2022] POST /identity/v3/users => generated 311 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:40:41.754097 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce3a07-9998-4e5f-ac9d-4ad57d31bb21 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:41.754644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce3a07-9998-4e5f-ac9d-4ad57d31bb21 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:41.754644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce3a07-9998-4e5f-ac9d-4ad57d31bb21 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:41.755959 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 581/1178] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:40:41.761207 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f283f-9cdd-4e77-b070-ef2e3942f8e2 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:41.761619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f283f-9cdd-4e77-b070-ef2e3942f8e2 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:41.761758 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f283f-9cdd-4e77-b070-ef2e3942f8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:41.779511 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-0f4f283f-9cdd-4e77-b070-ef2e3942f8e2 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:40:41.780729 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0f4f283f-9cdd-4e77-b070-ef2e3942f8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:40:41.797135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:41.845921 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 598/1179] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:40:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:40:42.117941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce3a07-9998-4e5f-ac9d-4ad57d31bb21 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:42.129293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:42.219043 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce3a07-9998-4e5f-ac9d-4ad57d31bb21 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:42.251539 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc87ba5-11d2-4fa6-ab12-c68a6e76632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:42.252161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc87ba5-11d2-4fa6-ab12-c68a6e76632d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:42.252459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc87ba5-11d2-4fa6-ab12-c68a6e76632d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:42.252736 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc87ba5-11d2-4fa6-ab12-c68a6e76632d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:42.264192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc87ba5-11d2-4fa6-ab12-c68a6e76632d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:40:42.268956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-ecc87ba5-11d2-4fa6-ab12-c68a6e76632d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:40:42.268956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:40:42.268956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:40:42.268956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:40:42.268956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:40:42.268956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:40:42.268956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:40:42.268956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:40:42.268956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:40:42.268956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:40:42.268956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:40:42.268956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:40:42.268956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:40:42.268956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:40:42.268956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:40:42.268956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:40:42.270698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:40:42.270698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:40:42.270698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:40:42.270698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:40:42.270698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:40:42.270698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:40:42.270698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:40:42.270698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:40:42.270698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:40:42.270698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:40:42.270698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:40:42.270698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:40:42.270698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:40:42.270698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:40:42.270698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:40:42.270698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:40:42.271964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:40:42.271964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:40:42.271964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:40:42.271964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:40:42.271964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:40:42.271964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:40:42.271964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:40:42.271964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:40:42.271964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:40:42.271964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:40:42.271964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:40:42.271964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:40:42.271964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 582/1180] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:40:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:40:42.276710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f283f-9cdd-4e77-b070-ef2e3942f8e2 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:42.371082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f283f-9cdd-4e77-b070-ef2e3942f8e2 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:42.403683 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bd354-956a-4e78-8ab4-59aec74ba691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:42.404275 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bd354-956a-4e78-8ab4-59aec74ba691 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:42.404582 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bd354-956a-4e78-8ab4-59aec74ba691 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:42.404850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bd354-956a-4e78-8ab4-59aec74ba691 None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:42.405502 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bd354-956a-4e78-8ab4-59aec74ba691 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:40:42.405800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bd354-956a-4e78-8ab4-59aec74ba691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:42.407144 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bd354-956a-4e78-8ab4-59aec74ba691 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:42.414831 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 599/1181] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:40:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:42.420560 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc87ba5-11d2-4fa6-ab12-c68a6e76632d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:42.485081 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:42.516864 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc87ba5-11d2-4fa6-ab12-c68a6e76632d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:42.550419 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81460f5-fd60-407a-a33f-148ed3fe9f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:42.551040 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81460f5-fd60-407a-a33f-148ed3fe9f86 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:42.551319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81460f5-fd60-407a-a33f-148ed3fe9f86 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:42.551601 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81460f5-fd60-407a-a33f-148ed3fe9f86 None admin] PATH_INFO: `/v3/users/64a104a75e284a05abaf1d816b9bd4d4` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:42.564416 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81460f5-fd60-407a-a33f-148ed3fe9f86 None admin] RBAC: Authorizing `identity:get_user(user_id=64a104a75e284a05abaf1d816b9bd4d4)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:42.566382 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81460f5-fd60-407a-a33f-148ed3fe9f86 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:42.567965 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 583/1182] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:40:42 2022] GET /identity/v3/users/64a104a75e284a05abaf1d816b9bd4d4 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:42.573643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bd354-956a-4e78-8ab4-59aec74ba691 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:42.590344 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:42.671028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bd354-956a-4e78-8ab4-59aec74ba691 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:42.704346 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624dd32-7d93-4f5a-84a2-fd59c2a602e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:42.704969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624dd32-7d93-4f5a-84a2-fd59c2a602e1 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:42.705254 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624dd32-7d93-4f5a-84a2-fd59c2a602e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:42.705527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624dd32-7d93-4f5a-84a2-fd59c2a602e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:42.770217 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624dd32-7d93-4f5a-84a2-fd59c2a602e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:42.771649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624dd32-7d93-4f5a-84a2-fd59c2a602e1 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:42.785252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:42.868231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 600/1183] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:40:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 22:40:42.874134 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81460f5-fd60-407a-a33f-148ed3fe9f86 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:42.977638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81460f5-fd60-407a-a33f-148ed3fe9f86 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:43.002427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:43.011570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec5927-a254-4e89-b6cf-bd9652105375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:43.012196 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec5927-a254-4e89-b6cf-bd9652105375 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:43.012513 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec5927-a254-4e89-b6cf-bd9652105375 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:43.012791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec5927-a254-4e89-b6cf-bd9652105375 None admin] PATH_INFO: `/v3/projects/f1d1767f30714654916697a49d20f4ba` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:43.013917 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec5927-a254-4e89-b6cf-bd9652105375 None admin] RBAC: Authorizing `identity:get_project(project_id=f1d1767f30714654916697a49d20f4ba)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:43.015352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec5927-a254-4e89-b6cf-bd9652105375 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:43.016995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 584/1184] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:40:42 2022] GET /identity/v3/projects/f1d1767f30714654916697a49d20f4ba => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:43.023179 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624dd32-7d93-4f5a-84a2-fd59c2a602e1 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:43.121349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624dd32-7d93-4f5a-84a2-fd59c2a602e1 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:43.134182 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:43.152930 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f70330-c4a6-450b-aa4c-dc63da4df7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:43.153533 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f70330-c4a6-450b-aa4c-dc63da4df7fa None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:43.153812 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f70330-c4a6-450b-aa4c-dc63da4df7fa None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:43.154085 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f70330-c4a6-450b-aa4c-dc63da4df7fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:43.154798 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f70330-c4a6-450b-aa4c-dc63da4df7fa None admin] RBAC: Adding query filter params (role.id=aa2332d1bdb74e48a88ed7c2a7ed2990, scope.project.id=f1d1767f30714654916697a49d20f4ba, user.id=64a104a75e284a05abaf1d816b9bd4d4) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:40:43.155100 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f70330-c4a6-450b-aa4c-dc63da4df7fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:43.156529 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f70330-c4a6-450b-aa4c-dc63da4df7fa None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:43.162558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 601/1185] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:40:43 2022] GET /identity/v3/role_assignments?user.id=64a104a75e284a05abaf1d816b9bd4d4&scope.project.id=f1d1767f30714654916697a49d20f4ba&role.id=aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:45.302421 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee5d9b-74c8-46b1-9e72-49ca23efb176 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:45.302988 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee5d9b-74c8-46b1-9e72-49ca23efb176 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:45.302988 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee5d9b-74c8-46b1-9e72-49ca23efb176 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:45.304305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 585/1186] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:40:45.309580 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9966746-3925-43c1-be7d-7fa86f710fa5 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:45.309986 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9966746-3925-43c1-be7d-7fa86f710fa5 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:45.310128 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9966746-3925-43c1-be7d-7fa86f710fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:45.328572 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-a9966746-3925-43c1-be7d-7fa86f710fa5 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:40:45.329747 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-a9966746-3925-43c1-be7d-7fa86f710fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:40:45.393577 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 602/1187] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:40:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:40:45.673049 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee5d9b-74c8-46b1-9e72-49ca23efb176 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:45.771981 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee5d9b-74c8-46b1-9e72-49ca23efb176 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:45.804871 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996510db-a623-46cd-a196-30f811b69379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:45.805489 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996510db-a623-46cd-a196-30f811b69379 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:45.805771 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996510db-a623-46cd-a196-30f811b69379 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:45.806045 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996510db-a623-46cd-a196-30f811b69379 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:45.815844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996510db-a623-46cd-a196-30f811b69379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:40:45.820799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-996510db-a623-46cd-a196-30f811b69379 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:40:45.820799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:40:45.820799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:40:45.820799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:40:45.820799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:40:45.820799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:40:45.820799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:40:45.820799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:40:45.820799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:40:45.820799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:40:45.820799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:40:45.820799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:40:45.820799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:40:45.820799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:40:45.820799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:40:45.820799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:40:45.821948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:40:45.821948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:40:45.821948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:40:45.821948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:40:45.821948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:40:45.821948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:40:45.821948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:40:45.821948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:40:45.821948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:40:45.821948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:40:45.821948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:40:45.821948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:40:45.821948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:40:45.821948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:40:45.821948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:40:45.821948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:40:45.822991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:40:45.822991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:40:45.822991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:40:45.822991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:40:45.822991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:40:45.822991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:40:45.822991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:40:45.822991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:40:45.822991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:40:45.822991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:40:45.822991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:40:45.822991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:40:45.822991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 586/1188] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:40:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:40:45.828085 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9966746-3925-43c1-be7d-7fa86f710fa5 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:45.922945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9966746-3925-43c1-be7d-7fa86f710fa5 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:45.931840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:45.955533 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23259ba6-4b24-40a7-a456-a8ae76ef237b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:45.956135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23259ba6-4b24-40a7-a456-a8ae76ef237b None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:45.956971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23259ba6-4b24-40a7-a456-a8ae76ef237b None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:45.957242 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23259ba6-4b24-40a7-a456-a8ae76ef237b None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:45.957910 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23259ba6-4b24-40a7-a456-a8ae76ef237b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:40:45.958207 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23259ba6-4b24-40a7-a456-a8ae76ef237b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:45.959557 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23259ba6-4b24-40a7-a456-a8ae76ef237b None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:45.967387 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 603/1189] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:40:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:45.974244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996510db-a623-46cd-a196-30f811b69379 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:46.028117 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:46.070438 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996510db-a623-46cd-a196-30f811b69379 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:46.104619 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7dc997-38b0-4d7f-ad84-e9fd0f45c7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:46.105243 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dc997-38b0-4d7f-ad84-e9fd0f45c7b1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:46.105521 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dc997-38b0-4d7f-ad84-e9fd0f45c7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:46.105794 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dc997-38b0-4d7f-ad84-e9fd0f45c7b1 None admin] PATH_INFO: `/v3/users/64a104a75e284a05abaf1d816b9bd4d4` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:46.106900 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7dc997-38b0-4d7f-ad84-e9fd0f45c7b1 None admin] RBAC: Authorizing `identity:get_user(user_id=64a104a75e284a05abaf1d816b9bd4d4)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:46.108343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7dc997-38b0-4d7f-ad84-e9fd0f45c7b1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:46.109978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 587/1190] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:40:45 2022] GET /identity/v3/users/64a104a75e284a05abaf1d816b9bd4d4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:46.115821 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23259ba6-4b24-40a7-a456-a8ae76ef237b None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:46.212604 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23259ba6-4b24-40a7-a456-a8ae76ef237b None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:46.246734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd41052-d535-4bff-ad81-40a96c417403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:46.247372 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd41052-d535-4bff-ad81-40a96c417403 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:46.247650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd41052-d535-4bff-ad81-40a96c417403 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:46.247920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd41052-d535-4bff-ad81-40a96c417403 None admin] PATH_INFO: `/v3/projects/f1d1767f30714654916697a49d20f4ba` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:46.249021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd41052-d535-4bff-ad81-40a96c417403 None admin] RBAC: Authorizing `identity:get_project(project_id=f1d1767f30714654916697a49d20f4ba)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:46.250446 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd41052-d535-4bff-ad81-40a96c417403 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:46.252071 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 604/1191] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:40:46 2022] GET /identity/v3/projects/f1d1767f30714654916697a49d20f4ba => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:46.258657 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7dc997-38b0-4d7f-ad84-e9fd0f45c7b1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:46.355210 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7dc997-38b0-4d7f-ad84-e9fd0f45c7b1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:46.377378 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:46.388848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08633197-c2f7-4e7b-bbc9-b394c02620e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:46.389495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08633197-c2f7-4e7b-bbc9-b394c02620e9 None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:46.389772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08633197-c2f7-4e7b-bbc9-b394c02620e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:46.390044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08633197-c2f7-4e7b-bbc9-b394c02620e9 None admin] PATH_INFO: `/v3/projects/f1d1767f30714654916697a49d20f4ba/users/64a104a75e284a05abaf1d816b9bd4d4/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:46.391901 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08633197-c2f7-4e7b-bbc9-b394c02620e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1d1767f30714654916697a49d20f4ba, user_id=64a104a75e284a05abaf1d816b9bd4d4, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:46.393482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08633197-c2f7-4e7b-bbc9-b394c02620e9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:46.464871 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 588/1192] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:40:46 2022] PUT /identity/v3/projects/f1d1767f30714654916697a49d20f4ba/users/64a104a75e284a05abaf1d816b9bd4d4/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:40:48.578383 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a27e84-5edc-4973-a98f-1fd37e93c529 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:48.578906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a27e84-5edc-4973-a98f-1fd37e93c529 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:48.579027 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a27e84-5edc-4973-a98f-1fd37e93c529 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:48.580284 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 605/1193] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:40:48.585435 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487f6cf-c0b8-42be-9e10-c503a051d01a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:48.585851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487f6cf-c0b8-42be-9e10-c503a051d01a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:48.585977 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487f6cf-c0b8-42be-9e10-c503a051d01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:48.604344 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a487f6cf-c0b8-42be-9e10-c503a051d01a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:40:48.605560 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a487f6cf-c0b8-42be-9e10-c503a051d01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:40:48.669556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 589/1194] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:40:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:40:48.954230 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a27e84-5edc-4973-a98f-1fd37e93c529 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:48.995087 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:49.055159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a27e84-5edc-4973-a98f-1fd37e93c529 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:49.088134 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ee61a-41f4-445f-90c1-118da5804912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:49.088796 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ee61a-41f4-445f-90c1-118da5804912 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:49.089074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ee61a-41f4-445f-90c1-118da5804912 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:49.089344 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ee61a-41f4-445f-90c1-118da5804912 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:49.099806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ee61a-41f4-445f-90c1-118da5804912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:40:49.104811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-fb2ee61a-41f4-445f-90c1-118da5804912 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:40:49.104811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:40:49.104811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:40:49.104811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:40:49.104811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:40:49.104811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:40:49.104811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:40:49.104811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:40:49.104811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:40:49.104811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:40:49.104811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:40:49.104811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:40:49.104811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:40:49.104811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:40:49.104811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:40:49.104811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:40:49.105919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:40:49.105919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:40:49.105919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:40:49.105919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:40:49.105919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:40:49.105919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:40:49.105919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:40:49.105919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:40:49.105919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:40:49.105919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:40:49.105919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:40:49.105919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:40:49.105919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:40:49.105919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:40:49.105919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:40:49.105919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:40:49.106919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:40:49.106919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:40:49.106919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:40:49.106919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:40:49.106919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:40:49.106919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:40:49.106919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:40:49.106919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:40:49.106919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:40:49.106919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:40:49.106919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:40:49.106919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:40:49.106919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 606/1195] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:40:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:40:49.112060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487f6cf-c0b8-42be-9e10-c503a051d01a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:49.208413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487f6cf-c0b8-42be-9e10-c503a051d01a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:49.220967 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:49.241570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2901c8-e297-4fb3-a217-270b2dd46ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:49.242174 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2901c8-e297-4fb3-a217-270b2dd46ef9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:49.242453 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2901c8-e297-4fb3-a217-270b2dd46ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:49.242721 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2901c8-e297-4fb3-a217-270b2dd46ef9 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:49.243380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2901c8-e297-4fb3-a217-270b2dd46ef9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:40:49.243679 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2901c8-e297-4fb3-a217-270b2dd46ef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:49.245084 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2901c8-e297-4fb3-a217-270b2dd46ef9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:49.253213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 590/1196] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:40:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:49.259319 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ee61a-41f4-445f-90c1-118da5804912 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:49.354688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:49.358305 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ee61a-41f4-445f-90c1-118da5804912 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:49.391539 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717a4c8-86ad-4b46-916d-6a03e9eb2b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:49.392184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717a4c8-86ad-4b46-916d-6a03e9eb2b1b None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:49.392488 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717a4c8-86ad-4b46-916d-6a03e9eb2b1b None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:49.392760 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717a4c8-86ad-4b46-916d-6a03e9eb2b1b None admin] PATH_INFO: `/v3/users/64a104a75e284a05abaf1d816b9bd4d4` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:49.394398 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717a4c8-86ad-4b46-916d-6a03e9eb2b1b None admin] RBAC: Authorizing `identity:get_user(user_id=64a104a75e284a05abaf1d816b9bd4d4)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:49.395817 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717a4c8-86ad-4b46-916d-6a03e9eb2b1b None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:49.397412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 607/1197] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Sep 6 22:40:49 2022] GET /identity/v3/users/64a104a75e284a05abaf1d816b9bd4d4 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:49.403127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2901c8-e297-4fb3-a217-270b2dd46ef9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:49.501502 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2901c8-e297-4fb3-a217-270b2dd46ef9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:49.533872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d0f60-25e4-411e-be50-77eaa116fb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:49.535054 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d0f60-25e4-411e-be50-77eaa116fb05 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:49.535331 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d0f60-25e4-411e-be50-77eaa116fb05 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:49.535603 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d0f60-25e4-411e-be50-77eaa116fb05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:49.575228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:49.600046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d0f60-25e4-411e-be50-77eaa116fb05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:49.601517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d0f60-25e4-411e-be50-77eaa116fb05 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:49.695199 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 591/1198] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:40:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 22:40:49.701409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717a4c8-86ad-4b46-916d-6a03e9eb2b1b None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:49.796643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717a4c8-86ad-4b46-916d-6a03e9eb2b1b None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:49.828776 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710ac72-fffa-4504-abed-eb55c7d6237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:49.829386 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710ac72-fffa-4504-abed-eb55c7d6237e None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:49.829658 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710ac72-fffa-4504-abed-eb55c7d6237e None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:49.829923 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710ac72-fffa-4504-abed-eb55c7d6237e None admin] PATH_INFO: `/v3/projects/f1d1767f30714654916697a49d20f4ba` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:49.831578 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710ac72-fffa-4504-abed-eb55c7d6237e None admin] RBAC: Authorizing `identity:get_project(project_id=f1d1767f30714654916697a49d20f4ba)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:49.833102 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710ac72-fffa-4504-abed-eb55c7d6237e None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:49.834729 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 608/1199] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Sep 6 22:40:49 2022] GET /identity/v3/projects/f1d1767f30714654916697a49d20f4ba => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:49.840652 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d0f60-25e4-411e-be50-77eaa116fb05 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:40:49.911770 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:49.935277 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d0f60-25e4-411e-be50-77eaa116fb05 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:40:49.969036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c12802-8292-483c-b973-32ea08da2a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:40:49.969624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c12802-8292-483c-b973-32ea08da2a15 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:40:49.969899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c12802-8292-483c-b973-32ea08da2a15 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:40:49.970169 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c12802-8292-483c-b973-32ea08da2a15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:40:49.970921 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c12802-8292-483c-b973-32ea08da2a15 None admin] RBAC: Adding query filter params (role.id=aa2332d1bdb74e48a88ed7c2a7ed2990, scope.project.id=f1d1767f30714654916697a49d20f4ba, user.id=64a104a75e284a05abaf1d816b9bd4d4) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:40:49.971226 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c12802-8292-483c-b973-32ea08da2a15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:40:49.972673 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c12802-8292-483c-b973-32ea08da2a15 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:40:49.978241 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 592/1200] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:40:49 2022] GET /identity/v3/role_assignments?user.id=64a104a75e284a05abaf1d816b9bd4d4&scope.project.id=f1d1767f30714654916697a49d20f4ba&role.id=aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:40:59.824547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=83 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:59.975644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=31 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:01.282931 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebc4c6-9e43-4b29-834a-c11ecf47b81c None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:01.283536 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebc4c6-9e43-4b29-834a-c11ecf47b81c None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:01.283536 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebc4c6-9e43-4b29-834a-c11ecf47b81c None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:01.284897 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 609/1201] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:42:01.290139 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80039c4d-b113-41f3-9932-c2c09764e22f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:01.290538 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80039c4d-b113-41f3-9932-c2c09764e22f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:01.290690 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80039c4d-b113-41f3-9932-c2c09764e22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:01.310008 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-80039c4d-b113-41f3-9932-c2c09764e22f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:42:01.311750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-80039c4d-b113-41f3-9932-c2c09764e22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:42:01.377692 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 593/1202] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:42:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:42:01.644464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebc4c6-9e43-4b29-834a-c11ecf47b81c None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:01.743024 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebc4c6-9e43-4b29-834a-c11ecf47b81c None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:01.775444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b383994-4b68-455c-a11a-5cd4c59859dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:01.776063 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b383994-4b68-455c-a11a-5cd4c59859dd None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:01.776338 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b383994-4b68-455c-a11a-5cd4c59859dd None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:01.776629 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b383994-4b68-455c-a11a-5cd4c59859dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:01.789441 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b383994-4b68-455c-a11a-5cd4c59859dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:01.792820 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b383994-4b68-455c-a11a-5cd4c59859dd None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:01.805031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-4b383994-4b68-455c-a11a-5cd4c59859dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:01.805031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:01.805031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:01.805031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:01.805031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:01.805031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:01.805031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:01.805031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:01.805031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:01.805031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:01.805031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:01.805031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:01.805031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:42:01.805031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:42:01.805031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:42:01.805031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:42:01.806212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:01.806212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:01.806212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:01.806212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:01.806212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:01.806212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:01.806212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:01.806212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:01.806212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:01.806212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:01.806212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:01.806212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:01.806212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:01.806212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:01.806212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:01.806212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:01.806212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:42:01.807244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:42:01.807244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:01.807244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:42:01.807244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 610/1203] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:01.812244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80039c4d-b113-41f3-9932-c2c09764e22f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:01.909079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80039c4d-b113-41f3-9932-c2c09764e22f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:01.936127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:01.941710 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3c553-6bd6-42a6-90ea-48b396244883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:01.942307 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3c553-6bd6-42a6-90ea-48b396244883 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:01.942582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3c553-6bd6-42a6-90ea-48b396244883 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:01.942849 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3c553-6bd6-42a6-90ea-48b396244883 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:01.943483 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3c553-6bd6-42a6-90ea-48b396244883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:01.943779 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3c553-6bd6-42a6-90ea-48b396244883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:01.945170 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3c553-6bd6-42a6-90ea-48b396244883 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:01.957241 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 594/1204] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:42:01.963016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b383994-4b68-455c-a11a-5cd4c59859dd None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:02.015897 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:02.061985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b383994-4b68-455c-a11a-5cd4c59859dd None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:02.096878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401945c9-928a-4a43-83ef-af6f1279b711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:02.097489 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401945c9-928a-4a43-83ef-af6f1279b711 None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:02.097766 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401945c9-928a-4a43-83ef-af6f1279b711 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:02.098034 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401945c9-928a-4a43-83ef-af6f1279b711 None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:02.098677 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401945c9-928a-4a43-83ef-af6f1279b711 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:02.100201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401945c9-928a-4a43-83ef-af6f1279b711 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:02.216131 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 611/1205] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Sep 6 22:42:01 2022] POST /identity/v3/users => generated 251 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:42:04.388789 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17290fc9-35db-4169-8a8f-1879d6e655c3 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:04.389305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17290fc9-35db-4169-8a8f-1879d6e655c3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:04.389305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17290fc9-35db-4169-8a8f-1879d6e655c3 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:04.390591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 595/1206] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:42:04.395949 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684cd72-8db2-410d-9ec6-cfbd8b8451ad None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:04.396372 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684cd72-8db2-410d-9ec6-cfbd8b8451ad None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:04.396530 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684cd72-8db2-410d-9ec6-cfbd8b8451ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:04.415148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-d684cd72-8db2-410d-9ec6-cfbd8b8451ad None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:42:04.416337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d684cd72-8db2-410d-9ec6-cfbd8b8451ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:42:04.481656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 612/1207] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:42:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:42:04.760774 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17290fc9-35db-4169-8a8f-1879d6e655c3 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:04.863040 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17290fc9-35db-4169-8a8f-1879d6e655c3 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:04.895776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b73f81-5ac9-4217-80c3-9171e6ff4ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:04.896397 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b73f81-5ac9-4217-80c3-9171e6ff4ee7 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:04.896706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b73f81-5ac9-4217-80c3-9171e6ff4ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:04.896980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b73f81-5ac9-4217-80c3-9171e6ff4ee7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:04.907851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b73f81-5ac9-4217-80c3-9171e6ff4ee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:42:04.912587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-22b73f81-5ac9-4217-80c3-9171e6ff4ee7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:42:04.912587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:04.912587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:04.912587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:04.912587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:04.912587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:04.912587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:04.912587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:04.912587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:04.912587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:04.912587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:04.912587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:04.912587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:42:04.912587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:42:04.912587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:42:04.912587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:42:04.913758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:42:04.913758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:42:04.913758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:42:04.913758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:42:04.913758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:04.913758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:04.913758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:04.913758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:04.913758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:04.913758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:04.913758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:04.913758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:04.913758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:04.913758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:04.913758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:04.913758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:04.915047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:04.915047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:04.915047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:04.915047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:04.915047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:42:04.915047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:42:04.915047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:42:04.915047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:42:04.915047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:42:04.915047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:42:04.915047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:42:04.915047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:04.915047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 596/1208] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:42:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:04.919868 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684cd72-8db2-410d-9ec6-cfbd8b8451ad None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:04.959537 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:05.016807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684cd72-8db2-410d-9ec6-cfbd8b8451ad None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:05.050750 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db736ba-c7c2-4729-bf7b-6bef3621952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:05.051360 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db736ba-c7c2-4729-bf7b-6bef3621952a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:05.051640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db736ba-c7c2-4729-bf7b-6bef3621952a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:05.051915 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db736ba-c7c2-4729-bf7b-6bef3621952a None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:05.052600 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db736ba-c7c2-4729-bf7b-6bef3621952a None admin] RBAC: Adding query filter params (name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:05.052903 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db736ba-c7c2-4729-bf7b-6bef3621952a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:05.054271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db736ba-c7c2-4729-bf7b-6bef3621952a None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:05.061879 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 613/1209] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:42:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:05.067880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b73f81-5ac9-4217-80c3-9171e6ff4ee7 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:05.120221 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:05.168600 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b73f81-5ac9-4217-80c3-9171e6ff4ee7 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:05.202811 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5df719-2e25-43ac-86b5-56b405c43608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:05.204671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5df719-2e25-43ac-86b5-56b405c43608 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:05.204671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5df719-2e25-43ac-86b5-56b405c43608 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:05.204671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5df719-2e25-43ac-86b5-56b405c43608 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:05.214140 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5df719-2e25-43ac-86b5-56b405c43608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:05.215579 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5df719-2e25-43ac-86b5-56b405c43608 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:05.229236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-1a5df719-2e25-43ac-86b5-56b405c43608 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:05.229236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:05.229236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:05.229236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:05.229236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:05.229236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:05.229236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:05.229236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:05.229236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:05.229236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:05.229236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:05.229236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:05.229236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:42:05.229236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:42:05.229236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:42:05.229236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:42:05.234485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:05.234485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:05.234485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:05.234485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:05.234485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:05.234485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:05.234485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:05.234485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:05.234485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:05.234485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:05.234485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:05.234485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:05.234485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:05.234485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:05.234485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:05.234485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:05.234485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:42:05.235648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:42:05.235648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:05.235648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:05.235648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 597/1210] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:05.236251 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db736ba-c7c2-4729-bf7b-6bef3621952a None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:05.332795 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:05.334154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db736ba-c7c2-4729-bf7b-6bef3621952a None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:05.366458 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5b8a3-a5e0-4245-a375-2fa66949942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:05.367062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5b8a3-a5e0-4245-a375-2fa66949942c None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:05.367346 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5b8a3-a5e0-4245-a375-2fa66949942c None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:05.367643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5b8a3-a5e0-4245-a375-2fa66949942c None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:05.368283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5b8a3-a5e0-4245-a375-2fa66949942c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:05.368620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5b8a3-a5e0-4245-a375-2fa66949942c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:05.370025 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5b8a3-a5e0-4245-a375-2fa66949942c None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:05.381587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 614/1211] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:05.387330 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5df719-2e25-43ac-86b5-56b405c43608 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:05.486245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5df719-2e25-43ac-86b5-56b405c43608 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:05.487847 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:05.519957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24a911-a4c1-4885-b70d-ad8c3fba0abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:05.520619 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24a911-a4c1-4885-b70d-ad8c3fba0abb None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:05.520899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24a911-a4c1-4885-b70d-ad8c3fba0abb None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:05.521169 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24a911-a4c1-4885-b70d-ad8c3fba0abb None admin] PATH_INFO: `/v3/users/placement` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:05.529510 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24a911-a4c1-4885-b70d-ad8c3fba0abb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:05.532390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24a911-a4c1-4885-b70d-ad8c3fba0abb None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:05.541713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-3b24a911-a4c1-4885-b70d-ad8c3fba0abb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 22:42:05.541713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:05.541713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:05.541713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:05.541713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:05.541713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:05.541713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:05.541713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:05.541713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:05.541713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:05.541713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:05.541713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:05.541713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:42:05.541713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:42:05.541713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:42:05.541713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:42:05.542888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:05.542888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:05.542888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:42:05.542888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:42:05.542888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:42:05.542888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:42:05.542888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:05.542888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:05.542888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:05.542888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:05.542888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:05.542888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:05.542888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:05.542888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:05.542888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:05.542888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:05.542888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:05.542888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:05.544356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:05.544356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:05.544356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:42:05.544356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:42:05.544356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:42:05.544356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:42:05.544356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:42:05.544356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:42:05.544356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 22:42:05.544356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:05.544356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 598/1212] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:42:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:05.549141 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5b8a3-a5e0-4245-a375-2fa66949942c None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:05.648636 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5b8a3-a5e0-4245-a375-2fa66949942c None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:05.681421 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533bea1-95ab-4228-b080-3fb80ae4b871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:05.682138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533bea1-95ab-4228-b080-3fb80ae4b871 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:05.682419 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533bea1-95ab-4228-b080-3fb80ae4b871 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:05.682693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533bea1-95ab-4228-b080-3fb80ae4b871 None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:05.683415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533bea1-95ab-4228-b080-3fb80ae4b871 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:05.683720 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533bea1-95ab-4228-b080-3fb80ae4b871 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:05.685790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533bea1-95ab-4228-b080-3fb80ae4b871 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:05.702730 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 615/1213] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Sep 6 22:42:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:05.708565 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24a911-a4c1-4885-b70d-ad8c3fba0abb None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:05.806316 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24a911-a4c1-4885-b70d-ad8c3fba0abb None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:05.839552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3978f-1093-48fd-bed7-85c23d109644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:05.840150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3978f-1093-48fd-bed7-85c23d109644 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:05.840444 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3978f-1093-48fd-bed7-85c23d109644 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:05.840725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3978f-1093-48fd-bed7-85c23d109644 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:05.869839 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:05.910163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3978f-1093-48fd-bed7-85c23d109644 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:05.911609 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3978f-1093-48fd-bed7-85c23d109644 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:06.013996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 599/1214] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:42:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 22:42:06.019865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533bea1-95ab-4228-b080-3fb80ae4b871 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:06.038568 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:06.117039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533bea1-95ab-4228-b080-3fb80ae4b871 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:06.148973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ef6a0-39c5-4379-8c62-01a31c982287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:06.149591 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ef6a0-39c5-4379-8c62-01a31c982287 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:06.149872 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ef6a0-39c5-4379-8c62-01a31c982287 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:06.150138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ef6a0-39c5-4379-8c62-01a31c982287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:06.160294 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ef6a0-39c5-4379-8c62-01a31c982287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:06.161714 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ef6a0-39c5-4379-8c62-01a31c982287 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:06.176199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-835ef6a0-39c5-4379-8c62-01a31c982287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:06.176199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:06.176199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:06.176199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:06.176199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:06.176199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:06.176199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:06.176199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:06.176199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:06.176199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:06.176199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:06.176199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:06.176199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:42:06.176199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:42:06.176199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:42:06.176199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:42:06.183628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:06.183628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:06.183628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:06.183628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:06.183628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:06.183628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:06.183628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:06.183628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:06.183628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:06.183628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:06.183628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:06.183628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:06.183628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:06.183628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:06.183628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:06.183628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:06.183628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:42:06.184824 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:42:06.184824 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:06.184824 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:42:06.184824 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 616/1215] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:06.185087 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3978f-1093-48fd-bed7-85c23d109644 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:06.242969 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:06.281832 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3978f-1093-48fd-bed7-85c23d109644 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:06.314960 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8d48a-990a-4663-9094-85e2ded2735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:06.315560 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8d48a-990a-4663-9094-85e2ded2735e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:06.315836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8d48a-990a-4663-9094-85e2ded2735e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:06.316109 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8d48a-990a-4663-9094-85e2ded2735e None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:06.316780 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8d48a-990a-4663-9094-85e2ded2735e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:06.317079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8d48a-990a-4663-9094-85e2ded2735e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:06.318447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8d48a-990a-4663-9094-85e2ded2735e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:06.329980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 600/1216] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:06.335792 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ef6a0-39c5-4379-8c62-01a31c982287 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:06.406172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:06.435381 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ef6a0-39c5-4379-8c62-01a31c982287 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:06.468484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b61e42-02f3-44e3-b9f3-22feebb48254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:06.469114 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b61e42-02f3-44e3-b9f3-22feebb48254 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:06.469393 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b61e42-02f3-44e3-b9f3-22feebb48254 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:06.469663 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b61e42-02f3-44e3-b9f3-22feebb48254 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:06.476158 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b61e42-02f3-44e3-b9f3-22feebb48254 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:06.477605 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b61e42-02f3-44e3-b9f3-22feebb48254 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:06.489788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-e4b61e42-02f3-44e3-b9f3-22feebb48254 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:42:06.489788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:06.489788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:06.489788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:06.489788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:06.489788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:06.489788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:06.489788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:06.489788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:06.489788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:06.489788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:06.489788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:06.489788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:42:06.489788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:42:06.489788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:42:06.495702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:42:06.495702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:06.495702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:06.495702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:06.495702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:06.495702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:06.495702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:06.495702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:06.495702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:06.495702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:06.495702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:06.495702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:06.495702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:06.495702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:06.495702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:06.495702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:06.495702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:06.496717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:42:06.496717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:42:06.496717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:42:06.496717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:42:06.496717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:42:06.496717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:42:06.496717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:42:06.496717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:42:06.496717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 617/1217] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:06.497241 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8d48a-990a-4663-9094-85e2ded2735e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:06.595842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8d48a-990a-4663-9094-85e2ded2735e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:06.618240 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:06.630088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc6191-585c-45bd-9739-b34348eaf2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:06.630694 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc6191-585c-45bd-9739-b34348eaf2c5 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:06.630978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc6191-585c-45bd-9739-b34348eaf2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:06.631254 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc6191-585c-45bd-9739-b34348eaf2c5 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:06.631942 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc6191-585c-45bd-9739-b34348eaf2c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:06.632252 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc6191-585c-45bd-9739-b34348eaf2c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:06.633727 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc6191-585c-45bd-9739-b34348eaf2c5 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:06.645928 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 601/1218] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:42:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:06.652190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b61e42-02f3-44e3-b9f3-22feebb48254 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:06.755588 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b61e42-02f3-44e3-b9f3-22feebb48254 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:06.783686 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:06.789308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e238ce-0b08-4d29-ae17-8425b1469919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:06.789906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e238ce-0b08-4d29-ae17-8425b1469919 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:06.790183 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e238ce-0b08-4d29-ae17-8425b1469919 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:06.790487 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e238ce-0b08-4d29-ae17-8425b1469919 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:06.791201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e238ce-0b08-4d29-ae17-8425b1469919 None admin] RBAC: Adding query filter params (role.id=85bcc17628d742209f79cc936d4290b5, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=4f6bd5bbbf65461990c9bb2747dbe5e9) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:06.791501 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e238ce-0b08-4d29-ae17-8425b1469919 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:06.792990 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e238ce-0b08-4d29-ae17-8425b1469919 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:06.798509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 618/1219] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:42:06 2022] GET /identity/v3/role_assignments?user.id=4f6bd5bbbf65461990c9bb2747dbe5e9&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=85bcc17628d742209f79cc936d4290b5 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:08.916145 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83cbd8-da80-486b-adfa-bcb0bfcd4629 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:08.916726 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83cbd8-da80-486b-adfa-bcb0bfcd4629 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:08.916726 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83cbd8-da80-486b-adfa-bcb0bfcd4629 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:08.918055 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 602/1220] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:42:08.923829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0b7e9-c5d0-46e8-8386-b3d46105b912 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:08.924210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0b7e9-c5d0-46e8-8386-b3d46105b912 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:08.924459 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0b7e9-c5d0-46e8-8386-b3d46105b912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:08.942355 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-dfa0b7e9-c5d0-46e8-8386-b3d46105b912 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:42:08.943525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-dfa0b7e9-c5d0-46e8-8386-b3d46105b912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:42:09.008001 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 619/1221] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:42:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:42:09.275446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83cbd8-da80-486b-adfa-bcb0bfcd4629 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:09.374856 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83cbd8-da80-486b-adfa-bcb0bfcd4629 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:09.411244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36344d74-6870-48e9-869b-3d5453121298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:09.411876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36344d74-6870-48e9-869b-3d5453121298 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:09.412155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36344d74-6870-48e9-869b-3d5453121298 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:09.412441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36344d74-6870-48e9-869b-3d5453121298 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:09.422462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36344d74-6870-48e9-869b-3d5453121298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:42:09.427228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-36344d74-6870-48e9-869b-3d5453121298 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:42:09.427228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:09.427228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:09.427228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:09.427228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:09.427228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:09.427228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:09.427228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:09.427228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:09.427228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:09.427228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:09.427228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:09.427228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:42:09.427228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:42:09.427228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:42:09.427228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:42:09.428335 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:42:09.428335 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:42:09.428335 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:42:09.428335 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:42:09.428335 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:09.428335 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:09.428335 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:09.428335 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:09.428335 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:09.428335 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:09.428335 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:09.428335 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:09.428335 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:09.428335 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:09.428335 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:09.428335 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:09.431549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:09.431549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:09.431549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:09.431549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:09.431549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:42:09.431549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:42:09.431549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:42:09.431549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:42:09.431549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:42:09.431549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:42:09.431549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:42:09.431549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:09.431549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 603/1222] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:42:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:09.434617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0b7e9-c5d0-46e8-8386-b3d46105b912 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:09.534527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0b7e9-c5d0-46e8-8386-b3d46105b912 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:09.557816 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:09.568389 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844d876-28b6-4181-ae68-7a7648dad64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:09.569036 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844d876-28b6-4181-ae68-7a7648dad64d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:09.569315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844d876-28b6-4181-ae68-7a7648dad64d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:09.569586 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844d876-28b6-4181-ae68-7a7648dad64d None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:09.570245 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844d876-28b6-4181-ae68-7a7648dad64d None admin] RBAC: Adding query filter params (name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:09.570543 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844d876-28b6-4181-ae68-7a7648dad64d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:09.571895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844d876-28b6-4181-ae68-7a7648dad64d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:09.580387 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 620/1223] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:42:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:09.586344 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36344d74-6870-48e9-869b-3d5453121298 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:09.629939 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:09.685385 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36344d74-6870-48e9-869b-3d5453121298 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:09.718246 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f84226-2188-4484-9e87-6ec35cca62cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:09.718877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f84226-2188-4484-9e87-6ec35cca62cd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:09.719158 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f84226-2188-4484-9e87-6ec35cca62cd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:09.719435 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f84226-2188-4484-9e87-6ec35cca62cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:09.729754 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f84226-2188-4484-9e87-6ec35cca62cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:09.731200 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f84226-2188-4484-9e87-6ec35cca62cd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:09.744865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-b5f84226-2188-4484-9e87-6ec35cca62cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:09.744865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:09.744865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:09.744865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:09.744865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:09.744865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:09.744865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:09.744865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:09.744865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:09.744865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:09.744865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:09.744865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:09.744865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:42:09.744865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:42:09.744865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:42:09.744865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:42:09.746030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:09.746030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:09.746030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:09.746030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:09.746030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:09.746030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:09.746030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:09.746030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:09.746030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:09.746030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:09.746030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:09.746030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:09.746030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:09.746030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:09.746030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:09.746030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:09.746030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:42:09.747124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:42:09.747124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:09.747124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:09.747124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 604/1224] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:09.752504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844d876-28b6-4181-ae68-7a7648dad64d None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:09.852179 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844d876-28b6-4181-ae68-7a7648dad64d None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:09.885623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65eb5bc-b770-4d6b-99ab-fe30a3c4745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:09.886237 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65eb5bc-b770-4d6b-99ab-fe30a3c4745d None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:09.886517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65eb5bc-b770-4d6b-99ab-fe30a3c4745d None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:09.886787 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65eb5bc-b770-4d6b-99ab-fe30a3c4745d None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:09.887423 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65eb5bc-b770-4d6b-99ab-fe30a3c4745d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:09.887723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65eb5bc-b770-4d6b-99ab-fe30a3c4745d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:09.889657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65eb5bc-b770-4d6b-99ab-fe30a3c4745d None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:09.901378 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 621/1225] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:09.907765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f84226-2188-4484-9e87-6ec35cca62cd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:10.001233 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:10.007638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f84226-2188-4484-9e87-6ec35cca62cd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:10.039603 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245e724-e305-40dd-b6c7-d773e86adebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:10.040224 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245e724-e305-40dd-b6c7-d773e86adebf None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:10.040528 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245e724-e305-40dd-b6c7-d773e86adebf None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:10.040795 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245e724-e305-40dd-b6c7-d773e86adebf None admin] PATH_INFO: `/v3/users/placement` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:10.048546 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245e724-e305-40dd-b6c7-d773e86adebf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:10.049972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245e724-e305-40dd-b6c7-d773e86adebf None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:10.061270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-3245e724-e305-40dd-b6c7-d773e86adebf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 22:42:10.061270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:10.061270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:10.061270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:10.061270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:10.061270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:10.061270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:10.061270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:10.061270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:10.061270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:10.061270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:10.061270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:10.061270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:42:10.061270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:42:10.061270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:42:10.061270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:42:10.062250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:10.062250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:10.062250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:42:10.062250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:42:10.062250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:42:10.062250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:42:10.062250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:10.062250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:10.062250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:10.062250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:10.062250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:10.062250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:10.062250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:10.062250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:10.062250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:10.062250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:10.062250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:10.062250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:10.063429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:10.063429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:10.063429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:42:10.063429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:42:10.063429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:42:10.063429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:42:10.063429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:42:10.063429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:42:10.063429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 22:42:10.063429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:10.063429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 605/1226] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:42:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:10.068314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65eb5bc-b770-4d6b-99ab-fe30a3c4745d None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:10.114863 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:10.165697 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65eb5bc-b770-4d6b-99ab-fe30a3c4745d None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:10.200725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d6f9f-6df5-4d3b-872e-586c8d16677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:10.201420 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d6f9f-6df5-4d3b-872e-586c8d16677b None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:10.201699 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d6f9f-6df5-4d3b-872e-586c8d16677b None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:10.201969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d6f9f-6df5-4d3b-872e-586c8d16677b None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:10.202688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d6f9f-6df5-4d3b-872e-586c8d16677b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:10.202989 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d6f9f-6df5-4d3b-872e-586c8d16677b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:10.204455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d6f9f-6df5-4d3b-872e-586c8d16677b None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:10.221764 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 622/1227] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Sep 6 22:42:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:10.236344 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245e724-e305-40dd-b6c7-d773e86adebf None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:10.327109 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245e724-e305-40dd-b6c7-d773e86adebf None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:10.360057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e8e69-9e5f-4405-b914-68e27ec59dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:10.360709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e8e69-9e5f-4405-b914-68e27ec59dba None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:10.360989 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e8e69-9e5f-4405-b914-68e27ec59dba None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:10.361259 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e8e69-9e5f-4405-b914-68e27ec59dba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:10.371535 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e8e69-9e5f-4405-b914-68e27ec59dba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:10.373553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e8e69-9e5f-4405-b914-68e27ec59dba None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:10.387272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-e93e8e69-9e5f-4405-b914-68e27ec59dba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:10.387272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:10.387272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:10.387272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:10.387272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:10.387272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:10.387272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:10.387272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:10.387272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:10.387272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:10.387272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:10.387272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:10.387272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:42:10.387272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:42:10.387272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:42:10.387272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:42:10.388460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:10.388460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:10.388460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:10.388460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:10.388460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:10.388460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:10.388460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:10.388460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:10.388460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:10.388460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:10.388460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:10.388460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:10.388460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:10.388460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:10.388460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:10.388460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:10.388460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:42:10.405266 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:42:10.405266 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:10.405266 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:10.405266 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 606/1228] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:10.405556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d6f9f-6df5-4d3b-872e-586c8d16677b None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:10.492396 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d6f9f-6df5-4d3b-872e-586c8d16677b None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:10.494716 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:10.526721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fd81a-36c1-4215-8571-1303e0352487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:10.527338 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fd81a-36c1-4215-8571-1303e0352487 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:10.527617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fd81a-36c1-4215-8571-1303e0352487 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:10.527887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fd81a-36c1-4215-8571-1303e0352487 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:10.529095 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fd81a-36c1-4215-8571-1303e0352487 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:10.529403 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fd81a-36c1-4215-8571-1303e0352487 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:10.530762 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fd81a-36c1-4215-8571-1303e0352487 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:10.542212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 623/1229] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:10.548856 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e8e69-9e5f-4405-b914-68e27ec59dba None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:10.558024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:10.645697 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e8e69-9e5f-4405-b914-68e27ec59dba None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:10.680382 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128d79e-45d9-46f3-8905-ef1da359ce94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:10.681099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128d79e-45d9-46f3-8905-ef1da359ce94 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:10.681380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128d79e-45d9-46f3-8905-ef1da359ce94 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:10.681651 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128d79e-45d9-46f3-8905-ef1da359ce94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:10.688233 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128d79e-45d9-46f3-8905-ef1da359ce94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:10.691163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128d79e-45d9-46f3-8905-ef1da359ce94 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:10.701799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-5128d79e-45d9-46f3-8905-ef1da359ce94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:42:10.701799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:10.701799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:10.701799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:10.701799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:10.701799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:10.701799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:10.701799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:10.701799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:10.701799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:10.701799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:10.701799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:10.701799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:42:10.701799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:42:10.701799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:42:10.702876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:42:10.702876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:10.702876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:10.702876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:10.702876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:10.702876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:10.702876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:10.702876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:10.702876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:10.702876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:10.702876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:10.702876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:10.702876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:10.702876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:10.702876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:10.702876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:10.702876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:10.704060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:42:10.704060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:42:10.704060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:42:10.704060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:42:10.704060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:42:10.704060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:42:10.704060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:42:10.704060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:10.704060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 607/1230] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:42:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:10.710045 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fd81a-36c1-4215-8571-1303e0352487 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:10.809758 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fd81a-36c1-4215-8571-1303e0352487 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:10.843898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55cd9c-99f7-460f-924b-e612bdf263e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:10.844534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55cd9c-99f7-460f-924b-e612bdf263e7 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:10.844817 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55cd9c-99f7-460f-924b-e612bdf263e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:10.845090 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55cd9c-99f7-460f-924b-e612bdf263e7 None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:10.845778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55cd9c-99f7-460f-924b-e612bdf263e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:10.846083 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55cd9c-99f7-460f-924b-e612bdf263e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:10.847503 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55cd9c-99f7-460f-924b-e612bdf263e7 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:10.859376 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 624/1231] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:42:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:42:10.865487 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128d79e-45d9-46f3-8905-ef1da359ce94 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:10.936477 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:10.970822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128d79e-45d9-46f3-8905-ef1da359ce94 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:11.003221 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866aeebd-10d2-49cd-92ab-0cf768f8d4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:11.003867 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866aeebd-10d2-49cd-92ab-0cf768f8d4ff None admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:11.004141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866aeebd-10d2-49cd-92ab-0cf768f8d4ff None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:11.004408 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866aeebd-10d2-49cd-92ab-0cf768f8d4ff None admin] PATH_INFO: `/v3/projects/f5e78b142d654280b161a34cec0186cd/users/4f6bd5bbbf65461990c9bb2747dbe5e9/roles/85bcc17628d742209f79cc936d4290b5` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:11.018770 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866aeebd-10d2-49cd-92ab-0cf768f8d4ff None admin] RBAC: Authorizing `identity:create_grant(project_id=f5e78b142d654280b161a34cec0186cd, user_id=4f6bd5bbbf65461990c9bb2747dbe5e9, role_id=85bcc17628d742209f79cc936d4290b5)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:11.020272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866aeebd-10d2-49cd-92ab-0cf768f8d4ff None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:11.111015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 608/1232] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:42:10 2022] PUT /identity/v3/projects/f5e78b142d654280b161a34cec0186cd/users/4f6bd5bbbf65461990c9bb2747dbe5e9/roles/85bcc17628d742209f79cc936d4290b5 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:42:13.215546 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaa4fb-70c2-4eab-b19b-4abe65d10fb2 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:13.216092 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaa4fb-70c2-4eab-b19b-4abe65d10fb2 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:13.216092 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaa4fb-70c2-4eab-b19b-4abe65d10fb2 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:13.217513 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 625/1233] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:42:13.222831 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10319ede-d695-4dfc-97be-ac3fa6c3d791 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:13.223246 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10319ede-d695-4dfc-97be-ac3fa6c3d791 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:13.223384 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10319ede-d695-4dfc-97be-ac3fa6c3d791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:13.241706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-10319ede-d695-4dfc-97be-ac3fa6c3d791 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:42:13.242890 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-10319ede-d695-4dfc-97be-ac3fa6c3d791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:42:13.309157 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 609/1234] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:42:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 22:42:13.575021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eaa4fb-70c2-4eab-b19b-4abe65d10fb2 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:13.600324 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:13.676091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eaa4fb-70c2-4eab-b19b-4abe65d10fb2 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:13.709389 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d86cda-93b5-4c5c-a075-a103f9278ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:13.710022 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d86cda-93b5-4c5c-a075-a103f9278ec7 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:13.710304 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d86cda-93b5-4c5c-a075-a103f9278ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:13.710579 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d86cda-93b5-4c5c-a075-a103f9278ec7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:13.721091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d86cda-93b5-4c5c-a075-a103f9278ec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:42:13.725997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-22d86cda-93b5-4c5c-a075-a103f9278ec7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:42:13.725997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:13.725997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:13.725997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:13.725997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:13.725997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:13.725997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:13.725997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:13.725997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:13.725997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:13.725997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:13.725997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:13.725997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:42:13.725997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:42:13.725997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:42:13.725997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:42:13.727167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:42:13.727167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:42:13.727167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:42:13.727167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:42:13.727167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:13.727167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:13.727167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:13.727167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:13.727167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:13.727167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:13.727167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:13.727167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:13.727167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:13.727167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:13.727167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:13.727167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:13.728201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:13.728201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:13.728201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:13.728201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:13.728201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:42:13.728201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:42:13.728201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:42:13.728201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:42:13.728201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:42:13.728201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:42:13.728201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 22:42:13.728201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:42:13.728201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 626/1235] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Sep 6 22:42:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:13.733884 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10319ede-d695-4dfc-97be-ac3fa6c3d791 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:13.781362 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:13.832259 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10319ede-d695-4dfc-97be-ac3fa6c3d791 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:13.865456 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab705f-6580-4ab2-8b1c-e7139ae7febc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:13.866062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab705f-6580-4ab2-8b1c-e7139ae7febc None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:13.866336 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab705f-6580-4ab2-8b1c-e7139ae7febc None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:13.866602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab705f-6580-4ab2-8b1c-e7139ae7febc None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:13.867268 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab705f-6580-4ab2-8b1c-e7139ae7febc None admin] RBAC: Adding query filter params (name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:13.867554 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab705f-6580-4ab2-8b1c-e7139ae7febc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:13.868940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab705f-6580-4ab2-8b1c-e7139ae7febc None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:13.876561 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 610/1236] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Sep 6 22:42:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:13.882468 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d86cda-93b5-4c5c-a075-a103f9278ec7 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:13.971485 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:13.986953 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d86cda-93b5-4c5c-a075-a103f9278ec7 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:14.019662 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe14a10-d709-4d04-8da2-e23956f98373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:14.020283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe14a10-d709-4d04-8da2-e23956f98373 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:14.020588 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe14a10-d709-4d04-8da2-e23956f98373 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:14.020857 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe14a10-d709-4d04-8da2-e23956f98373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:14.031026 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe14a10-d709-4d04-8da2-e23956f98373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:14.032468 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe14a10-d709-4d04-8da2-e23956f98373 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:14.047166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-1fe14a10-d709-4d04-8da2-e23956f98373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:14.047166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:14.047166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:14.047166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:14.047166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:14.047166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:14.047166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:14.047166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:14.047166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:14.047166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:14.047166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:14.047166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:14.047166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:42:14.047166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:42:14.047166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:42:14.047166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:42:14.048306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:14.048306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:14.048306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:14.048306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:14.048306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:14.048306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:14.048306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:14.048306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:14.048306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:14.048306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:14.048306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:14.048306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:14.048306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:14.048306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:14.048306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:14.048306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:14.048306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:42:14.049522 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:42:14.049522 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:14.049522 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:42:14.049522 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 627/1237] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:14.054132 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab705f-6580-4ab2-8b1c-e7139ae7febc None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:14.152734 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab705f-6580-4ab2-8b1c-e7139ae7febc None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:14.161253 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:14.185130 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0539d7-3a04-479c-8598-dc499128ea03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:14.185732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0539d7-3a04-479c-8598-dc499128ea03 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:14.186008 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0539d7-3a04-479c-8598-dc499128ea03 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:14.186277 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0539d7-3a04-479c-8598-dc499128ea03 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:14.186908 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0539d7-3a04-479c-8598-dc499128ea03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:14.187208 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0539d7-3a04-479c-8598-dc499128ea03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:14.188648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0539d7-3a04-479c-8598-dc499128ea03 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:14.201340 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 611/1238] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:14.206924 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe14a10-d709-4d04-8da2-e23956f98373 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:14.305472 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe14a10-d709-4d04-8da2-e23956f98373 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:14.338872 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cac8f4-88c2-4d29-ab3c-08f62c331680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:14.339436 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cac8f4-88c2-4d29-ab3c-08f62c331680 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:14.339713 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cac8f4-88c2-4d29-ab3c-08f62c331680 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:14.339985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cac8f4-88c2-4d29-ab3c-08f62c331680 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:14.342734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:14.347854 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cac8f4-88c2-4d29-ab3c-08f62c331680 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:14.353984 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cac8f4-88c2-4d29-ab3c-08f62c331680 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:14.360111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-a2cac8f4-88c2-4d29-ab3c-08f62c331680 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 22:42:14.360111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:14.360111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:14.360111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:14.360111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:14.360111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:14.360111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:14.360111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:14.360111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:14.360111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:14.360111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:14.360111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:14.360111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:42:14.360111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:42:14.360111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:42:14.360111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:42:14.361213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:14.361213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:14.361213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:42:14.361213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:42:14.361213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:42:14.361213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:42:14.361213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:14.361213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:14.361213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:14.361213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:14.361213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:14.361213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:14.361213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:14.361213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:14.361213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:14.361213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:14.361213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:14.361213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:14.362412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:14.362412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:14.362412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:42:14.362412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:42:14.362412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:42:14.362412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:42:14.362412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:42:14.362412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:42:14.362412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 22:42:14.362412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:42:14.362412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 628/1239] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:42:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:14.367047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0539d7-3a04-479c-8598-dc499128ea03 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:14.466746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0539d7-3a04-479c-8598-dc499128ea03 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:14.501017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962087b3-5ed6-48d9-bad4-fbcfc4d29d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:14.501611 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962087b3-5ed6-48d9-bad4-fbcfc4d29d84 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:14.501886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962087b3-5ed6-48d9-bad4-fbcfc4d29d84 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:14.502157 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962087b3-5ed6-48d9-bad4-fbcfc4d29d84 None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:14.502868 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962087b3-5ed6-48d9-bad4-fbcfc4d29d84 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:14.503165 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962087b3-5ed6-48d9-bad4-fbcfc4d29d84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:14.504606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962087b3-5ed6-48d9-bad4-fbcfc4d29d84 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:14.523614 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 612/1240] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Sep 6 22:42:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:14.530043 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cac8f4-88c2-4d29-ab3c-08f62c331680 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:14.627843 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cac8f4-88c2-4d29-ab3c-08f62c331680 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:14.662754 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa316f6-382e-4a4b-81f2-080436852ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:14.663361 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa316f6-382e-4a4b-81f2-080436852ded None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:14.663640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa316f6-382e-4a4b-81f2-080436852ded None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:14.664018 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa316f6-382e-4a4b-81f2-080436852ded None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:14.730150 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:14.736604 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa316f6-382e-4a4b-81f2-080436852ded None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:14.738061 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa316f6-382e-4a4b-81f2-080436852ded None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:14.832534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 629/1241] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:42:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 22:42:14.838355 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962087b3-5ed6-48d9-bad4-fbcfc4d29d84 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:14.865874 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:14.935746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962087b3-5ed6-48d9-bad4-fbcfc4d29d84 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:14.969771 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe484a-ce30-4d95-a094-17e03ddd9fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:14.970391 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe484a-ce30-4d95-a094-17e03ddd9fd1 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:14.970668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe484a-ce30-4d95-a094-17e03ddd9fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:14.970933 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe484a-ce30-4d95-a094-17e03ddd9fd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:14.980593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe484a-ce30-4d95-a094-17e03ddd9fd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:14.982089 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe484a-ce30-4d95-a094-17e03ddd9fd1 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:14.996155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-95fe484a-ce30-4d95-a094-17e03ddd9fd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:14.996155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:14.996155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:14.996155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:14.996155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:14.996155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:14.996155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:14.996155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:14.996155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:14.996155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:14.996155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:14.996155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:14.996155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:42:14.996155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:42:14.996155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:42:14.996155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:42:14.997826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:14.997826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:14.997826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:14.997826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:14.997826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:14.997826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:14.997826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:14.997826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:14.997826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:14.997826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:14.997826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:14.997826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:14.997826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:14.997826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:14.997826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:14.997826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:14.997826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:42:14.998932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:42:14.998932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:14.998932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:14.998932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 613/1242] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:15.003702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa316f6-382e-4a4b-81f2-080436852ded None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:15.095820 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:15.101438 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa316f6-382e-4a4b-81f2-080436852ded None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:15.133887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a7ce0-9cbe-4f44-8212-f9766fe1f054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:15.134493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a7ce0-9cbe-4f44-8212-f9766fe1f054 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:15.134769 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a7ce0-9cbe-4f44-8212-f9766fe1f054 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:15.135040 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a7ce0-9cbe-4f44-8212-f9766fe1f054 None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:15.135670 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a7ce0-9cbe-4f44-8212-f9766fe1f054 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:15.135966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a7ce0-9cbe-4f44-8212-f9766fe1f054 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:15.137336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a7ce0-9cbe-4f44-8212-f9766fe1f054 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:15.148528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 630/1243] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:15.154482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe484a-ce30-4d95-a094-17e03ddd9fd1 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:15.233061 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:15.254612 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe484a-ce30-4d95-a094-17e03ddd9fd1 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:15.287023 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785803c-949e-4254-916f-f18bd84cb7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:15.287644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785803c-949e-4254-916f-f18bd84cb7cd None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:15.287921 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785803c-949e-4254-916f-f18bd84cb7cd None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:15.288246 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785803c-949e-4254-916f-f18bd84cb7cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:15.295120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785803c-949e-4254-916f-f18bd84cb7cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:15.296584 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785803c-949e-4254-916f-f18bd84cb7cd None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:15.308171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-3785803c-949e-4254-916f-f18bd84cb7cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:42:15.308171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:15.308171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:15.308171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:15.308171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:15.308171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:15.308171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:15.308171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:15.308171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:15.308171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:15.308171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:15.308171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:15.308171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:42:15.308171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:42:15.308171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:42:15.309198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:42:15.309198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:15.309198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:15.309198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:15.309198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:15.309198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:15.309198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:15.309198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:15.309198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:15.309198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:15.309198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:15.309198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:15.309198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:15.309198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:15.309198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:15.309198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:15.309198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:15.311392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:42:15.311392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:42:15.311392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:42:15.311392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:42:15.311392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:42:15.311392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:42:15.311392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:42:15.311392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:15.311392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 614/1244] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:42:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:15.315755 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a7ce0-9cbe-4f44-8212-f9766fe1f054 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:15.412381 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a7ce0-9cbe-4f44-8212-f9766fe1f054 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:15.445529 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1aa3c1-1e2e-4f9a-826c-4310789272e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:15.446128 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aa3c1-1e2e-4f9a-826c-4310789272e2 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:15.446405 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aa3c1-1e2e-4f9a-826c-4310789272e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:15.446918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aa3c1-1e2e-4f9a-826c-4310789272e2 None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:15.447612 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1aa3c1-1e2e-4f9a-826c-4310789272e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:15.447910 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1aa3c1-1e2e-4f9a-826c-4310789272e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:15.449361 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1aa3c1-1e2e-4f9a-826c-4310789272e2 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:15.461452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 631/1245] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:42:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:15.467814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785803c-949e-4254-916f-f18bd84cb7cd None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:15.568834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785803c-949e-4254-916f-f18bd84cb7cd None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:15.603759 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad91b9-81e7-4c73-8788-eec28a559d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:15.604556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad91b9-81e7-4c73-8788-eec28a559d05 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:15.604860 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad91b9-81e7-4c73-8788-eec28a559d05 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:15.605131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad91b9-81e7-4c73-8788-eec28a559d05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:15.605909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad91b9-81e7-4c73-8788-eec28a559d05 None admin] RBAC: Adding query filter params (role.id=85bcc17628d742209f79cc936d4290b5, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=4f6bd5bbbf65461990c9bb2747dbe5e9) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:15.606250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad91b9-81e7-4c73-8788-eec28a559d05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:15.608231 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad91b9-81e7-4c73-8788-eec28a559d05 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:15.614256 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 615/1246] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:42:15 2022] GET /identity/v3/role_assignments?user.id=4f6bd5bbbf65461990c9bb2747dbe5e9&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=85bcc17628d742209f79cc936d4290b5 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:17.809517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439e9ba-73eb-444e-858b-e22f9f53c352 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:17.810114 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439e9ba-73eb-444e-858b-e22f9f53c352 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:17.810114 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439e9ba-73eb-444e-858b-e22f9f53c352 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:17.811708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 632/1247] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:42:17.817004 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314609c-3347-4597-8b80-d4a874d04461 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:17.817547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314609c-3347-4597-8b80-d4a874d04461 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:17.817996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314609c-3347-4597-8b80-d4a874d04461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:17.824621 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:17.837203 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9314609c-3347-4597-8b80-d4a874d04461 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:42:17.838392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9314609c-3347-4597-8b80-d4a874d04461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:42:17.904846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 616/1248] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:42:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:42:18.171047 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439e9ba-73eb-444e-858b-e22f9f53c352 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:18.189659 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:18.271569 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439e9ba-73eb-444e-858b-e22f9f53c352 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:18.304694 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02460d13-587f-4898-8577-88cc477120b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:18.305316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02460d13-587f-4898-8577-88cc477120b8 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:18.305597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02460d13-587f-4898-8577-88cc477120b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:18.305869 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02460d13-587f-4898-8577-88cc477120b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:18.316373 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02460d13-587f-4898-8577-88cc477120b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:42:18.321295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-02460d13-587f-4898-8577-88cc477120b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:42:18.321295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:18.321295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:18.321295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:18.321295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:18.321295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:18.321295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:18.321295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:18.321295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:18.321295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:18.321295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:18.321295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:18.321295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:42:18.321295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:42:18.321295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:42:18.321295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:42:18.322583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:42:18.322583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:42:18.322583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:42:18.322583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:42:18.322583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:18.322583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:18.322583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:18.322583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:18.322583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:18.322583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:18.322583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:18.322583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:18.322583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:18.322583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:18.322583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:18.322583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:18.323432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:18.323432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:18.323432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:18.323432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:18.323432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:42:18.323432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:42:18.323432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:42:18.323432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:42:18.323432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:42:18.323432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:42:18.323432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:42:18.323432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:42:18.323432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 633/1249] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:42:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:18.328700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314609c-3347-4597-8b80-d4a874d04461 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:18.427968 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314609c-3347-4597-8b80-d4a874d04461 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:18.458903 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:18.463653 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c69df-8863-4c54-b49a-c06b4752cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:18.464268 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c69df-8863-4c54-b49a-c06b4752cfe9 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:18.464590 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c69df-8863-4c54-b49a-c06b4752cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:18.464866 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c69df-8863-4c54-b49a-c06b4752cfe9 None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:18.465533 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c69df-8863-4c54-b49a-c06b4752cfe9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:18.465834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c69df-8863-4c54-b49a-c06b4752cfe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:18.467203 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c69df-8863-4c54-b49a-c06b4752cfe9 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:18.475179 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 617/1250] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:42:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:18.481861 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02460d13-587f-4898-8577-88cc477120b8 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:18.557190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:18.579816 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02460d13-587f-4898-8577-88cc477120b8 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:18.612673 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc69513-0175-42a9-a5c5-1497f7b8ff69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:18.613300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc69513-0175-42a9-a5c5-1497f7b8ff69 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:18.613578 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc69513-0175-42a9-a5c5-1497f7b8ff69 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:18.613848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc69513-0175-42a9-a5c5-1497f7b8ff69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:18.624054 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc69513-0175-42a9-a5c5-1497f7b8ff69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:18.625519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc69513-0175-42a9-a5c5-1497f7b8ff69 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:18.639602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-9dc69513-0175-42a9-a5c5-1497f7b8ff69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:18.639602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:18.639602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:18.639602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:18.639602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:18.639602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:18.639602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:18.639602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:18.639602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:18.639602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:18.639602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:18.639602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:18.639602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:42:18.639602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:42:18.639602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:42:18.639602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:42:18.640689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:18.640689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:18.640689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:18.640689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:18.640689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:18.640689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:18.640689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:18.640689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:18.640689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:18.640689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:18.640689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:18.640689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:18.640689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:18.640689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:18.640689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:18.640689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:18.640689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:42:18.641785 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:42:18.641785 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:18.641785 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:42:18.641785 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 634/1251] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:18.646471 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c69df-8863-4c54-b49a-c06b4752cfe9 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:18.752966 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c69df-8863-4c54-b49a-c06b4752cfe9 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:18.785467 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0f3ed-e4c4-41e3-b256-80c1087b0316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:18.786060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0f3ed-e4c4-41e3-b256-80c1087b0316 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:18.786338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0f3ed-e4c4-41e3-b256-80c1087b0316 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:18.786609 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0f3ed-e4c4-41e3-b256-80c1087b0316 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:18.787240 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0f3ed-e4c4-41e3-b256-80c1087b0316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:18.787537 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0f3ed-e4c4-41e3-b256-80c1087b0316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:18.788939 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0f3ed-e4c4-41e3-b256-80c1087b0316 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:18.800745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 618/1252] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:18.806640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc69513-0175-42a9-a5c5-1497f7b8ff69 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:18.905388 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc69513-0175-42a9-a5c5-1497f7b8ff69 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:18.931280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:18.939060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c74dee-6a15-42ea-9884-30d2b13e8106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:18.939689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74dee-6a15-42ea-9884-30d2b13e8106 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:18.939961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74dee-6a15-42ea-9884-30d2b13e8106 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:18.940232 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74dee-6a15-42ea-9884-30d2b13e8106 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:18.947642 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c74dee-6a15-42ea-9884-30d2b13e8106 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:18.949094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c74dee-6a15-42ea-9884-30d2b13e8106 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:18.959806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-d4c74dee-6a15-42ea-9884-30d2b13e8106 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 22:42:18.959806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:18.959806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:18.959806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:18.959806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:18.959806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:18.959806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:18.959806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:18.959806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:18.959806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:18.959806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:18.959806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:18.959806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:42:18.959806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:42:18.959806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:42:18.959806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:42:18.961007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:18.961007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:18.961007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:42:18.961007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:42:18.961007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:42:18.961007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:42:18.961007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:18.961007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:18.961007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:18.961007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:18.961007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:18.961007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:18.961007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:18.961007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:18.961007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:18.961007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:18.961007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:18.961007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:18.962213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:18.962213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:18.962213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:42:18.962213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:42:18.962213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:42:18.962213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:42:18.962213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:42:18.962213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:42:18.962213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 22:42:18.962213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:42:18.962213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 635/1253] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:42:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:18.967673 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0f3ed-e4c4-41e3-b256-80c1087b0316 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:19.023077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:19.065439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0f3ed-e4c4-41e3-b256-80c1087b0316 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:19.100916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2aa08-6a2c-467e-b411-9598d909d21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:19.101528 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2aa08-6a2c-467e-b411-9598d909d21e None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:19.101806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2aa08-6a2c-467e-b411-9598d909d21e None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:19.102080 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2aa08-6a2c-467e-b411-9598d909d21e None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:19.102800 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2aa08-6a2c-467e-b411-9598d909d21e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:19.103105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2aa08-6a2c-467e-b411-9598d909d21e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:19.104560 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2aa08-6a2c-467e-b411-9598d909d21e None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:19.121794 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 619/1254] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Sep 6 22:42:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:19.127678 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c74dee-6a15-42ea-9884-30d2b13e8106 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:19.228375 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c74dee-6a15-42ea-9884-30d2b13e8106 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:19.261167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cf0f9-84f5-401d-818a-7c26bd1310d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:19.261774 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cf0f9-84f5-401d-818a-7c26bd1310d6 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:19.262051 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cf0f9-84f5-401d-818a-7c26bd1310d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:19.262850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cf0f9-84f5-401d-818a-7c26bd1310d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:19.316549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:19.329195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628cf0f9-84f5-401d-818a-7c26bd1310d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:19.330627 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628cf0f9-84f5-401d-818a-7c26bd1310d6 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:19.426040 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 636/1255] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:42:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 22:42:19.431871 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2aa08-6a2c-467e-b411-9598d909d21e None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:19.529185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2aa08-6a2c-467e-b411-9598d909d21e None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:19.541805 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:19.562247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b65dc8-daa4-4a23-a07a-56b83a32dbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:19.562870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65dc8-daa4-4a23-a07a-56b83a32dbc6 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:19.563150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65dc8-daa4-4a23-a07a-56b83a32dbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:19.563422 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65dc8-daa4-4a23-a07a-56b83a32dbc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:19.573269 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b65dc8-daa4-4a23-a07a-56b83a32dbc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:19.574664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b65dc8-daa4-4a23-a07a-56b83a32dbc6 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:19.589222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-54b65dc8-daa4-4a23-a07a-56b83a32dbc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:19.589222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:19.589222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:19.589222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:19.589222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:19.589222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:19.589222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:19.589222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:19.589222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:19.589222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:19.589222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:19.589222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:19.589222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:42:19.589222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:42:19.589222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:42:19.589222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:42:19.590412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:19.590412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:19.590412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:19.590412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:19.590412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:19.590412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:19.590412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:19.590412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:19.590412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:19.590412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:19.590412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:19.590412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:19.590412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:19.590412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:19.590412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:19.590412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:19.590412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:42:19.591548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:42:19.591548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:19.591548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:19.591548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 620/1256] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:19.596189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cf0f9-84f5-401d-818a-7c26bd1310d6 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:19.680021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:19.691945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cf0f9-84f5-401d-818a-7c26bd1310d6 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:19.725428 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be749c-6bf3-4b0b-bba6-17b9a5ce842a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:19.726037 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be749c-6bf3-4b0b-bba6-17b9a5ce842a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:19.726316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be749c-6bf3-4b0b-bba6-17b9a5ce842a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:19.726596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be749c-6bf3-4b0b-bba6-17b9a5ce842a None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:19.727235 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be749c-6bf3-4b0b-bba6-17b9a5ce842a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:19.727535 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be749c-6bf3-4b0b-bba6-17b9a5ce842a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:19.728985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be749c-6bf3-4b0b-bba6-17b9a5ce842a None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:19.740518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 637/1257] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:19.746176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b65dc8-daa4-4a23-a07a-56b83a32dbc6 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:19.845043 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b65dc8-daa4-4a23-a07a-56b83a32dbc6 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:19.879203 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b921f20-4a31-402f-beff-5c9d4d9172ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:19.879824 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b921f20-4a31-402f-beff-5c9d4d9172ff None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:19.880104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b921f20-4a31-402f-beff-5c9d4d9172ff None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:19.880375 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b921f20-4a31-402f-beff-5c9d4d9172ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:19.890454 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b921f20-4a31-402f-beff-5c9d4d9172ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:19.891905 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b921f20-4a31-402f-beff-5c9d4d9172ff None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:19.903141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-6b921f20-4a31-402f-beff-5c9d4d9172ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:42:19.903141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:19.903141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:19.903141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:19.903141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:19.903141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:19.903141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:19.903141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:19.903141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:19.903141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:19.903141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:19.903141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:19.903141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:42:19.903141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:42:19.903141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:42:19.904192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:42:19.904192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:19.904192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:19.904192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:19.904192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:19.904192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:19.904192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:19.904192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:19.904192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:19.904192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:19.904192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:19.904192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:19.904192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:19.904192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:19.904192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:19.904192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:19.904192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:19.905553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:42:19.905553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:42:19.905553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:42:19.905553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:42:19.905553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:42:19.905553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:42:19.905553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:42:19.905553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:19.905553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 621/1258] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:42:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:19.910137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be749c-6bf3-4b0b-bba6-17b9a5ce842a None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:20.008771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be749c-6bf3-4b0b-bba6-17b9a5ce842a None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:20.040932 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbf851-28df-4e85-941f-f40247e02128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:20.041536 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbf851-28df-4e85-941f-f40247e02128 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:20.041814 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbf851-28df-4e85-941f-f40247e02128 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:20.042082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbf851-28df-4e85-941f-f40247e02128 None admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:20.042761 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbf851-28df-4e85-941f-f40247e02128 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:20.043062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbf851-28df-4e85-941f-f40247e02128 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:20.045019 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbf851-28df-4e85-941f-f40247e02128 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:20.056502 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 638/1259] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:42:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:20.063181 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b921f20-4a31-402f-beff-5c9d4d9172ff None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:20.088495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:20.162169 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b921f20-4a31-402f-beff-5c9d4d9172ff None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:20.194835 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04811176-c6e2-4f66-9bdf-2eadae840583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:20.195432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04811176-c6e2-4f66-9bdf-2eadae840583 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:20.195708 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04811176-c6e2-4f66-9bdf-2eadae840583 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:20.195979 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04811176-c6e2-4f66-9bdf-2eadae840583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:20.197012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04811176-c6e2-4f66-9bdf-2eadae840583 None admin] RBAC: Adding query filter params (role.id=aa2332d1bdb74e48a88ed7c2a7ed2990, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=4f6bd5bbbf65461990c9bb2747dbe5e9) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:20.197313 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04811176-c6e2-4f66-9bdf-2eadae840583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:20.198741 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04811176-c6e2-4f66-9bdf-2eadae840583 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:20.204036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 622/1260] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:42:20 2022] GET /identity/v3/role_assignments?user.id=4f6bd5bbbf65461990c9bb2747dbe5e9&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:22.316796 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c63c0c-26f1-4129-907c-74c7b4d293a0 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:22.317358 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c63c0c-26f1-4129-907c-74c7b4d293a0 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:22.317358 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c63c0c-26f1-4129-907c-74c7b4d293a0 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:22.318803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 639/1261] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:42:22.324127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d3834-634e-4fee-885b-0f6a8d86b2ba None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:22.325098 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d3834-634e-4fee-885b-0f6a8d86b2ba None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:22.325236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d3834-634e-4fee-885b-0f6a8d86b2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:22.343986 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-945d3834-634e-4fee-885b-0f6a8d86b2ba None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:42:22.345130 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-945d3834-634e-4fee-885b-0f6a8d86b2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:42:22.410014 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 623/1262] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:42:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:42:22.673666 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c63c0c-26f1-4129-907c-74c7b4d293a0 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:22.684538 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:22.780128 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c63c0c-26f1-4129-907c-74c7b4d293a0 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:22.812852 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be538d9-f5df-421d-90a4-676df418c442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:22.813476 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be538d9-f5df-421d-90a4-676df418c442 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:22.813752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be538d9-f5df-421d-90a4-676df418c442 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:22.814021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be538d9-f5df-421d-90a4-676df418c442 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:22.825110 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be538d9-f5df-421d-90a4-676df418c442 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:42:22.829929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-2be538d9-f5df-421d-90a4-676df418c442 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:42:22.829929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:22.829929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:22.829929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:22.829929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:22.829929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:22.829929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:22.829929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:22.829929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:22.829929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:22.829929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:22.829929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:22.829929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:42:22.829929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:42:22.829929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:42:22.829929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:42:22.831020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:42:22.831020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:42:22.831020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:42:22.831020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:42:22.831020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:22.831020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:22.831020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:22.831020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:22.831020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:22.831020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:22.831020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:22.831020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:22.831020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:22.831020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:22.831020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:22.831020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:22.831945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:22.831945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:22.831945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:22.831945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:22.831945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:42:22.831945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:42:22.831945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:42:22.831945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:42:22.831945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:42:22.831945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:42:22.831945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:42:22.831945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:42:22.831945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 640/1263] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:42:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 22:42:22.837153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d3834-634e-4fee-885b-0f6a8d86b2ba None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:22.856616 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:22.935246 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d3834-634e-4fee-885b-0f6a8d86b2ba None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:22.970583 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91a697-b1bf-40d8-bea6-b6c8db9d1eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:22.971194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91a697-b1bf-40d8-bea6-b6c8db9d1eca None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:22.971473 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91a697-b1bf-40d8-bea6-b6c8db9d1eca None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:22.971745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91a697-b1bf-40d8-bea6-b6c8db9d1eca None admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:22.972410 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91a697-b1bf-40d8-bea6-b6c8db9d1eca None admin] RBAC: Adding query filter params (name=admin) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:22.972747 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91a697-b1bf-40d8-bea6-b6c8db9d1eca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:22.974350 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91a697-b1bf-40d8-bea6-b6c8db9d1eca None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:22.983353 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 624/1264] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:42:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:22.989684 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be538d9-f5df-421d-90a4-676df418c442 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:23.056216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:23.089172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be538d9-f5df-421d-90a4-676df418c442 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:23.123777 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86293e7-72c0-4418-8505-d3e77686ebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:23.124400 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86293e7-72c0-4418-8505-d3e77686ebbc None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:23.124725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86293e7-72c0-4418-8505-d3e77686ebbc None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:23.124992 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86293e7-72c0-4418-8505-d3e77686ebbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:23.135683 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86293e7-72c0-4418-8505-d3e77686ebbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:23.137753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86293e7-72c0-4418-8505-d3e77686ebbc None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:23.152556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-f86293e7-72c0-4418-8505-d3e77686ebbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:23.152556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:23.152556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:23.152556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:23.152556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:23.152556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:23.152556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:23.152556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:23.152556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:23.152556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:23.152556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:23.152556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:23.152556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:42:23.152556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:42:23.152556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:42:23.152556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:42:23.153693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:23.153693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:23.153693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:23.153693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:23.153693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:23.153693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:23.153693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:23.153693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:23.153693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:23.153693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:23.153693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:23.153693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:23.153693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:23.153693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:23.153693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:23.153693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:23.153693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:42:23.154657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:42:23.154657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:23.154657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:42:23.154657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 641/1265] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:23.159410 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91a697-b1bf-40d8-bea6-b6c8db9d1eca None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:23.238604 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:23.257778 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91a697-b1bf-40d8-bea6-b6c8db9d1eca None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:23.293203 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67269fc8-3364-4eb9-a3b7-c532fdace497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:23.293821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67269fc8-3364-4eb9-a3b7-c532fdace497 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:23.294098 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67269fc8-3364-4eb9-a3b7-c532fdace497 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:23.294368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67269fc8-3364-4eb9-a3b7-c532fdace497 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:23.295009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67269fc8-3364-4eb9-a3b7-c532fdace497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:23.295303 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67269fc8-3364-4eb9-a3b7-c532fdace497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:23.296718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67269fc8-3364-4eb9-a3b7-c532fdace497 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:23.308541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 625/1266] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:23.314676 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86293e7-72c0-4418-8505-d3e77686ebbc None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:23.412531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86293e7-72c0-4418-8505-d3e77686ebbc None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:23.431094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:23.444789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08c04e-48a0-4b82-beb1-76b2d69f7f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:23.445409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08c04e-48a0-4b82-beb1-76b2d69f7f23 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:23.445688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08c04e-48a0-4b82-beb1-76b2d69f7f23 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:23.445948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08c04e-48a0-4b82-beb1-76b2d69f7f23 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:23.453948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08c04e-48a0-4b82-beb1-76b2d69f7f23 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:23.455355 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08c04e-48a0-4b82-beb1-76b2d69f7f23 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:23.466598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-fc08c04e-48a0-4b82-beb1-76b2d69f7f23 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 22:42:23.466598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:23.466598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:23.466598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:23.466598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:23.466598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:23.466598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:23.466598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:23.466598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:23.466598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:23.466598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:23.466598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:23.466598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:42:23.466598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:42:23.466598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:42:23.466598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:42:23.467745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:23.467745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:23.467745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:42:23.467745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:42:23.467745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:42:23.467745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:42:23.467745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:23.467745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:23.467745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:23.467745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:23.467745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:23.467745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:23.467745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:23.467745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:23.467745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:23.467745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:23.467745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:23.467745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:23.468941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:23.468941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:23.468941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:42:23.468941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:42:23.468941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:42:23.468941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:42:23.468941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:42:23.468941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:42:23.468941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 22:42:23.468941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:42:23.472317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 642/1267] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:42:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:23.473555 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67269fc8-3364-4eb9-a3b7-c532fdace497 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:23.570953 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67269fc8-3364-4eb9-a3b7-c532fdace497 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:23.607776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addbc84-8245-48df-a361-269d6e2afd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:23.608480 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addbc84-8245-48df-a361-269d6e2afd2d None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:23.608760 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addbc84-8245-48df-a361-269d6e2afd2d None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:23.609030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addbc84-8245-48df-a361-269d6e2afd2d None admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:23.609752 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addbc84-8245-48df-a361-269d6e2afd2d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:23.610053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addbc84-8245-48df-a361-269d6e2afd2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:23.611481 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addbc84-8245-48df-a361-269d6e2afd2d None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:23.620354 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:23.628763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 626/1268] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Sep 6 22:42:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:23.634698 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08c04e-48a0-4b82-beb1-76b2d69f7f23 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:23.733459 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08c04e-48a0-4b82-beb1-76b2d69f7f23 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:23.765885 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7c396-ae6c-4dbb-b643-b95f5ccbc1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:23.766515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7c396-ae6c-4dbb-b643-b95f5ccbc1d3 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:23.766788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7c396-ae6c-4dbb-b643-b95f5ccbc1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:23.767058 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7c396-ae6c-4dbb-b643-b95f5ccbc1d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:23.777206 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7c396-ae6c-4dbb-b643-b95f5ccbc1d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:23.779275 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7c396-ae6c-4dbb-b643-b95f5ccbc1d3 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:23.792908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-eac7c396-ae6c-4dbb-b643-b95f5ccbc1d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:23.792908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:23.792908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:23.792908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:23.792908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:23.792908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:23.792908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:23.792908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:23.792908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:23.792908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:23.792908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:23.792908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:23.792908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:42:23.792908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:42:23.792908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:42:23.792908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:42:23.801971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:23.801971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:23.801971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:23.801971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:23.801971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:23.801971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:23.801971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:23.801971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:23.801971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:23.801971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:23.801971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:23.801971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:23.801971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:23.801971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:23.801971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:23.801971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:23.801971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:42:23.803085 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:42:23.803085 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:23.803085 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:42:23.803085 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 643/1269] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:23.803373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addbc84-8245-48df-a361-269d6e2afd2d None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:23.901440 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addbc84-8245-48df-a361-269d6e2afd2d None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:23.936256 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004804a-dac4-4d82-a16c-c9850055977c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:23.936893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004804a-dac4-4d82-a16c-c9850055977c None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:23.939583 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004804a-dac4-4d82-a16c-c9850055977c None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:23.939583 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004804a-dac4-4d82-a16c-c9850055977c None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:23.939583 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004804a-dac4-4d82-a16c-c9850055977c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:23.939583 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004804a-dac4-4d82-a16c-c9850055977c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:23.939892 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004804a-dac4-4d82-a16c-c9850055977c None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:23.951637 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 627/1270] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:23.957301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7c396-ae6c-4dbb-b643-b95f5ccbc1d3 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:23.987778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:24.054776 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7c396-ae6c-4dbb-b643-b95f5ccbc1d3 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:24.088559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c06576-3a23-4aee-a705-6c19bbb4b9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:24.089189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c06576-3a23-4aee-a705-6c19bbb4b9af None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:24.089463 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c06576-3a23-4aee-a705-6c19bbb4b9af None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:24.089728 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c06576-3a23-4aee-a705-6c19bbb4b9af None admin] PATH_INFO: `/v3/projects/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:24.096089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c06576-3a23-4aee-a705-6c19bbb4b9af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:24.097542 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c06576-3a23-4aee-a705-6c19bbb4b9af None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:24.108166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-44c06576-3a23-4aee-a705-6c19bbb4b9af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:42:24.108166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:24.108166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:24.108166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:24.108166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:24.108166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:24.108166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:24.108166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:24.108166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:24.108166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:24.108166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:24.108166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:24.108166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:42:24.108166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:42:24.108166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:42:24.109211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:42:24.109211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:24.109211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:24.109211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:24.109211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:24.109211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:24.109211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:24.109211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:24.109211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:24.109211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:24.109211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:24.109211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:24.109211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:24.109211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:24.109211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:24.109211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:24.109211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:24.110386 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:42:24.110386 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:42:24.110386 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:42:24.110386 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:42:24.110386 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:42:24.110386 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:42:24.110386 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:42:24.110386 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:42:24.112567 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 644/1271] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:42:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:24.114932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004804a-dac4-4d82-a16c-c9850055977c None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:24.173240 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:24.216111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004804a-dac4-4d82-a16c-c9850055977c None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:24.250612 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a77453-a707-4005-8f60-db6d992ece45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:24.251227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a77453-a707-4005-8f60-db6d992ece45 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:24.251505 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a77453-a707-4005-8f60-db6d992ece45 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:24.251774 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a77453-a707-4005-8f60-db6d992ece45 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:24.252552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a77453-a707-4005-8f60-db6d992ece45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:24.252859 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a77453-a707-4005-8f60-db6d992ece45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:24.254418 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a77453-a707-4005-8f60-db6d992ece45 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:24.266911 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 628/1272] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:42:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:24.272972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c06576-3a23-4aee-a705-6c19bbb4b9af None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:24.362352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:24.370951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c06576-3a23-4aee-a705-6c19bbb4b9af None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:24.403648 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae821268-5245-4568-a7a6-01a59275eac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:24.404313 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae821268-5245-4568-a7a6-01a59275eac1 None admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:24.404622 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae821268-5245-4568-a7a6-01a59275eac1 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:24.404899 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae821268-5245-4568-a7a6-01a59275eac1 None admin] PATH_INFO: `/v3/projects/f5e78b142d654280b161a34cec0186cd/users/4f6bd5bbbf65461990c9bb2747dbe5e9/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:24.406780 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae821268-5245-4568-a7a6-01a59275eac1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5e78b142d654280b161a34cec0186cd, user_id=4f6bd5bbbf65461990c9bb2747dbe5e9, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:24.408206 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae821268-5245-4568-a7a6-01a59275eac1 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:24.494736 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 645/1273] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Sep 6 22:42:24 2022] PUT /identity/v3/projects/f5e78b142d654280b161a34cec0186cd/users/4f6bd5bbbf65461990c9bb2747dbe5e9/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:42:26.637348 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d08a3-53be-48fa-a4cf-fd904853e8c5 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:26.637874 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d08a3-53be-48fa-a4cf-fd904853e8c5 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:26.637874 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d08a3-53be-48fa-a4cf-fd904853e8c5 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:26.639204 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 629/1274] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:42:26.644461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf58b5a-992c-4186-a5db-f5c039097528 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:26.644839 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf58b5a-992c-4186-a5db-f5c039097528 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:26.645007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf58b5a-992c-4186-a5db-f5c039097528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:26.663339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-ebf58b5a-992c-4186-a5db-f5c039097528 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:42:26.664547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ebf58b5a-992c-4186-a5db-f5c039097528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:42:26.730740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 646/1275] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:42:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:42:26.999263 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d08a3-53be-48fa-a4cf-fd904853e8c5 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:27.099964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d08a3-53be-48fa-a4cf-fd904853e8c5 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:27.117092 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:27.133738 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11617da7-cbc9-45c1-9dce-b01155dc0746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:27.134366 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11617da7-cbc9-45c1-9dce-b01155dc0746 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:27.134644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11617da7-cbc9-45c1-9dce-b01155dc0746 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:27.134916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11617da7-cbc9-45c1-9dce-b01155dc0746 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:27.145274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11617da7-cbc9-45c1-9dce-b01155dc0746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 22:42:27.150009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-11617da7-cbc9-45c1-9dce-b01155dc0746 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:42:27.150009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:27.150009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:27.150009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:27.150009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:27.150009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:27.150009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:27.150009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:27.150009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:27.150009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:27.150009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:27.150009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:27.150009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 22:42:27.150009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 22:42:27.150009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 22:42:27.150009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 22:42:27.151120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 22:42:27.151120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 22:42:27.151120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 22:42:27.151120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 22:42:27.151120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:27.151120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:27.151120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:27.151120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:27.151120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:27.151120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:27.151120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:27.151120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:27.151120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:27.151120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:27.151120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:27.151120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:27.152164 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:27.152164 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:27.152164 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:27.152164 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:27.152164 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 22:42:27.152164 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 22:42:27.152164 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 22:42:27.152164 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 22:42:27.152164 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 22:42:27.152164 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 22:42:27.152164 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 22:42:27.152164 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:27.152164 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 630/1276] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Sep 6 22:42:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:27.157318 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf58b5a-992c-4186-a5db-f5c039097528 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:27.236728 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:27.254515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf58b5a-992c-4186-a5db-f5c039097528 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:27.286723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e215e23-a874-4b30-b199-b2eced1779ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:27.287329 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e215e23-a874-4b30-b199-b2eced1779ad None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:27.287608 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e215e23-a874-4b30-b199-b2eced1779ad None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:27.287880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e215e23-a874-4b30-b199-b2eced1779ad None admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:27.288586 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e215e23-a874-4b30-b199-b2eced1779ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:27.288886 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e215e23-a874-4b30-b199-b2eced1779ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:27.290247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e215e23-a874-4b30-b199-b2eced1779ad None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:27.298856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 647/1277] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Sep 6 22:42:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:27.304738 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11617da7-cbc9-45c1-9dce-b01155dc0746 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:27.403615 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11617da7-cbc9-45c1-9dce-b01155dc0746 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:27.437552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3282e8-08d5-49e1-af0a-53e03d27fbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:27.438196 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3282e8-08d5-49e1-af0a-53e03d27fbda None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:27.438476 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3282e8-08d5-49e1-af0a-53e03d27fbda None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:27.438752 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3282e8-08d5-49e1-af0a-53e03d27fbda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:27.448787 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3282e8-08d5-49e1-af0a-53e03d27fbda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:27.450260 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3282e8-08d5-49e1-af0a-53e03d27fbda None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:27.465607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-cd3282e8-08d5-49e1-af0a-53e03d27fbda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:27.465607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:27.465607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:27.465607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:27.465607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:27.465607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:27.465607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:27.465607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:27.465607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:27.465607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:27.465607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:27.465607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:27.465607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:42:27.465607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:42:27.465607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:42:27.465607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:42:27.466643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:27.466643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:27.466643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:27.466643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:27.466643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:27.466643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:27.466643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:27.466643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:27.466643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:27.466643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:27.466643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:27.466643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:27.466643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:27.466643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:27.466643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:27.466643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:27.466643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:42:27.467666 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:42:27.467666 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:27.467666 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:27.467666 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 631/1278] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:27.472542 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e215e23-a874-4b30-b199-b2eced1779ad None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:27.570095 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e215e23-a874-4b30-b199-b2eced1779ad None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:27.602759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f02a83-eb79-41b4-b80e-cfa5b90dbb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:27.603420 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f02a83-eb79-41b4-b80e-cfa5b90dbb8c None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:27.603707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f02a83-eb79-41b4-b80e-cfa5b90dbb8c None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:27.603978 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f02a83-eb79-41b4-b80e-cfa5b90dbb8c None admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:27.604644 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f02a83-eb79-41b4-b80e-cfa5b90dbb8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:27.604946 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f02a83-eb79-41b4-b80e-cfa5b90dbb8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:27.606893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f02a83-eb79-41b4-b80e-cfa5b90dbb8c None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:27.618354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 648/1279] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:27.624731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3282e8-08d5-49e1-af0a-53e03d27fbda None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:27.655232 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:27.722134 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3282e8-08d5-49e1-af0a-53e03d27fbda None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:27.756676 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46181f7d-f5eb-41d2-954d-94e16e279516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:27.757310 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46181f7d-f5eb-41d2-954d-94e16e279516 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:27.757595 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46181f7d-f5eb-41d2-954d-94e16e279516 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:27.757870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46181f7d-f5eb-41d2-954d-94e16e279516 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:27.765100 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46181f7d-f5eb-41d2-954d-94e16e279516 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:27.766531 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46181f7d-f5eb-41d2-954d-94e16e279516 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:27.778338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-46181f7d-f5eb-41d2-954d-94e16e279516 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 22:42:27.778338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:27.778338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:27.778338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:27.778338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:27.778338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:27.778338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:27.778338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:27.778338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:27.778338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:27.778338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:27.778338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:27.778338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 22:42:27.778338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 22:42:27.778338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 22:42:27.778338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 22:42:27.779552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:27.779552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:27.779552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 22:42:27.779552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:42:27.779552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 22:42:27.779552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 22:42:27.779552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:27.779552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:27.779552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:27.779552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:27.779552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:27.779552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:27.779552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:27.779552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:27.779552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:27.779552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:27.779552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:27.779552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:27.780562 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:27.780562 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:27.780562 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 22:42:27.780562 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 22:42:27.780562 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 22:42:27.780562 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 22:42:27.780562 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 22:42:27.780562 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 22:42:27.780562 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 22:42:27.780562 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:27.780562 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 632/1280] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:42:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:27.785389 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f02a83-eb79-41b4-b80e-cfa5b90dbb8c None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:27.789322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:27.880734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f02a83-eb79-41b4-b80e-cfa5b90dbb8c None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:27.913227 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3faba6c-91ea-449f-9cd4-2eeda34237bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:27.913833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faba6c-91ea-449f-9cd4-2eeda34237bb None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:27.914163 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faba6c-91ea-449f-9cd4-2eeda34237bb None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:27.914440 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faba6c-91ea-449f-9cd4-2eeda34237bb None admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:27.915157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3faba6c-91ea-449f-9cd4-2eeda34237bb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:27.915462 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3faba6c-91ea-449f-9cd4-2eeda34237bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:27.916916 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3faba6c-91ea-449f-9cd4-2eeda34237bb None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:27.935918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 649/1281] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Sep 6 22:42:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:27.941633 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46181f7d-f5eb-41d2-954d-94e16e279516 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:28.033522 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:28.042679 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46181f7d-f5eb-41d2-954d-94e16e279516 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:28.075708 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93278f66-9147-4969-80f0-5728b229d64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:28.076382 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93278f66-9147-4969-80f0-5728b229d64a None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:28.076694 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93278f66-9147-4969-80f0-5728b229d64a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:28.076970 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93278f66-9147-4969-80f0-5728b229d64a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:28.143232 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93278f66-9147-4969-80f0-5728b229d64a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:28.144665 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93278f66-9147-4969-80f0-5728b229d64a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:28.230941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:28.240853 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 633/1282] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Sep 6 22:42:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 22:42:28.246882 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3faba6c-91ea-449f-9cd4-2eeda34237bb None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:28.308257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:28.346231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3faba6c-91ea-449f-9cd4-2eeda34237bb None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:28.383696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22443ea0-33e5-41f5-a76c-9416cea2dd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:28.384352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22443ea0-33e5-41f5-a76c-9416cea2dd8a None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:28.384660 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22443ea0-33e5-41f5-a76c-9416cea2dd8a None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:28.384932 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22443ea0-33e5-41f5-a76c-9416cea2dd8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:28.396959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22443ea0-33e5-41f5-a76c-9416cea2dd8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:28.398373 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22443ea0-33e5-41f5-a76c-9416cea2dd8a None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:28.414547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-22443ea0-33e5-41f5-a76c-9416cea2dd8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:28.414547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:28.414547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:28.414547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:28.414547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:28.414547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:28.414547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:28.414547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:28.414547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:28.414547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:28.414547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:28.414547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:28.414547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 22:42:28.414547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 22:42:28.414547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 22:42:28.414547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 22:42:28.418076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:28.418076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:28.418076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:28.418076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:28.418076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:28.418076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:28.418076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:28.418076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:28.418076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:28.418076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:28.418076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:28.418076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:28.418076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:28.418076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:28.418076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:28.418076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:28.418076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 22:42:28.419230 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 22:42:28.419230 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 22:42:28.419230 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:42:28.419230 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 650/1283] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:28.421913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93278f66-9147-4969-80f0-5728b229d64a None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:28.531992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93278f66-9147-4969-80f0-5728b229d64a None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:28.568919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6da4a-39b0-4246-b716-d988d3112869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:28.569543 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6da4a-39b0-4246-b716-d988d3112869 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:28.569822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6da4a-39b0-4246-b716-d988d3112869 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:28.570093 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6da4a-39b0-4246-b716-d988d3112869 None admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:28.570752 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6da4a-39b0-4246-b716-d988d3112869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:28.571052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6da4a-39b0-4246-b716-d988d3112869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:28.572799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6da4a-39b0-4246-b716-d988d3112869 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:28.585400 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 634/1284] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Sep 6 22:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:28.592027 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22443ea0-33e5-41f5-a76c-9416cea2dd8a None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:28.696633 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22443ea0-33e5-41f5-a76c-9416cea2dd8a None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:28.710355 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:28.731359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9f923-ece8-4b24-9c56-b98ac23549d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:28.731995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9f923-ece8-4b24-9c56-b98ac23549d8 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:28.732276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9f923-ece8-4b24-9c56-b98ac23549d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:28.732615 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9f923-ece8-4b24-9c56-b98ac23549d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:28.739342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9f923-ece8-4b24-9c56-b98ac23549d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:28.740847 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9f923-ece8-4b24-9c56-b98ac23549d8 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:28.752103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application [None req-cba9f923-ece8-4b24-9c56-b98ac23549d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:42:28.752103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:28.752103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:28.752103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:28.752103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:28.752103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:28.752103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:28.752103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:28.752103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:28.752103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:28.752103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:28.752103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:28.752103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 22:42:28.752103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 22:42:28.752103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 22:42:28.754574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 22:42:28.754574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:28.754574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:28.754574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:28.754574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:28.754574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:28.754574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:28.754574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:28.754574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:28.754574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:28.754574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:28.754574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:28.754574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:28.754574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:28.754574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:28.754574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:28.754574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:28.755553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 22:42:28.755553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 22:42:28.755553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 22:42:28.755553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 22:42:28.755553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 22:42:28.755553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 22:42:28.755553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 22:42:28.755553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: ERROR keystone.server.flask.application Sep 06 22:42:28.755553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 651/1285] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Sep 6 22:42:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:28.759285 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6da4a-39b0-4246-b716-d988d3112869 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:28.814037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:28.865067 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6da4a-39b0-4246-b716-d988d3112869 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:28.898505 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47622cd-1bba-495e-bb42-52e8abfcbf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:28.899106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47622cd-1bba-495e-bb42-52e8abfcbf33 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:28.899380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47622cd-1bba-495e-bb42-52e8abfcbf33 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:28.899684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47622cd-1bba-495e-bb42-52e8abfcbf33 None admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:28.900365 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47622cd-1bba-495e-bb42-52e8abfcbf33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:28.900692 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47622cd-1bba-495e-bb42-52e8abfcbf33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:28.902785 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47622cd-1bba-495e-bb42-52e8abfcbf33 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:28.914316 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 635/1286] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Sep 6 22:42:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:28.920417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9f923-ece8-4b24-9c56-b98ac23549d8 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:29.017517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9f923-ece8-4b24-9c56-b98ac23549d8 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:29.049782 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb09a5-9c92-46e2-b678-582eb1b8e454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:29.050381 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb09a5-9c92-46e2-b678-582eb1b8e454 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:29.050660 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb09a5-9c92-46e2-b678-582eb1b8e454 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:29.050932 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb09a5-9c92-46e2-b678-582eb1b8e454 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:29.051649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb09a5-9c92-46e2-b678-582eb1b8e454 None admin] RBAC: Adding query filter params (role.id=aa2332d1bdb74e48a88ed7c2a7ed2990, scope.project.id=f5e78b142d654280b161a34cec0186cd, user.id=4f6bd5bbbf65461990c9bb2747dbe5e9) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:29.051952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb09a5-9c92-46e2-b678-582eb1b8e454 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:29.053398 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb09a5-9c92-46e2-b678-582eb1b8e454 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:29.059066 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 652/1287] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Sep 6 22:42:28 2022] GET /identity/v3/role_assignments?user.id=4f6bd5bbbf65461990c9bb2747dbe5e9&scope.project.id=f5e78b142d654280b161a34cec0186cd&role.id=aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:31.203812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9db08-2f64-4399-966e-749e0e8cf197 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:31.204357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9db08-2f64-4399-966e-749e0e8cf197 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:31.204357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9db08-2f64-4399-966e-749e0e8cf197 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:31.205700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 636/1288] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:42:31.210792 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2e091-ad79-4348-91bb-4762cc49d3a3 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:31.211214 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2e091-ad79-4348-91bb-4762cc49d3a3 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:31.211342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2e091-ad79-4348-91bb-4762cc49d3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:31.229397 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-38b2e091-ad79-4348-91bb-4762cc49d3a3 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:42:31.231112 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-38b2e091-ad79-4348-91bb-4762cc49d3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:42:31.260522 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:31.295714 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 653/1289] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:42:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:42:31.565333 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9db08-2f64-4399-966e-749e0e8cf197 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:31.664665 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9db08-2f64-4399-966e-749e0e8cf197 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:31.675097 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:31.698134 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7d9f8-fc7c-4201-bd4b-bf030a6134fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:31.699344 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7d9f8-fc7c-4201-bd4b-bf030a6134fa None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:31.699618 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7d9f8-fc7c-4201-bd4b-bf030a6134fa None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:31.699886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7d9f8-fc7c-4201-bd4b-bf030a6134fa None admin] PATH_INFO: `/v3/services/placement` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:31.700478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7d9f8-fc7c-4201-bd4b-bf030a6134fa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:31.701832 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7d9f8-fc7c-4201-bd4b-bf030a6134fa None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:31.710404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-c0e7d9f8-fc7c-4201-bd4b-bf030a6134fa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 22:42:31.710404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:31.710404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:42:31.710404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:42:31.710404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:42:31.710404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:42:31.710404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:42:31.710404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:42:31.710404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 22:42:31.710404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:31.710404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:42:31.710404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:31.710404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:31.710404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:31.710404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:31.710404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:31.710404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:31.715737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:31.715737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:31.715737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:31.715737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:31.715737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:31.715737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:31.715737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:42:31.715737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:42:31.715737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:42:31.715737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:42:31.715737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:31.715737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:31.715737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:31.715737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:31.715737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:31.715737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:31.716765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:31.716765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:31.716765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:31.716765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:31.716765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:31.716765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:31.716765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:31.716765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:31.716765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:31.716765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:31.716765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:42:31.716765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:42:31.716765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 22:42:31.716765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:31.716765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 637/1290] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Sep 6 22:42:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:31.717754 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2e091-ad79-4348-91bb-4762cc49d3a3 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:31.814085 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2e091-ad79-4348-91bb-4762cc49d3a3 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:31.847093 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d977ce-c30e-4820-8eb1-fdc93e786ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:31.847672 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d977ce-c30e-4820-8eb1-fdc93e786ccb None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:31.847965 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d977ce-c30e-4820-8eb1-fdc93e786ccb None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:31.848218 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d977ce-c30e-4820-8eb1-fdc93e786ccb None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:31.848872 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d977ce-c30e-4820-8eb1-fdc93e786ccb None admin] RBAC: Adding query filter params (name=placement) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:31.849172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d977ce-c30e-4820-8eb1-fdc93e786ccb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:31.850520 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d977ce-c30e-4820-8eb1-fdc93e786ccb None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:31.855703 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 654/1291] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Sep 6 22:42:31 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:42:31.861397 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7d9f8-fc7c-4201-bd4b-bf030a6134fa None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:31.958528 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7d9f8-fc7c-4201-bd4b-bf030a6134fa None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:31.991439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d882c-aa9c-4119-9049-889a29e92bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:31.992046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d882c-aa9c-4119-9049-889a29e92bcf None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:31.992325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d882c-aa9c-4119-9049-889a29e92bcf None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:31.992633 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d882c-aa9c-4119-9049-889a29e92bcf None admin] PATH_INFO: `/v3/services` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:31.993261 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d882c-aa9c-4119-9049-889a29e92bcf None admin] RBAC: Adding query filter params (type=placement) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:31.993563 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d882c-aa9c-4119-9049-889a29e92bcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:31.994938 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d882c-aa9c-4119-9049-889a29e92bcf None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:31.999824 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 638/1292] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Sep 6 22:42:31 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:34.113417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c74a1-099e-4732-8eb0-e1335def8f65 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:34.113858 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c74a1-099e-4732-8eb0-e1335def8f65 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:34.113952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c74a1-099e-4732-8eb0-e1335def8f65 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:34.115286 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 655/1293] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:42:34.120352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ad7ca-9faf-460d-9f87-3af312993432 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:34.120759 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ad7ca-9faf-460d-9f87-3af312993432 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:34.120936 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ad7ca-9faf-460d-9f87-3af312993432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:34.139256 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-774ad7ca-9faf-460d-9f87-3af312993432 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:42:34.140466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-774ad7ca-9faf-460d-9f87-3af312993432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:42:34.169326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:34.207676 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 639/1294] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:42:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:42:34.472284 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c74a1-099e-4732-8eb0-e1335def8f65 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:34.503325 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:34.573671 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c74a1-099e-4732-8eb0-e1335def8f65 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:34.607800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a2fc7-9a46-4560-84e9-746b5a0af130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:34.608407 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a2fc7-9a46-4560-84e9-746b5a0af130 None admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:34.608720 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a2fc7-9a46-4560-84e9-746b5a0af130 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:34.608988 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a2fc7-9a46-4560-84e9-746b5a0af130 None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:34.612951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a2fc7-9a46-4560-84e9-746b5a0af130 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:34.612951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a2fc7-9a46-4560-84e9-746b5a0af130 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:34.694703 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 656/1295] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Sep 6 22:42:34 2022] POST /identity/v3/services => generated 246 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:42:36.832515 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e349386-7e6c-47e9-8633-642b7b69dea0 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:36.833099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e349386-7e6c-47e9-8633-642b7b69dea0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:36.833099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e349386-7e6c-47e9-8633-642b7b69dea0 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:36.834408 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 640/1296] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:42:36.840049 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70350bb2-135c-4b30-97c0-8459968e13bd None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:36.840573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70350bb2-135c-4b30-97c0-8459968e13bd None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:36.840677 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70350bb2-135c-4b30-97c0-8459968e13bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:36.859188 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-70350bb2-135c-4b30-97c0-8459968e13bd None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:42:36.860379 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-70350bb2-135c-4b30-97c0-8459968e13bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:42:36.931959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 657/1297] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:42:36 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:42:37.197645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e349386-7e6c-47e9-8633-642b7b69dea0 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:37.296978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e349386-7e6c-47e9-8633-642b7b69dea0 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:37.330278 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ee0cb-e189-4e77-8067-4e2da616c491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:37.330892 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ee0cb-e189-4e77-8067-4e2da616c491 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:37.331171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ee0cb-e189-4e77-8067-4e2da616c491 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:37.331443 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ee0cb-e189-4e77-8067-4e2da616c491 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:37.332022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ee0cb-e189-4e77-8067-4e2da616c491 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:37.333415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ee0cb-e189-4e77-8067-4e2da616c491 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:37.342624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-9c0ee0cb-e189-4e77-8067-4e2da616c491 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 22:42:37.342624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:37.342624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:42:37.342624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:42:37.342624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:42:37.342624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:42:37.342624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:42:37.342624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:42:37.342624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 22:42:37.342624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:37.342624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:42:37.342624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:37.342624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:37.342624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:37.342624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:37.342624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:37.342624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:37.343879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:37.343879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:37.343879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:37.343879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:37.343879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:37.343879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:37.343879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:42:37.343879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:42:37.343879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:42:37.343879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:42:37.343879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:37.343879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:37.343879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:37.343879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:37.343879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:37.343879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:37.344980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:37.344980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:37.344980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:37.344980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:37.344980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:37.344980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:37.344980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:37.344980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:37.344980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:37.344980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:37.344980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:42:37.344980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:42:37.344980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 22:42:37.344980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:37.344980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 641/1298] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Sep 6 22:42:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:37.349589 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70350bb2-135c-4b30-97c0-8459968e13bd None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:37.367741 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:37.446729 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70350bb2-135c-4b30-97c0-8459968e13bd None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:37.480287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ca67d-1647-4a7c-8f7e-d2590ea32a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:37.480924 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ca67d-1647-4a7c-8f7e-d2590ea32a01 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:37.481204 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ca67d-1647-4a7c-8f7e-d2590ea32a01 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:37.481475 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ca67d-1647-4a7c-8f7e-d2590ea32a01 None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:37.482143 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ca67d-1647-4a7c-8f7e-d2590ea32a01 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:37.482446 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ca67d-1647-4a7c-8f7e-d2590ea32a01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:37.483799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ca67d-1647-4a7c-8f7e-d2590ea32a01 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:37.488767 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 658/1299] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Sep 6 22:42:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:37.494805 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ee0cb-e189-4e77-8067-4e2da616c491 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:37.525458 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:37.591588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ee0cb-e189-4e77-8067-4e2da616c491 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:37.624881 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4967bc-bacd-4e88-965f-a97a2cdc0f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:37.625422 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4967bc-bacd-4e88-965f-a97a2cdc0f04 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:37.625701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4967bc-bacd-4e88-965f-a97a2cdc0f04 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:37.625974 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4967bc-bacd-4e88-965f-a97a2cdc0f04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:37.626671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4967bc-bacd-4e88-965f-a97a2cdc0f04 None admin] RBAC: Adding query filter params (interface=public, service_id=3967cc31ee9f4e64a3298bd0a66b96f9, region_id=RegionOne) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:37.626975 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4967bc-bacd-4e88-965f-a97a2cdc0f04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:37.628337 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4967bc-bacd-4e88-965f-a97a2cdc0f04 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:37.633267 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 642/1300] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Sep 6 22:42:37 2022] GET /identity/v3/endpoints?service_id=3967cc31ee9f4e64a3298bd0a66b96f9&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:37.639161 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ca67d-1647-4a7c-8f7e-d2590ea32a01 None admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:37.722330 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:37.740020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ca67d-1647-4a7c-8f7e-d2590ea32a01 None admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:37.772367 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bd159-0c6d-4657-8f5e-a9ca3fa6d271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:37.773011 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bd159-0c6d-4657-8f5e-a9ca3fa6d271 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:37.773291 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bd159-0c6d-4657-8f5e-a9ca3fa6d271 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:37.773564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bd159-0c6d-4657-8f5e-a9ca3fa6d271 None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:37.774160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bd159-0c6d-4657-8f5e-a9ca3fa6d271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:37.775503 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bd159-0c6d-4657-8f5e-a9ca3fa6d271 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:37.783157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 659/1301] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Sep 6 22:42:37 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:42:39.934169 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06926e10-c5ff-4fb8-952e-9501cc401fb7 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:39.934734 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06926e10-c5ff-4fb8-952e-9501cc401fb7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:39.934734 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06926e10-c5ff-4fb8-952e-9501cc401fb7 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:39.936037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 643/1302] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:42:39.941449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac90f93-3a4f-4999-86e7-15c378baec0c None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:39.944538 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac90f93-3a4f-4999-86e7-15c378baec0c None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:39.944538 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac90f93-3a4f-4999-86e7-15c378baec0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:39.960480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-1ac90f93-3a4f-4999-86e7-15c378baec0c None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:42:39.961667 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1ac90f93-3a4f-4999-86e7-15c378baec0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:42:40.028435 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 660/1303] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:42:39 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 22:42:40.297382 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06926e10-c5ff-4fb8-952e-9501cc401fb7 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:40.393447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:40.399994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06926e10-c5ff-4fb8-952e-9501cc401fb7 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:40.433636 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3fe21-f256-4653-8729-1755a620f237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:40.434259 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3fe21-f256-4653-8729-1755a620f237 None admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:40.434538 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3fe21-f256-4653-8729-1755a620f237 None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:40.434812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3fe21-f256-4653-8729-1755a620f237 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:40.435392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3fe21-f256-4653-8729-1755a620f237 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:40.436792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3fe21-f256-4653-8729-1755a620f237 None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:40.445465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application [None req-75d3fe21-f256-4653-8729-1755a620f237 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 22:42:40.445465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:40.445465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 22:42:40.445465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 22:42:40.445465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 22:42:40.445465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 22:42:40.445465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 22:42:40.445465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:42:40.445465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 22:42:40.445465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:40.445465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 22:42:40.445465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:40.445465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 22:42:40.445465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 22:42:40.445465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 22:42:40.445465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 22:42:40.445465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 22:42:40.446784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 22:42:40.446784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 22:42:40.446784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 22:42:40.446784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 22:42:40.446784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 22:42:40.446784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 22:42:40.446784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 22:42:40.446784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 22:42:40.446784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 22:42:40.446784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 22:42:40.446784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 22:42:40.446784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 22:42:40.446784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 22:42:40.446784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 22:42:40.446784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 22:42:40.446784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 22:42:40.447817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 22:42:40.447817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application with Lock( Sep 06 22:42:40.447817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 22:42:40.447817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self._enter() Sep 06 22:42:40.447817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 22:42:40.447817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 22:42:40.447817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 22:42:40.447817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application return self.creator() Sep 06 22:42:40.447817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 22:42:40.447817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application created_value = creator( Sep 06 22:42:40.447817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 22:42:40.447817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 22:42:40.447817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 22:42:40.447817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: ERROR keystone.server.flask.application Sep 06 22:42:40.447817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 644/1304] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Sep 6 22:42:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 22:42:40.453465 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac90f93-3a4f-4999-86e7-15c378baec0c None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:40.527293 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:40.549224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac90f93-3a4f-4999-86e7-15c378baec0c None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:40.582926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afc68c-aaa9-48d2-bc8c-44d6e6a029b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:40.583538 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afc68c-aaa9-48d2-bc8c-44d6e6a029b4 None admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:40.583820 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afc68c-aaa9-48d2-bc8c-44d6e6a029b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:40.584097 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afc68c-aaa9-48d2-bc8c-44d6e6a029b4 None admin] PATH_INFO: `/v3/services` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:40.584752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afc68c-aaa9-48d2-bc8c-44d6e6a029b4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:42:40.585058 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afc68c-aaa9-48d2-bc8c-44d6e6a029b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:40.586417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afc68c-aaa9-48d2-bc8c-44d6e6a029b4 None admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:40.591590 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 661/1305] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Sep 6 22:42:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:42:40.597329 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3fe21-f256-4653-8729-1755a620f237 None admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:42:40.697605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3fe21-f256-4653-8729-1755a620f237 None admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:42:40.731747 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d5778-a0e7-4fb8-8ca5-e4f9de4c435a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:42:40.732347 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d5778-a0e7-4fb8-8ca5-e4f9de4c435a None admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:42:40.732700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d5778-a0e7-4fb8-8ca5-e4f9de4c435a None admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:42:40.732981 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d5778-a0e7-4fb8-8ca5-e4f9de4c435a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:42:40.733660 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d5778-a0e7-4fb8-8ca5-e4f9de4c435a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:42:40.735038 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d5778-a0e7-4fb8-8ca5-e4f9de4c435a None admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:42:40.840749 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 645/1306] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:42:40 2022] POST /identity/v3/endpoints => generated 331 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:42:50.637508 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=30 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:50.835843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:48:51.935087 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ec82d-20b1-449e-ab95-96dba44c73c0 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:48:51.936044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ec82d-20b1-449e-ab95-96dba44c73c0 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:48:51.936330 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ec82d-20b1-449e-ab95-96dba44c73c0 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:48:51.937739 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 662/1307] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:48:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:48:51.943676 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1a64a-6d50-4627-9484-6da8d21336c1 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:48:51.944172 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1a64a-6d50-4627-9484-6da8d21336c1 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:48:51.944656 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1a64a-6d50-4627-9484-6da8d21336c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:48:52.032281 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c1f1a64a-6d50-4627-9484-6da8d21336c1 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:48:52.033851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c1f1a64a-6d50-4627-9484-6da8d21336c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:48:52.150282 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 646/1308] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:48:52.446139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5fae1-a76a-43b5-8890-2213eed62e97 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:48:52.446447 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5fae1-a76a-43b5-8890-2213eed62e97 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:48:52.446697 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5fae1-a76a-43b5-8890-2213eed62e97 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:48:52.448940 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 663/1309] 10.222.0.30 () {54 vars in 965 bytes} [Tue Sep 6 22:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:48:52.455735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4169e76-5ba8-4962-97ce-1a7b17fe5f21 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:48:52.456023 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4169e76-5ba8-4962-97ce-1a7b17fe5f21 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:48:52.456701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4169e76-5ba8-4962-97ce-1a7b17fe5f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:48:52.545998 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e4169e76-5ba8-4962-97ce-1a7b17fe5f21 None None] MFA Rules not processed for user `314bb14d5fa1414a832efb6d37c0446d`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:48:52.547340 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e4169e76-5ba8-4962-97ce-1a7b17fe5f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:48:52.569602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:48:52.629149 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 647/1310] 10.222.0.30 () {58 vars in 1062 bytes} [Tue Sep 6 22:48:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:48:52.638743 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5fae1-a76a-43b5-8890-2213eed62e97 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:48:52.640528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-cdf5fae1-a76a-43b5-8890-2213eed62e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:48:52.758771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5fae1-a76a-43b5-8890-2213eed62e97 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:48:52.837276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99458ab-f4e3-4b03-8ce0-9178c3318f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:48:52.837899 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99458ab-f4e3-4b03-8ce0-9178c3318f47 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:48:52.838233 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99458ab-f4e3-4b03-8ce0-9178c3318f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:48:52.838508 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99458ab-f4e3-4b03-8ce0-9178c3318f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:48:52.840155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f99458ab-f4e3-4b03-8ce0-9178c3318f47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:48:52.904054 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:48:52.973193 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99458ab-f4e3-4b03-8ce0-9178c3318f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:48:52.974638 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99458ab-f4e3-4b03-8ce0-9178c3318f47 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:48:52.997063 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 664/1311] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:48:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:48:55.468639 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f27b48-32dd-481f-ab82-03044a1a4f0f None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:48:55.469165 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f27b48-32dd-481f-ab82-03044a1a4f0f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:48:55.469165 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f27b48-32dd-481f-ab82-03044a1a4f0f None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:48:55.470522 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 648/1312] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:48:55.475908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dcf14-1f96-4925-8c99-3f8638582c17 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:48:55.476277 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dcf14-1f96-4925-8c99-3f8638582c17 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:48:55.476490 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dcf14-1f96-4925-8c99-3f8638582c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:48:55.556907 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-c17dcf14-1f96-4925-8c99-3f8638582c17 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:48:55.558637 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c17dcf14-1f96-4925-8c99-3f8638582c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:48:55.655637 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 665/1313] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:48:55.938881 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f27b48-32dd-481f-ab82-03044a1a4f0f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:48:55.940444 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e6f27b48-32dd-481f-ab82-03044a1a4f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:48:56.045833 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f27b48-32dd-481f-ab82-03044a1a4f0f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:48:56.116740 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:48:56.119306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22cb17-a076-4951-9781-ab81b22a43a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:48:56.119926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22cb17-a076-4951-9781-ab81b22a43a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:48:56.120207 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22cb17-a076-4951-9781-ab81b22a43a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:48:56.120515 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22cb17-a076-4951-9781-ab81b22a43a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:48:56.122120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3f22cb17-a076-4951-9781-ab81b22a43a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:48:56.229344 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22cb17-a076-4951-9781-ab81b22a43a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:48:56.230716 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22cb17-a076-4951-9781-ab81b22a43a9 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:48:56.248620 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 649/1314] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:48:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:48:58.886862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531d32a-3153-4945-9646-37f36c68800b None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:48:58.887399 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531d32a-3153-4945-9646-37f36c68800b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:48:58.887399 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531d32a-3153-4945-9646-37f36c68800b None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:48:58.888837 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 666/1315] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:48:58.894097 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcf050-bccf-478b-99eb-90968d105a20 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:48:58.894505 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcf050-bccf-478b-99eb-90968d105a20 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:48:58.894669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcf050-bccf-478b-99eb-90968d105a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:48:58.960293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-35dcf050-bccf-478b-99eb-90968d105a20 None None] MFA Rules not processed for user `5bdeea17b84e4c4e841735f505cd12e5`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:48:58.961519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-35dcf050-bccf-478b-99eb-90968d105a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:48:59.012577 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:48:59.056790 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 650/1316] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:48:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:48:59.340663 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531d32a-3153-4945-9646-37f36c68800b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:48:59.342222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b531d32a-3153-4945-9646-37f36c68800b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:48:59.351857 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:48:59.443341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531d32a-3153-4945-9646-37f36c68800b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:48:59.514917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cda49-6ed0-4096-bd77-a72b4d6d94d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:48:59.515518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cda49-6ed0-4096-bd77-a72b4d6d94d5 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:48:59.515796 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cda49-6ed0-4096-bd77-a72b4d6d94d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:48:59.516066 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cda49-6ed0-4096-bd77-a72b4d6d94d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:48:59.517692 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-272cda49-6ed0-4096-bd77-a72b4d6d94d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:48:59.577710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:48:59.624719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cda49-6ed0-4096-bd77-a72b4d6d94d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:48:59.626149 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cda49-6ed0-4096-bd77-a72b4d6d94d5 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:48:59.644338 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 667/1317] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:48:59 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:49:02.488869 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ea535-51fa-4b3d-b680-032ea08cb09b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:02.489393 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ea535-51fa-4b3d-b680-032ea08cb09b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:02.489393 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ea535-51fa-4b3d-b680-032ea08cb09b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:02.490674 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 651/1318] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:49:02.495889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2becedf-d3f3-4dbd-9c77-6433c740f990 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:02.496269 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2becedf-d3f3-4dbd-9c77-6433c740f990 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:02.496477 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2becedf-d3f3-4dbd-9c77-6433c740f990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:02.561457 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-b2becedf-d3f3-4dbd-9c77-6433c740f990 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:49:02.562648 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b2becedf-d3f3-4dbd-9c77-6433c740f990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:02.656974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 668/1319] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:49:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:49:02.944789 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ea535-51fa-4b3d-b680-032ea08cb09b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:49:02.946317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-313ea535-51fa-4b3d-b680-032ea08cb09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:03.050299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ea535-51fa-4b3d-b680-032ea08cb09b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:49:03.123074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a16c00-d6d8-4720-9ce3-90328029ecf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:49:03.123685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a16c00-d6d8-4720-9ce3-90328029ecf3 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:03.123958 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a16c00-d6d8-4720-9ce3-90328029ecf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:03.124230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a16c00-d6d8-4720-9ce3-90328029ecf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:03.125839 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a7a16c00-d6d8-4720-9ce3-90328029ecf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:03.133046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:03.231996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a16c00-d6d8-4720-9ce3-90328029ecf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:49:03.233485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a16c00-d6d8-4720-9ce3-90328029ecf3 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:49:03.251039 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 652/1320] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:49:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:49:06.360809 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151ce31-7769-4347-a6ec-b2480cf8f2b7 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:06.361310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151ce31-7769-4347-a6ec-b2480cf8f2b7 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:06.361310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151ce31-7769-4347-a6ec-b2480cf8f2b7 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:06.362833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 669/1321] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:49:06.367925 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6790d1e-6786-4a96-92f2-dc81fa4ab96b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:06.368317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6790d1e-6786-4a96-92f2-dc81fa4ab96b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:06.368629 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6790d1e-6786-4a96-92f2-dc81fa4ab96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:06.434765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c6790d1e-6786-4a96-92f2-dc81fa4ab96b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:49:06.435979 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c6790d1e-6786-4a96-92f2-dc81fa4ab96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:06.501741 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:06.548603 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 653/1322] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:49:06.824651 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151ce31-7769-4347-a6ec-b2480cf8f2b7 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:49:06.826295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4151ce31-7769-4347-a6ec-b2480cf8f2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:06.846264 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:06.931552 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151ce31-7769-4347-a6ec-b2480cf8f2b7 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:49:07.005310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f6c1b-6977-4a09-8000-cb49ac78784e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:49:07.005921 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f6c1b-6977-4a09-8000-cb49ac78784e service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:07.006202 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f6c1b-6977-4a09-8000-cb49ac78784e service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:07.006473 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f6c1b-6977-4a09-8000-cb49ac78784e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:07.008082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0c5f6c1b-6977-4a09-8000-cb49ac78784e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:07.081602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:07.119729 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f6c1b-6977-4a09-8000-cb49ac78784e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:49:07.121851 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f6c1b-6977-4a09-8000-cb49ac78784e service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:49:07.139564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 670/1323] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:49:09.338050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e89d8c-3597-4ac4-a3a8-ec2f6c629879 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:09.338553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e89d8c-3597-4ac4-a3a8-ec2f6c629879 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:09.338553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e89d8c-3597-4ac4-a3a8-ec2f6c629879 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:09.340417 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 654/1324] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:49:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:49:09.345738 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab3c7b-460b-409e-a263-c662bfe8f32e None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:09.346155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab3c7b-460b-409e-a263-c662bfe8f32e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:09.346326 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab3c7b-460b-409e-a263-c662bfe8f32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:09.412167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-38ab3c7b-460b-409e-a263-c662bfe8f32e None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:49:09.413413 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-38ab3c7b-460b-409e-a263-c662bfe8f32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:09.519261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 671/1325] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:49:09.804983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e89d8c-3597-4ac4-a3a8-ec2f6c629879 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:49:09.806508 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b1e89d8c-3597-4ac4-a3a8-ec2f6c629879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:09.913372 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e89d8c-3597-4ac4-a3a8-ec2f6c629879 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:49:09.990385 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5c8e4-7be4-4bb8-ad46-6886d5a91f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:49:09.991104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5c8e4-7be4-4bb8-ad46-6886d5a91f85 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:09.991465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5c8e4-7be4-4bb8-ad46-6886d5a91f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:09.991800 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5c8e4-7be4-4bb8-ad46-6886d5a91f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:09.993560 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-45b5c8e4-7be4-4bb8-ad46-6886d5a91f85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:10.012136 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:10.110974 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5c8e4-7be4-4bb8-ad46-6886d5a91f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:49:10.112346 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5c8e4-7be4-4bb8-ad46-6886d5a91f85 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:49:10.130703 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 655/1326] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:49:12.377047 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2914fda-bea3-45e0-836d-e19b0792a689 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:12.377534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2914fda-bea3-45e0-836d-e19b0792a689 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:12.377534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2914fda-bea3-45e0-836d-e19b0792a689 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:12.378868 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 672/1327] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:49:12.384013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1e4c0-1da4-41b2-953b-1cfe85ad3b1f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:12.384468 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1e4c0-1da4-41b2-953b-1cfe85ad3b1f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:12.384633 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1e4c0-1da4-41b2-953b-1cfe85ad3b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:12.450665 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-8ab1e4c0-1da4-41b2-953b-1cfe85ad3b1f None None] MFA Rules not processed for user `5bdeea17b84e4c4e841735f505cd12e5`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:49:12.451806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8ab1e4c0-1da4-41b2-953b-1cfe85ad3b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:12.518507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:12.550420 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 656/1328] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:49:12 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:49:12.830134 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2914fda-bea3-45e0-836d-e19b0792a689 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:49:12.831690 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-a2914fda-bea3-45e0-836d-e19b0792a689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:12.865525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:12.941891 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2914fda-bea3-45e0-836d-e19b0792a689 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:49:13.016804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416d87d-b385-4060-8fac-8fadc6126668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:49:13.017427 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416d87d-b385-4060-8fac-8fadc6126668 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:13.017711 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416d87d-b385-4060-8fac-8fadc6126668 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:13.017982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416d87d-b385-4060-8fac-8fadc6126668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:13.019596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3416d87d-b385-4060-8fac-8fadc6126668 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:13.097302 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:13.128828 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416d87d-b385-4060-8fac-8fadc6126668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:49:13.130262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416d87d-b385-4060-8fac-8fadc6126668 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:49:13.148137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 673/1329] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:49:12 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:49:15.730749 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8f639-3821-4d2d-a2b6-12d151f6aff0 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:15.731318 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8f639-3821-4d2d-a2b6-12d151f6aff0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:15.731318 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8f639-3821-4d2d-a2b6-12d151f6aff0 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:15.732625 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 657/1330] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:49:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:49:15.737702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c4a6d-10ec-4b46-9f62-2dd7f821c3c9 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:15.738097 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c4a6d-10ec-4b46-9f62-2dd7f821c3c9 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:15.738253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c4a6d-10ec-4b46-9f62-2dd7f821c3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:15.802848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-8d6c4a6d-10ec-4b46-9f62-2dd7f821c3c9 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:49:15.804079 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-8d6c4a6d-10ec-4b46-9f62-2dd7f821c3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:15.898484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 674/1331] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:49:16.186189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8f639-3821-4d2d-a2b6-12d151f6aff0 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:49:16.187726 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1ca8f639-3821-4d2d-a2b6-12d151f6aff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:16.289913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8f639-3821-4d2d-a2b6-12d151f6aff0 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:49:16.362138 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebad4b7-4243-455d-aea6-6a55c084e9bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:49:16.362681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebad4b7-4243-455d-aea6-6a55c084e9bc service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:16.362961 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebad4b7-4243-455d-aea6-6a55c084e9bc service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:16.363232 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebad4b7-4243-455d-aea6-6a55c084e9bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:16.364849 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cebad4b7-4243-455d-aea6-6a55c084e9bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:16.390807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:16.472087 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebad4b7-4243-455d-aea6-6a55c084e9bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:49:16.473556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebad4b7-4243-455d-aea6-6a55c084e9bc service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:49:16.491566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 658/1332] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:49:18.664826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51377e68-eaf5-49c2-8aa1-6f8ccf8d37b7 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:18.665385 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51377e68-eaf5-49c2-8aa1-6f8ccf8d37b7 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:18.665385 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51377e68-eaf5-49c2-8aa1-6f8ccf8d37b7 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:18.666725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 675/1333] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:49:18.672394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218a07-532c-4fb0-9255-c3bd19be1725 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:18.672855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218a07-532c-4fb0-9255-c3bd19be1725 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:18.672960 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218a07-532c-4fb0-9255-c3bd19be1725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:18.738230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-eb218a07-532c-4fb0-9255-c3bd19be1725 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:49:18.739345 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-eb218a07-532c-4fb0-9255-c3bd19be1725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:18.812390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:18.835246 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 659/1334] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:49:19.141422 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51377e68-eaf5-49c2-8aa1-6f8ccf8d37b7 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:49:19.142997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-51377e68-eaf5-49c2-8aa1-6f8ccf8d37b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:19.183019 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:19.245713 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51377e68-eaf5-49c2-8aa1-6f8ccf8d37b7 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:49:19.316269 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ae7db-c455-4eb4-8721-fb6f9667fdfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:49:19.316904 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ae7db-c455-4eb4-8721-fb6f9667fdfb service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:19.317181 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ae7db-c455-4eb4-8721-fb6f9667fdfb service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:19.317452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ae7db-c455-4eb4-8721-fb6f9667fdfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:19.319072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-424ae7db-c455-4eb4-8721-fb6f9667fdfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:19.403847 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:19.428411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ae7db-c455-4eb4-8721-fb6f9667fdfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:49:19.429856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ae7db-c455-4eb4-8721-fb6f9667fdfb service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:49:19.447704 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 676/1335] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:49:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:49:22.271563 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2678e-9145-4eeb-ae97-97dd7355687b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:22.272105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2678e-9145-4eeb-ae97-97dd7355687b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:22.272105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2678e-9145-4eeb-ae97-97dd7355687b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:22.273511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 660/1336] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:49:22.279116 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700d44a-c44b-439c-a5a0-92097dd0b512 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:22.279496 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700d44a-c44b-439c-a5a0-92097dd0b512 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:22.279674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700d44a-c44b-439c-a5a0-92097dd0b512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:22.344324 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-1700d44a-c44b-439c-a5a0-92097dd0b512 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:49:22.345551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1700d44a-c44b-439c-a5a0-92097dd0b512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:22.439234 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 677/1337] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:49:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:49:22.723129 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2678e-9145-4eeb-ae97-97dd7355687b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:49:22.724710 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b6d2678e-9145-4eeb-ae97-97dd7355687b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:22.826313 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2678e-9145-4eeb-ae97-97dd7355687b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:49:22.899176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790ab41-fd70-4a65-8faf-313e42517e76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:49:22.899785 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790ab41-fd70-4a65-8faf-313e42517e76 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:22.900136 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790ab41-fd70-4a65-8faf-313e42517e76 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:22.900448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790ab41-fd70-4a65-8faf-313e42517e76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:22.902091 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e790ab41-fd70-4a65-8faf-313e42517e76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:22.936909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:23.009216 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790ab41-fd70-4a65-8faf-313e42517e76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:49:23.011286 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790ab41-fd70-4a65-8faf-313e42517e76 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:49:23.030279 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 661/1338] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:49:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:49:27.336996 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff398d30-a914-4458-8dec-31818de68c23 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:27.337535 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff398d30-a914-4458-8dec-31818de68c23 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:27.337535 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff398d30-a914-4458-8dec-31818de68c23 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:27.339477 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 678/1339] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:49:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:49:27.345095 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c688b5-9eac-4fa6-8b16-4948fb55ed1c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:27.345480 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c688b5-9eac-4fa6-8b16-4948fb55ed1c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:27.345857 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c688b5-9eac-4fa6-8b16-4948fb55ed1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:27.411746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-22c688b5-9eac-4fa6-8b16-4948fb55ed1c None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:49:27.413090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-22c688b5-9eac-4fa6-8b16-4948fb55ed1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:27.499455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:27.511454 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 662/1340] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:49:27.796509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff398d30-a914-4458-8dec-31818de68c23 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:49:27.798048 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ff398d30-a914-4458-8dec-31818de68c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:27.848698 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:27.905962 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff398d30-a914-4458-8dec-31818de68c23 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:49:27.982753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f3b0c-ceef-4e03-9905-5c50cb5444f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:49:27.983364 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f3b0c-ceef-4e03-9905-5c50cb5444f9 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:27.983642 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f3b0c-ceef-4e03-9905-5c50cb5444f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:27.983910 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f3b0c-ceef-4e03-9905-5c50cb5444f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:27.985527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f18f3b0c-ceef-4e03-9905-5c50cb5444f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:28.081394 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:28.097981 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f3b0c-ceef-4e03-9905-5c50cb5444f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:49:28.099461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f3b0c-ceef-4e03-9905-5c50cb5444f9 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:49:28.118558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 679/1341] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:49:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:49:31.283121 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a83d9-f583-4a19-873a-1b0cbc1d4ee2 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:31.283636 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a83d9-f583-4a19-873a-1b0cbc1d4ee2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:31.283732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a83d9-f583-4a19-873a-1b0cbc1d4ee2 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:31.285041 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 663/1342] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:49:31.290354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f98c2-0687-4c81-b0d0-5ea6aa1f50ec None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:31.290794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f98c2-0687-4c81-b0d0-5ea6aa1f50ec None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:31.290919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f98c2-0687-4c81-b0d0-5ea6aa1f50ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:31.362369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-b02f98c2-0687-4c81-b0d0-5ea6aa1f50ec None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:49:31.363528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b02f98c2-0687-4c81-b0d0-5ea6aa1f50ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:31.463220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 680/1343] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:49:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:49:31.746045 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a83d9-f583-4a19-873a-1b0cbc1d4ee2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:49:31.747587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ef2a83d9-f583-4a19-873a-1b0cbc1d4ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:31.852236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a83d9-f583-4a19-873a-1b0cbc1d4ee2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:49:31.929206 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcb752-1ccc-4abf-8638-1817a0d165ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:49:31.929818 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcb752-1ccc-4abf-8638-1817a0d165ea service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:31.930095 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcb752-1ccc-4abf-8638-1817a0d165ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:31.930367 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcb752-1ccc-4abf-8638-1817a0d165ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:31.932084 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-78bcb752-1ccc-4abf-8638-1817a0d165ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:31.976123 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:32.049907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcb752-1ccc-4abf-8638-1817a0d165ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:49:32.056567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcb752-1ccc-4abf-8638-1817a0d165ea service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:49:32.075968 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 664/1344] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:49:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:49:36.485323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6c57f-cbed-4d34-9024-07de410d52c7 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:36.485797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6c57f-cbed-4d34-9024-07de410d52c7 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:36.485892 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6c57f-cbed-4d34-9024-07de410d52c7 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:36.487299 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 681/1345] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:49:36.492855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3b34b-60f9-48cf-a2e7-5f85da908950 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:36.493299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3b34b-60f9-48cf-a2e7-5f85da908950 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:36.493413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3b34b-60f9-48cf-a2e7-5f85da908950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:36.564768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f1f3b34b-60f9-48cf-a2e7-5f85da908950 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:49:36.565978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f1f3b34b-60f9-48cf-a2e7-5f85da908950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:36.675353 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:36.677935 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 665/1346] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:49:36.961163 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6c57f-cbed-4d34-9024-07de410d52c7 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:49:36.962926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d2c6c57f-cbed-4d34-9024-07de410d52c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:37.020683 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:37.066664 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6c57f-cbed-4d34-9024-07de410d52c7 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:49:37.140264 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84783e0e-91a9-4a5c-b76e-c071f897824a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:49:37.140906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84783e0e-91a9-4a5c-b76e-c071f897824a service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:37.141185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84783e0e-91a9-4a5c-b76e-c071f897824a service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:37.141455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84783e0e-91a9-4a5c-b76e-c071f897824a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:37.143040 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-84783e0e-91a9-4a5c-b76e-c071f897824a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:37.248043 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:37.251839 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84783e0e-91a9-4a5c-b76e-c071f897824a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:49:37.253482 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84783e0e-91a9-4a5c-b76e-c071f897824a service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:49:37.272780 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 682/1347] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:49:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:49:42.200289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4bff0-8119-4651-85f3-830c869a5940 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:42.200790 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4bff0-8119-4651-85f3-830c869a5940 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:42.200875 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4bff0-8119-4651-85f3-830c869a5940 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:42.204586 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 666/1348] 10.222.0.30 () {54 vars in 921 bytes} [Tue Sep 6 22:49:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:49:42.209910 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728f027-46ee-4f1d-a50a-d663d3a68d58 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:42.210855 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728f027-46ee-4f1d-a50a-d663d3a68d58 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:42.211139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728f027-46ee-4f1d-a50a-d663d3a68d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:42.323577 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-2728f027-46ee-4f1d-a50a-d663d3a68d58 None None] MFA Rules not processed for user `4f6bd5bbbf65461990c9bb2747dbe5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:49:42.325088 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-2728f027-46ee-4f1d-a50a-d663d3a68d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:42.489927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 683/1349] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Sep 6 22:49:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:49:46.651400 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e321b4-efc5-4824-90ad-9487fdb823e6 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:46.652000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e321b4-efc5-4824-90ad-9487fdb823e6 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:46.652000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e321b4-efc5-4824-90ad-9487fdb823e6 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:46.653317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 667/1350] 10.222.0.30 () {54 vars in 921 bytes} [Tue Sep 6 22:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:49:46.659395 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f09a94-697d-45e2-b05d-ea638039c818 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:46.659863 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f09a94-697d-45e2-b05d-ea638039c818 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:46.659967 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f09a94-697d-45e2-b05d-ea638039c818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:46.717140 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:46.740502 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-43f09a94-697d-45e2-b05d-ea638039c818 None None] MFA Rules not processed for user `4f6bd5bbbf65461990c9bb2747dbe5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:49:46.745600 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-43f09a94-697d-45e2-b05d-ea638039c818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:46.856463 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 684/1351] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Sep 6 22:49:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:49:48.235000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac549c6-ab0b-4c8d-b273-9e9d3aef3a26 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:48.235519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac549c6-ab0b-4c8d-b273-9e9d3aef3a26 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:48.235663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac549c6-ab0b-4c8d-b273-9e9d3aef3a26 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:48.237151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 668/1352] 10.222.0.30 () {54 vars in 921 bytes} [Tue Sep 6 22:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:49:48.242165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac0fc3-9f40-44d3-8819-9262c380bac5 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:48.242584 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac0fc3-9f40-44d3-8819-9262c380bac5 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:48.242711 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac0fc3-9f40-44d3-8819-9262c380bac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:48.321457 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-08ac0fc3-9f40-44d3-8819-9262c380bac5 None None] MFA Rules not processed for user `4f6bd5bbbf65461990c9bb2747dbe5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:49:48.323181 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-08ac0fc3-9f40-44d3-8819-9262c380bac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:48.364558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:48.434837 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 685/1353] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Sep 6 22:49:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:49:52.002842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c8128-0f2b-451b-b655-43961a660fc7 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:52.003414 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c8128-0f2b-451b-b655-43961a660fc7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:52.003618 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c8128-0f2b-451b-b655-43961a660fc7 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:52.010124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 669/1354] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:49:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:49:52.013858 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89322316-4836-4564-a3c7-9ece03092c8b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:52.014290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89322316-4836-4564-a3c7-9ece03092c8b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:52.014592 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89322316-4836-4564-a3c7-9ece03092c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:52.105186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-89322316-4836-4564-a3c7-9ece03092c8b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:49:52.106532 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-89322316-4836-4564-a3c7-9ece03092c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:52.216813 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 686/1355] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:49:52.522054 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b976e18-52e0-45e1-a6ee-1292a453de00 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:52.522783 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b976e18-52e0-45e1-a6ee-1292a453de00 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:52.523407 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b976e18-52e0-45e1-a6ee-1292a453de00 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:52.525332 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 670/1356] 10.222.0.30 () {54 vars in 962 bytes} [Tue Sep 6 22:49:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:49:52.533231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6022c9a-9ff8-4f54-b887-8354526de866 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:52.533779 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6022c9a-9ff8-4f54-b887-8354526de866 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:52.534505 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6022c9a-9ff8-4f54-b887-8354526de866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:52.566035 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:52.627598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-c6022c9a-9ff8-4f54-b887-8354526de866 None None] MFA Rules not processed for user `b18fd296138349408613004929144e70`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:49:52.629003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c6022c9a-9ff8-4f54-b887-8354526de866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:52.755698 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 687/1357] 10.222.0.30 () {58 vars in 1059 bytes} [Tue Sep 6 22:49:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:49:52.764197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b976e18-52e0-45e1-a6ee-1292a453de00 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:49:52.765949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6b976e18-52e0-45e1-a6ee-1292a453de00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:52.925090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b976e18-52e0-45e1-a6ee-1292a453de00 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:49:53.003974 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:53.044720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12602e2b-9496-42db-87b9-b5a58be2a9db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:49:53.045339 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12602e2b-9496-42db-87b9-b5a58be2a9db service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:53.045692 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12602e2b-9496-42db-87b9-b5a58be2a9db service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:53.046683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12602e2b-9496-42db-87b9-b5a58be2a9db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:53.048374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-12602e2b-9496-42db-87b9-b5a58be2a9db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:53.148415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12602e2b-9496-42db-87b9-b5a58be2a9db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:49:53.150045 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12602e2b-9496-42db-87b9-b5a58be2a9db service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:49:53.168731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 671/1358] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:49:55.557226 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa01ec-9f67-4afe-9051-336efbc02169 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:55.557668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa01ec-9f67-4afe-9051-336efbc02169 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:55.557865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa01ec-9f67-4afe-9051-336efbc02169 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:55.563541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 688/1359] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:49:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:49:55.571532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a53ec3-7a48-4ac4-aa17-0e1461d8441d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:55.571532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a53ec3-7a48-4ac4-aa17-0e1461d8441d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:55.571532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a53ec3-7a48-4ac4-aa17-0e1461d8441d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:55.662290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f9a53ec3-7a48-4ac4-aa17-0e1461d8441d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:49:55.663879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f9a53ec3-7a48-4ac4-aa17-0e1461d8441d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:55.707630 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:55.769462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 672/1360] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:49:56.061555 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa01ec-9f67-4afe-9051-336efbc02169 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:49:56.062558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7bfa01ec-9f67-4afe-9051-336efbc02169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:56.133793 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:56.237366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa01ec-9f67-4afe-9051-336efbc02169 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:49:56.372172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94daad2-05bd-45ee-9aeb-e308ecf9b771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:49:56.372891 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94daad2-05bd-45ee-9aeb-e308ecf9b771 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:56.373167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94daad2-05bd-45ee-9aeb-e308ecf9b771 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:56.373460 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94daad2-05bd-45ee-9aeb-e308ecf9b771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:56.375142 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-a94daad2-05bd-45ee-9aeb-e308ecf9b771 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:56.401829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:56.470294 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94daad2-05bd-45ee-9aeb-e308ecf9b771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:49:56.471928 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94daad2-05bd-45ee-9aeb-e308ecf9b771 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:49:56.490015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 689/1361] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:49:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:49:59.185700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfb757-17ab-43f1-aa86-8b2efd29b0b2 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:59.186217 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfb757-17ab-43f1-aa86-8b2efd29b0b2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:59.186330 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfb757-17ab-43f1-aa86-8b2efd29b0b2 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:59.187779 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 673/1362] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:49:59.192870 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bbd71-af2b-4445-b57d-56154352b96d None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:59.193288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bbd71-af2b-4445-b57d-56154352b96d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:59.193593 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bbd71-af2b-4445-b57d-56154352b96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:59.265288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-b61bbd71-af2b-4445-b57d-56154352b96d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:49:59.266518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b61bbd71-af2b-4445-b57d-56154352b96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:59.368830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:59.380831 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 690/1363] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:49:59.674559 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f5bc7-f4c7-4e12-ac3b-2f84edd2a37d None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:59.675078 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f5bc7-f4c7-4e12-ac3b-2f84edd2a37d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:59.675447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f5bc7-f4c7-4e12-ac3b-2f84edd2a37d None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:59.677117 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 674/1364] 10.222.0.30 () {54 vars in 962 bytes} [Tue Sep 6 22:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:49:59.682493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86aaa5-ce01-45d0-bb7f-eeee7297ac73 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:49:59.682788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86aaa5-ce01-45d0-bb7f-eeee7297ac73 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:49:59.683069 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86aaa5-ce01-45d0-bb7f-eeee7297ac73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:49:59.763322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-3f86aaa5-ce01-45d0-bb7f-eeee7297ac73 None None] MFA Rules not processed for user `b18fd296138349408613004929144e70`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:49:59.764582 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3f86aaa5-ce01-45d0-bb7f-eeee7297ac73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:49:59.896608 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 691/1365] 10.222.0.30 () {58 vars in 1059 bytes} [Tue Sep 6 22:49:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:49:59.902533 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f5bc7-f4c7-4e12-ac3b-2f84edd2a37d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:49:59.904294 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0b7f5bc7-f4c7-4e12-ac3b-2f84edd2a37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:00.067686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f5bc7-f4c7-4e12-ac3b-2f84edd2a37d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:50:00.099867 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:00.201576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640469-11bb-4b01-9aa4-222d7ef6b2b9 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:00.202157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640469-11bb-4b01-9aa4-222d7ef6b2b9 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:00.202298 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008af3b-508f-4d89-9c6a-3db75c133e17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:50:00.202686 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640469-11bb-4b01-9aa4-222d7ef6b2b9 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:00.202783 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008af3b-508f-4d89-9c6a-3db75c133e17 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:00.202881 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008af3b-508f-4d89-9c6a-3db75c133e17 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:00.203140 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008af3b-508f-4d89-9c6a-3db75c133e17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:00.204479 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 692/1366] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:50:00.205062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1008af3b-508f-4d89-9c6a-3db75c133e17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:00.209581 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ab533-4195-405c-9336-86ef923f5f7b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:00.209970 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ab533-4195-405c-9336-86ef923f5f7b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:00.210355 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ab533-4195-405c-9336-86ef923f5f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:00.272684 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:00.280730 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-7a9ab533-4195-405c-9336-86ef923f5f7b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:00.282963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7a9ab533-4195-405c-9336-86ef923f5f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:00.301329 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008af3b-508f-4d89-9c6a-3db75c133e17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:50:00.302963 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008af3b-508f-4d89-9c6a-3db75c133e17 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:50:00.324230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 675/1367] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:49:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:50:00.403408 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 693/1368] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:00.747264 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7347ebf-f8af-4264-ab4f-78f3fa69f8b2 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:00.747264 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7347ebf-f8af-4264-ab4f-78f3fa69f8b2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:00.747264 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7347ebf-f8af-4264-ab4f-78f3fa69f8b2 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:00.748950 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 676/1369] 10.222.0.30 () {54 vars in 964 bytes} [Tue Sep 6 22:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:50:00.753205 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c78c71-3b34-4f0f-83ee-6b3f8fcf2461 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:00.753563 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c78c71-3b34-4f0f-83ee-6b3f8fcf2461 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:00.753910 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c78c71-3b34-4f0f-83ee-6b3f8fcf2461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:00.833564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-70c78c71-3b34-4f0f-83ee-6b3f8fcf2461 None None] MFA Rules not processed for user `5ef596f83ce54fab8779e4e0f3899abc`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:00.834921 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-70c78c71-3b34-4f0f-83ee-6b3f8fcf2461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:00.914383 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:00.923427 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 694/1370] 10.222.0.30 () {58 vars in 1061 bytes} [Tue Sep 6 22:50:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:50:00.932881 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7347ebf-f8af-4264-ab4f-78f3fa69f8b2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:50:00.934431 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d7347ebf-f8af-4264-ab4f-78f3fa69f8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:00.967406 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:01.050784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7347ebf-f8af-4264-ab4f-78f3fa69f8b2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:50:01.136764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7ad8d-9803-40c2-b953-31cc1e3cbce8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:50:01.137191 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7ad8d-9803-40c2-b953-31cc1e3cbce8 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:01.137465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7ad8d-9803-40c2-b953-31cc1e3cbce8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:01.137735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7ad8d-9803-40c2-b953-31cc1e3cbce8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:01.139363 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5ec7ad8d-9803-40c2-b953-31cc1e3cbce8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:01.223941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:01.265134 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7ad8d-9803-40c2-b953-31cc1e3cbce8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:50:01.266664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7ad8d-9803-40c2-b953-31cc1e3cbce8 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:50:01.296753 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 677/1371] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:50:02.653147 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedb162-760e-400f-9d32-40b932b4d2c3 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:02.653682 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedb162-760e-400f-9d32-40b932b4d2c3 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:02.653682 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedb162-760e-400f-9d32-40b932b4d2c3 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:02.655057 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 695/1372] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:50:02.660207 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83add23f-d55d-4698-acc0-6a86d626f528 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:02.660638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83add23f-d55d-4698-acc0-6a86d626f528 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:02.660797 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83add23f-d55d-4698-acc0-6a86d626f528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:02.727658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-83add23f-d55d-4698-acc0-6a86d626f528 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:02.728903 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-83add23f-d55d-4698-acc0-6a86d626f528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:02.830858 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 678/1373] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:03.119101 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedb162-760e-400f-9d32-40b932b4d2c3 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:50:03.120883 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-8dedb162-760e-400f-9d32-40b932b4d2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:03.272149 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedb162-760e-400f-9d32-40b932b4d2c3 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:50:03.340219 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:03.389173 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff73450-6cd1-4f91-8f4e-aad5772a4be1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:50:03.389803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff73450-6cd1-4f91-8f4e-aad5772a4be1 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:03.390085 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff73450-6cd1-4f91-8f4e-aad5772a4be1 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:03.390352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff73450-6cd1-4f91-8f4e-aad5772a4be1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:03.391971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-2ff73450-6cd1-4f91-8f4e-aad5772a4be1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:03.486750 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff73450-6cd1-4f91-8f4e-aad5772a4be1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:50:03.488357 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff73450-6cd1-4f91-8f4e-aad5772a4be1 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:50:03.506742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 696/1374] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:50:05.845656 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377b5c0-75ff-4400-ae6f-898c280f60fe None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:05.846244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377b5c0-75ff-4400-ae6f-898c280f60fe None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:05.846244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377b5c0-75ff-4400-ae6f-898c280f60fe None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:05.851403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 679/1375] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:50:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:50:05.853390 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20de99-280e-47fe-8c0e-b0a2ff65e123 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:05.853819 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20de99-280e-47fe-8c0e-b0a2ff65e123 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:05.853924 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20de99-280e-47fe-8c0e-b0a2ff65e123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:05.923376 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-8a20de99-280e-47fe-8c0e-b0a2ff65e123 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:05.924624 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-8a20de99-280e-47fe-8c0e-b0a2ff65e123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:05.955437 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:06.023289 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 697/1376] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:06.312362 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377b5c0-75ff-4400-ae6f-898c280f60fe None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:50:06.314245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f377b5c0-75ff-4400-ae6f-898c280f60fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:06.353304 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:06.474233 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377b5c0-75ff-4400-ae6f-898c280f60fe None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:50:06.598947 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:06.607650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e74cd0-85cd-48d5-9c7f-bc65a9f1663f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:50:06.609667 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74cd0-85cd-48d5-9c7f-bc65a9f1663f service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:06.609667 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74cd0-85cd-48d5-9c7f-bc65a9f1663f service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:06.609667 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74cd0-85cd-48d5-9c7f-bc65a9f1663f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:06.611072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d0e74cd0-85cd-48d5-9c7f-bc65a9f1663f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:06.708664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e74cd0-85cd-48d5-9c7f-bc65a9f1663f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:50:06.710384 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e74cd0-85cd-48d5-9c7f-bc65a9f1663f service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:50:06.730811 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 680/1377] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:50:09.123559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c96bd6-b60f-413a-9e64-c4a515f495b0 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:09.124071 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c96bd6-b60f-413a-9e64-c4a515f495b0 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:09.124071 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c96bd6-b60f-413a-9e64-c4a515f495b0 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:09.129894 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 698/1378] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:50:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:50:09.135756 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047def98-8442-4036-a85f-0ebdcd1cf7b0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:09.136151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047def98-8442-4036-a85f-0ebdcd1cf7b0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:09.136590 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047def98-8442-4036-a85f-0ebdcd1cf7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:09.218497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-047def98-8442-4036-a85f-0ebdcd1cf7b0 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:09.219751 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-047def98-8442-4036-a85f-0ebdcd1cf7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:09.288527 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:09.321679 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 681/1379] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:09.614984 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c96bd6-b60f-413a-9e64-c4a515f495b0 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:50:09.617934 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-29c96bd6-b60f-413a-9e64-c4a515f495b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:09.800602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c96bd6-b60f-413a-9e64-c4a515f495b0 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:50:09.818390 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:09.924737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941e5ec-3162-424b-88ed-cfe7270bc0ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:50:09.925281 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941e5ec-3162-424b-88ed-cfe7270bc0ff service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:09.925559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941e5ec-3162-424b-88ed-cfe7270bc0ff service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:09.925834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941e5ec-3162-424b-88ed-cfe7270bc0ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:09.927453 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-a941e5ec-3162-424b-88ed-cfe7270bc0ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:10.018074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941e5ec-3162-424b-88ed-cfe7270bc0ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:50:10.019755 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941e5ec-3162-424b-88ed-cfe7270bc0ff service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:50:10.038212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 699/1380] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:50:12.865375 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d3564-f4fb-4171-9349-bbbe0af1f753 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:12.865899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d3564-f4fb-4171-9349-bbbe0af1f753 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:12.865899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d3564-f4fb-4171-9349-bbbe0af1f753 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:12.867842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 682/1381] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:50:12.873364 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4a7dc-b546-43a5-9b4c-b84a3811864d None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:12.873834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4a7dc-b546-43a5-9b4c-b84a3811864d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:12.873934 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4a7dc-b546-43a5-9b4c-b84a3811864d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:12.895674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:12.941416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-36b4a7dc-b546-43a5-9b4c-b84a3811864d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:12.942649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-36b4a7dc-b546-43a5-9b4c-b84a3811864d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:13.052634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 700/1382] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:13.341403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d3564-f4fb-4171-9349-bbbe0af1f753 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:50:13.342948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fa3d3564-f4fb-4171-9349-bbbe0af1f753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:13.493598 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d3564-f4fb-4171-9349-bbbe0af1f753 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:50:13.549696 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:13.616542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b1c06-27f4-418b-9cd2-281b4271e210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:50:13.617169 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b1c06-27f4-418b-9cd2-281b4271e210 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:13.617450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b1c06-27f4-418b-9cd2-281b4271e210 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:13.617724 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b1c06-27f4-418b-9cd2-281b4271e210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:13.619354 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cf2b1c06-27f4-418b-9cd2-281b4271e210 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:13.731387 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b1c06-27f4-418b-9cd2-281b4271e210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:50:13.733486 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b1c06-27f4-418b-9cd2-281b4271e210 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:50:13.753106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 683/1383] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:50:16.110503 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4c4e3-aa66-4ab7-acdd-f048e156a114 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:16.111004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4c4e3-aa66-4ab7-acdd-f048e156a114 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:16.111112 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4c4e3-aa66-4ab7-acdd-f048e156a114 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:16.112444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 701/1384] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:50:16.118348 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a638ed-a236-4c80-a6d7-be56e7917184 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:16.118766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a638ed-a236-4c80-a6d7-be56e7917184 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:16.118961 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a638ed-a236-4c80-a6d7-be56e7917184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:16.183716 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-05a638ed-a236-4c80-a6d7-be56e7917184 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:16.184936 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-05a638ed-a236-4c80-a6d7-be56e7917184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:16.193003 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:16.281640 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 684/1385] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:16.578188 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4c4e3-aa66-4ab7-acdd-f048e156a114 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:50:16.580068 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-04a4c4e3-aa66-4ab7-acdd-f048e156a114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:16.670731 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:16.726241 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4c4e3-aa66-4ab7-acdd-f048e156a114 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:50:16.870332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8a26b-dc1f-45dd-afc2-aa882a519029 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:50:16.870332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8a26b-dc1f-45dd-afc2-aa882a519029 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:16.870332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8a26b-dc1f-45dd-afc2-aa882a519029 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:16.870332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8a26b-dc1f-45dd-afc2-aa882a519029 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:16.870861 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-aab8a26b-dc1f-45dd-afc2-aa882a519029 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:16.895612 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37683e81-ed84-40bf-b431-f083e90ddc00 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:16.895929 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37683e81-ed84-40bf-b431-f083e90ddc00 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:16.896232 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37683e81-ed84-40bf-b431-f083e90ddc00 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:16.897709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 685/1386] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:50:16.903325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8b862-0725-470d-b851-15624ca6fd46 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:16.903754 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8b862-0725-470d-b851-15624ca6fd46 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:16.903935 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8b862-0725-470d-b851-15624ca6fd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:16.927561 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:16.962878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8a26b-dc1f-45dd-afc2-aa882a519029 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:50:16.964546 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8a26b-dc1f-45dd-afc2-aa882a519029 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:50:16.972374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-bbf8b862-0725-470d-b851-15624ca6fd46 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:16.973623 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bbf8b862-0725-470d-b851-15624ca6fd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:16.984198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 702/1387] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:50:17.060958 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:17.072072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 686/1388] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:50:17.375083 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0012ecd-e3e7-4aac-b711-ecdb166339a9 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:17.375583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0012ecd-e3e7-4aac-b711-ecdb166339a9 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:17.375760 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0012ecd-e3e7-4aac-b711-ecdb166339a9 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:17.377165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 703/1389] 10.222.0.30 () {54 vars in 961 bytes} [Tue Sep 6 22:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:50:17.382785 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff8eb7-4868-49cb-972d-c1e32e91b680 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:17.383224 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff8eb7-4868-49cb-972d-c1e32e91b680 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:17.383328 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff8eb7-4868-49cb-972d-c1e32e91b680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:17.460957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b5ff8eb7-4868-49cb-972d-c1e32e91b680 None None] MFA Rules not processed for user `4a2c1f1668814a5e9e654c6308fa0628`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:17.462079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b5ff8eb7-4868-49cb-972d-c1e32e91b680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:17.537555 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 687/1390] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Sep 6 22:50:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:17.547057 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0012ecd-e3e7-4aac-b711-ecdb166339a9 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:50:17.548795 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f0012ecd-e3e7-4aac-b711-ecdb166339a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:17.666488 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0012ecd-e3e7-4aac-b711-ecdb166339a9 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:50:17.741417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a875db5-759f-41df-9b11-79a1cfa2a507 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a2c1f1668814a5e9e654c6308fa0628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:50:17.741977 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a875db5-759f-41df-9b11-79a1cfa2a507 service glance] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:17.742253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a875db5-759f-41df-9b11-79a1cfa2a507 service glance] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:17.742524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a875db5-759f-41df-9b11-79a1cfa2a507 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:17.744099 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-5a875db5-759f-41df-9b11-79a1cfa2a507 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:17.752984 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:17.856158 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a875db5-759f-41df-9b11-79a1cfa2a507 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:50:17.857624 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a875db5-759f-41df-9b11-79a1cfa2a507 service glance] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:50:17.875506 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 704/1391] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:50:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:50:18.775685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac02613-21d2-4da8-b81d-5d98ffd0ebc8 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:18.776187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac02613-21d2-4da8-b81d-5d98ffd0ebc8 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:18.776293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac02613-21d2-4da8-b81d-5d98ffd0ebc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:18.844084 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3ac02613-21d2-4da8-b81d-5d98ffd0ebc8 None None] MFA Rules not processed for user `642d4bef7e9c459a8d2dde636094b528`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:18.845334 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3ac02613-21d2-4da8-b81d-5d98ffd0ebc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:18.880853 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:18.934119 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 688/1392] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Sep 6 22:50:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:18.979828 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c226699-ffe9-4fe6-9962-377c55ba9ec6 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:18.980342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c226699-ffe9-4fe6-9962-377c55ba9ec6 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:18.980470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c226699-ffe9-4fe6-9962-377c55ba9ec6 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:18.981827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 705/1393] 10.222.0.30 () {54 vars in 943 bytes} [Tue Sep 6 22:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:50:18.988840 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b737e-5263-4d8f-9b13-98e6aeebd54b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:18.989165 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b737e-5263-4d8f-9b13-98e6aeebd54b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:18.989448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b737e-5263-4d8f-9b13-98e6aeebd54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:19.066427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-148b737e-5263-4d8f-9b13-98e6aeebd54b None None] MFA Rules not processed for user `660248a90f524a43b143bae127e0eaa1`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:19.067637 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-148b737e-5263-4d8f-9b13-98e6aeebd54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:19.175875 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 689/1394] 10.222.0.30 () {58 vars in 1040 bytes} [Tue Sep 6 22:50:18 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:19.186170 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c226699-ffe9-4fe6-9962-377c55ba9ec6 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:50:19.187771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1c226699-ffe9-4fe6-9962-377c55ba9ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:19.297856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:19.299020 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdb6e8-40b2-4c22-a3be-6abfec8b1476 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:19.299309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdb6e8-40b2-4c22-a3be-6abfec8b1476 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:19.299581 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdb6e8-40b2-4c22-a3be-6abfec8b1476 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:19.300964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 690/1395] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:50:19.306137 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2535bbf-3b3f-4eb3-91e1-96a9e0b2ce67 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:19.306420 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2535bbf-3b3f-4eb3-91e1-96a9e0b2ce67 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:19.306697 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2535bbf-3b3f-4eb3-91e1-96a9e0b2ce67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:19.316555 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:19.326209 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c226699-ffe9-4fe6-9962-377c55ba9ec6 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:50:19.375134 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c2535bbf-3b3f-4eb3-91e1-96a9e0b2ce67 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:19.376346 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c2535bbf-3b3f-4eb3-91e1-96a9e0b2ce67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:19.433199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995f4be-0f3c-4eb4-9e8f-926ced0b2570 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660248a90f524a43b143bae127e0eaa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:50:19.433734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995f4be-0f3c-4eb4-9e8f-926ced0b2570 service swift] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:19.434011 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995f4be-0f3c-4eb4-9e8f-926ced0b2570 service swift] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:19.434282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995f4be-0f3c-4eb4-9e8f-926ced0b2570 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:19.435941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7995f4be-0f3c-4eb4-9e8f-926ced0b2570 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:19.473568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 691/1396] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:50:19.521377 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995f4be-0f3c-4eb4-9e8f-926ced0b2570 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:50:19.522974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995f4be-0f3c-4eb4-9e8f-926ced0b2570 service swift] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:50:19.531425 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 706/1397] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Sep 6 22:50:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 22:50:19.767068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2535bbf-3b3f-4eb3-91e1-96a9e0b2ce67 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:50:19.768303 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c2535bbf-3b3f-4eb3-91e1-96a9e0b2ce67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:19.852815 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:19.885962 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2535bbf-3b3f-4eb3-91e1-96a9e0b2ce67 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:50:20.009546 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704429c-22c8-49a7-baf3-3529462c996b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:50:20.010509 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704429c-22c8-49a7-baf3-3529462c996b service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:20.010792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704429c-22c8-49a7-baf3-3529462c996b service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:20.011075 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704429c-22c8-49a7-baf3-3529462c996b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:20.012727 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7704429c-22c8-49a7-baf3-3529462c996b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:20.100021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:20.112712 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704429c-22c8-49a7-baf3-3529462c996b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:50:20.114388 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704429c-22c8-49a7-baf3-3529462c996b service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:50:20.133246 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 692/1398] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:50:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:50:22.510991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35edeb1-8315-4b26-8338-69a3474cf339 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:22.511688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35edeb1-8315-4b26-8338-69a3474cf339 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:22.511688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35edeb1-8315-4b26-8338-69a3474cf339 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:22.516758 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 707/1399] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:50:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:50:22.518520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef0421-5706-4b1d-8069-bff753e3969d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:22.518973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef0421-5706-4b1d-8069-bff753e3969d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:22.519080 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef0421-5706-4b1d-8069-bff753e3969d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:22.619679 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9bef0421-5706-4b1d-8069-bff753e3969d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:22.620956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9bef0421-5706-4b1d-8069-bff753e3969d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:22.774066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 693/1400] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:23.076120 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35edeb1-8315-4b26-8338-69a3474cf339 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:50:23.077676 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b35edeb1-8315-4b26-8338-69a3474cf339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:23.092116 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:23.256942 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35edeb1-8315-4b26-8338-69a3474cf339 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:50:23.358782 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:23.396366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28b5c4-2951-4e92-a1a8-b972ba914440 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:50:23.397189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28b5c4-2951-4e92-a1a8-b972ba914440 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:23.401017 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28b5c4-2951-4e92-a1a8-b972ba914440 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:23.401017 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28b5c4-2951-4e92-a1a8-b972ba914440 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:23.401017 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4f28b5c4-2951-4e92-a1a8-b972ba914440 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:23.502356 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28b5c4-2951-4e92-a1a8-b972ba914440 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:50:23.503972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28b5c4-2951-4e92-a1a8-b972ba914440 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:50:23.524403 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 708/1401] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:50:25.890160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb3ce8-4522-4173-9b34-fe287be062b4 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:25.890726 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb3ce8-4522-4173-9b34-fe287be062b4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:25.890726 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb3ce8-4522-4173-9b34-fe287be062b4 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:25.892011 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 694/1402] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:50:25.897833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90b9fa-de0a-4124-809c-52412aee204a None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:25.898608 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90b9fa-de0a-4124-809c-52412aee204a None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:25.898914 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90b9fa-de0a-4124-809c-52412aee204a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:25.972339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-fc90b9fa-de0a-4124-809c-52412aee204a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:25.973609 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-fc90b9fa-de0a-4124-809c-52412aee204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:26.025751 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:26.080653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 709/1403] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:26.374301 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb3ce8-4522-4173-9b34-fe287be062b4 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:50:26.374301 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ccfb3ce8-4522-4173-9b34-fe287be062b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:26.440080 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:26.535661 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb3ce8-4522-4173-9b34-fe287be062b4 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:50:26.669426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4d8c0-bf33-4a15-9d2e-93c20c332b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:50:26.670058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4d8c0-bf33-4a15-9d2e-93c20c332b5e service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:26.670359 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4d8c0-bf33-4a15-9d2e-93c20c332b5e service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:26.670635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4d8c0-bf33-4a15-9d2e-93c20c332b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:26.672229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8cd4d8c0-bf33-4a15-9d2e-93c20c332b5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:26.694126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:26.770253 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4d8c0-bf33-4a15-9d2e-93c20c332b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:50:26.771891 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4d8c0-bf33-4a15-9d2e-93c20c332b5e service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:50:26.791895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 695/1404] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:50:29.199980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9973e3-64e9-4b1a-900b-40857491bba7 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:29.200788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9973e3-64e9-4b1a-900b-40857491bba7 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:29.200788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9973e3-64e9-4b1a-900b-40857491bba7 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:29.202058 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 710/1405] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:50:29.207470 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcc753-b084-4170-80b8-cbeb8d296a66 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:29.207880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcc753-b084-4170-80b8-cbeb8d296a66 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:29.208058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcc753-b084-4170-80b8-cbeb8d296a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:29.277810 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-24bcc753-b084-4170-80b8-cbeb8d296a66 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:29.279019 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-24bcc753-b084-4170-80b8-cbeb8d296a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:29.381228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:29.400245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 696/1406] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:29.675797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9973e3-64e9-4b1a-900b-40857491bba7 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:50:29.677356 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-dd9973e3-64e9-4b1a-900b-40857491bba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:29.840482 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9973e3-64e9-4b1a-900b-40857491bba7 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:50:29.879030 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:29.968686 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bea572-34b7-4daa-8dee-cbe8345d7c5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:50:29.969209 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bea572-34b7-4daa-8dee-cbe8345d7c5c service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:29.969487 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bea572-34b7-4daa-8dee-cbe8345d7c5c service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:29.969757 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bea572-34b7-4daa-8dee-cbe8345d7c5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:29.971353 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f7bea572-34b7-4daa-8dee-cbe8345d7c5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:30.066884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bea572-34b7-4daa-8dee-cbe8345d7c5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:50:30.068590 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bea572-34b7-4daa-8dee-cbe8345d7c5c service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:50:30.091313 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 711/1407] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:50:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:50:39.411274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:40.089890 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=84 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:43.654930 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48665544-e456-4cbf-bac3-c20a523a2016 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:43.655495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48665544-e456-4cbf-bac3-c20a523a2016 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:43.655495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48665544-e456-4cbf-bac3-c20a523a2016 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:43.656862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 697/1408] 10.222.0.30 () {54 vars in 918 bytes} [Tue Sep 6 22:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:50:43.661950 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca2710-ac7e-4e54-94ba-130b5a216c82 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:43.662891 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca2710-ac7e-4e54-94ba-130b5a216c82 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:43.663038 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca2710-ac7e-4e54-94ba-130b5a216c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:43.738270 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-4fca2710-ac7e-4e54-94ba-130b5a216c82 None None] MFA Rules not processed for user `4f6bd5bbbf65461990c9bb2747dbe5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:43.739471 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4fca2710-ac7e-4e54-94ba-130b5a216c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:43.847366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 712/1409] 10.222.0.30 () {58 vars in 1015 bytes} [Tue Sep 6 22:50:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:50:43.861538 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5a1d1-c729-445e-9a5a-5e74caadc845 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:43.861828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5a1d1-c729-445e-9a5a-5e74caadc845 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:43.862121 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5a1d1-c729-445e-9a5a-5e74caadc845 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:43.863462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 698/1410] 10.222.0.30 () {54 vars in 918 bytes} [Tue Sep 6 22:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:50:43.868862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601d058-37ed-41ca-9c02-1d2e595cf2dd None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:43.869152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601d058-37ed-41ca-9c02-1d2e595cf2dd None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:43.869437 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601d058-37ed-41ca-9c02-1d2e595cf2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:43.941621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:43.944838 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-5601d058-37ed-41ca-9c02-1d2e595cf2dd None None] MFA Rules not processed for user `b18fd296138349408613004929144e70`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:43.946054 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-5601d058-37ed-41ca-9c02-1d2e595cf2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:44.059295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 713/1411] 10.222.0.30 () {58 vars in 1015 bytes} [Tue Sep 6 22:50:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:46.587808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5763b6-92cf-4f29-97ed-cceb14661fa4 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:46.588353 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5763b6-92cf-4f29-97ed-cceb14661fa4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:46.588353 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5763b6-92cf-4f29-97ed-cceb14661fa4 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:46.589732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 699/1412] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 22:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:50:46.594895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ec374-88df-42e5-b8a1-b29706c989bd None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:46.595288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ec374-88df-42e5-b8a1-b29706c989bd None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:46.595442 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ec374-88df-42e5-b8a1-b29706c989bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:46.659751 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-ca7ec374-88df-42e5-b8a1-b29706c989bd None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:46.660971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ca7ec374-88df-42e5-b8a1-b29706c989bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:46.715746 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:46.757877 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 714/1413] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 22:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:47.043814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5763b6-92cf-4f29-97ed-cceb14661fa4 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:50:47.045392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4b5763b6-92cf-4f29-97ed-cceb14661fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:47.190584 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5763b6-92cf-4f29-97ed-cceb14661fa4 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:50:47.262457 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:47.303389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433f62c-13e7-456a-be3e-87aa713cd91b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:50:47.303944 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433f62c-13e7-456a-be3e-87aa713cd91b service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:47.304224 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433f62c-13e7-456a-be3e-87aa713cd91b service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:47.304527 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433f62c-13e7-456a-be3e-87aa713cd91b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:47.306124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8433f62c-13e7-456a-be3e-87aa713cd91b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:47.393052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433f62c-13e7-456a-be3e-87aa713cd91b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:50:47.394643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433f62c-13e7-456a-be3e-87aa713cd91b service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:50:47.412674 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 700/1414] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:50:48.542072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8580d-8d81-405e-95b3-a5fdb53a7c2e None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:48.542621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8580d-8d81-405e-95b3-a5fdb53a7c2e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:48.542734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8580d-8d81-405e-95b3-a5fdb53a7c2e None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:48.544013 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 715/1415] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 22:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:50:48.550183 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2f068-a82c-435d-b5b9-5a7738d9dd9a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:48.550651 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2f068-a82c-435d-b5b9-5a7738d9dd9a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:48.550753 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2f068-a82c-435d-b5b9-5a7738d9dd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:48.624820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-6da2f068-a82c-435d-b5b9-5a7738d9dd9a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:48.626016 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6da2f068-a82c-435d-b5b9-5a7738d9dd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:48.652302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:48.722542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 701/1416] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 22:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:48.873289 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8580d-8d81-405e-95b3-a5fdb53a7c2e None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:50:48.874871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-15e8580d-8d81-405e-95b3-a5fdb53a7c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:49.017125 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8580d-8d81-405e-95b3-a5fdb53a7c2e None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:50:49.056176 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:49.128521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d7721-1c0d-4a4d-be95-d28d6ef0b806 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:50:49.129130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d7721-1c0d-4a4d-be95-d28d6ef0b806 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:49.129406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d7721-1c0d-4a4d-be95-d28d6ef0b806 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:49.129673 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d7721-1c0d-4a4d-be95-d28d6ef0b806 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:49.131802 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-241d7721-1c0d-4a4d-be95-d28d6ef0b806 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:49.218292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d7721-1c0d-4a4d-be95-d28d6ef0b806 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:50:49.219977 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d7721-1c0d-4a4d-be95-d28d6ef0b806 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:50:49.237600 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 716/1417] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:50:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:50:50.368042 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e17e0-c55f-4051-ac6c-0b3936cac520 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:50.368648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e17e0-c55f-4051-ac6c-0b3936cac520 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:50.368648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e17e0-c55f-4051-ac6c-0b3936cac520 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:50.369872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 702/1418] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 22:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:50:50.375892 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38691ff9-86f0-44c8-b83a-8954363e7725 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:50.376296 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38691ff9-86f0-44c8-b83a-8954363e7725 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:50.376478 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38691ff9-86f0-44c8-b83a-8954363e7725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:50.430682 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:50.452288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-38691ff9-86f0-44c8-b83a-8954363e7725 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:50.453796 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-38691ff9-86f0-44c8-b83a-8954363e7725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:50.550227 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 717/1419] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 22:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:50.699467 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e17e0-c55f-4051-ac6c-0b3936cac520 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:50:50.700929 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5d0e17e0-c55f-4051-ac6c-0b3936cac520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:50.846806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e17e0-c55f-4051-ac6c-0b3936cac520 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:50:50.859000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:50.961031 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba28825-e9c4-4acc-9627-aa9630979854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:50:50.961547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba28825-e9c4-4acc-9627-aa9630979854 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:50.961825 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba28825-e9c4-4acc-9627-aa9630979854 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:50.962098 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba28825-e9c4-4acc-9627-aa9630979854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:50.963699 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4ba28825-e9c4-4acc-9627-aa9630979854 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:51.051718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba28825-e9c4-4acc-9627-aa9630979854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:50:51.054028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba28825-e9c4-4acc-9627-aa9630979854 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:50:51.072050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 703/1420] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:50:52.182856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26dd86-18e8-44a9-a458-10e00239863b None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:52.183441 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26dd86-18e8-44a9-a458-10e00239863b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:52.183441 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26dd86-18e8-44a9-a458-10e00239863b None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:52.185019 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 718/1421] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 22:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:50:52.192050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4a2d1-69c1-4c83-a108-325d92670d17 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:52.192610 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4a2d1-69c1-4c83-a108-325d92670d17 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:52.193636 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4a2d1-69c1-4c83-a108-325d92670d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:52.213992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:52.269520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-04f4a2d1-69c1-4c83-a108-325d92670d17 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:52.270646 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-04f4a2d1-69c1-4c83-a108-325d92670d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:52.364627 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 704/1422] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 22:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:52.515102 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26dd86-18e8-44a9-a458-10e00239863b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:50:52.516696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-cb26dd86-18e8-44a9-a458-10e00239863b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:52.627185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:52.662431 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26dd86-18e8-44a9-a458-10e00239863b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:50:52.773484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd6bcc-d5ee-47d3-a8fb-35f5182bdb04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:50:52.774099 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd6bcc-d5ee-47d3-a8fb-35f5182bdb04 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:52.774379 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd6bcc-d5ee-47d3-a8fb-35f5182bdb04 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:52.774715 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd6bcc-d5ee-47d3-a8fb-35f5182bdb04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:52.776326 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ccdd6bcc-d5ee-47d3-a8fb-35f5182bdb04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:52.856321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:52.870304 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd6bcc-d5ee-47d3-a8fb-35f5182bdb04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:50:52.871900 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd6bcc-d5ee-47d3-a8fb-35f5182bdb04 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:50:52.889950 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 719/1423] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:50:53.993851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddc2ac-2e72-42bd-8a51-83040cc5bb6c None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:53.994499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddc2ac-2e72-42bd-8a51-83040cc5bb6c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:53.994499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddc2ac-2e72-42bd-8a51-83040cc5bb6c None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:53.995827 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 705/1424] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 22:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:50:54.002234 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7e871-56c0-4c2b-b23b-f6acf246d2cf None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:54.002684 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7e871-56c0-4c2b-b23b-f6acf246d2cf None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:54.002787 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7e871-56c0-4c2b-b23b-f6acf246d2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:54.083082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-36e7e871-56c0-4c2b-b23b-f6acf246d2cf None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:54.085118 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-36e7e871-56c0-4c2b-b23b-f6acf246d2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:54.188176 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 720/1425] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 22:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:54.337053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddc2ac-2e72-42bd-8a51-83040cc5bb6c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:50:54.338488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-baddc2ac-2e72-42bd-8a51-83040cc5bb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:54.420942 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:54.487958 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddc2ac-2e72-42bd-8a51-83040cc5bb6c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:50:54.599835 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a2b5a-7487-4c67-ac55-f3b01d5c26bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:50:54.600364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a2b5a-7487-4c67-ac55-f3b01d5c26bc service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:54.600667 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a2b5a-7487-4c67-ac55-f3b01d5c26bc service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:54.600936 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a2b5a-7487-4c67-ac55-f3b01d5c26bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:54.602550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a71a2b5a-7487-4c67-ac55-f3b01d5c26bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:54.649383 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:54.688761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a2b5a-7487-4c67-ac55-f3b01d5c26bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:50:54.690356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a2b5a-7487-4c67-ac55-f3b01d5c26bc service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:50:54.709429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 706/1426] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:50:55.823467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f53e9-f8f6-4fe9-9ee3-75bd00f7a43a None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:55.824044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f53e9-f8f6-4fe9-9ee3-75bd00f7a43a None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:55.824044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f53e9-f8f6-4fe9-9ee3-75bd00f7a43a None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:55.825395 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 721/1427] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 22:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:50:55.831787 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d09d7f-878f-4ad0-8d65-63521041e0be None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:55.832229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d09d7f-878f-4ad0-8d65-63521041e0be None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:55.832395 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d09d7f-878f-4ad0-8d65-63521041e0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:55.908309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c8d09d7f-878f-4ad0-8d65-63521041e0be None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:55.909560 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c8d09d7f-878f-4ad0-8d65-63521041e0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:56.006465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 707/1428] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 22:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:56.155004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f53e9-f8f6-4fe9-9ee3-75bd00f7a43a None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:50:56.156558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b72f53e9-f8f6-4fe9-9ee3-75bd00f7a43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:56.204551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:56.299187 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f53e9-f8f6-4fe9-9ee3-75bd00f7a43a None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:50:56.409556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bde0de-bbcf-48b2-ba8a-e1f2a28c4495 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:50:56.410097 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bde0de-bbcf-48b2-ba8a-e1f2a28c4495 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:56.410373 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bde0de-bbcf-48b2-ba8a-e1f2a28c4495 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:56.410644 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bde0de-bbcf-48b2-ba8a-e1f2a28c4495 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:56.412756 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-55bde0de-bbcf-48b2-ba8a-e1f2a28c4495 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:56.419480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:56.501079 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bde0de-bbcf-48b2-ba8a-e1f2a28c4495 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:50:56.502689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bde0de-bbcf-48b2-ba8a-e1f2a28c4495 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:50:56.520295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 722/1429] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:50:57.638040 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25e9c9-493e-4cfc-a8a1-636eb623ef86 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:57.638606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25e9c9-493e-4cfc-a8a1-636eb623ef86 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:57.638606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25e9c9-493e-4cfc-a8a1-636eb623ef86 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:57.639950 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 708/1430] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 22:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:50:57.646739 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda875a-47e4-4408-a83e-1c300f1c3421 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:57.647196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda875a-47e4-4408-a83e-1c300f1c3421 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:57.647301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda875a-47e4-4408-a83e-1c300f1c3421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:57.721693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-1cda875a-47e4-4408-a83e-1c300f1c3421 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:57.722902 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1cda875a-47e4-4408-a83e-1c300f1c3421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:57.908016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:57.936817 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 723/1431] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 22:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:58.089092 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25e9c9-493e-4cfc-a8a1-636eb623ef86 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:50:58.090689 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fc25e9c9-493e-4cfc-a8a1-636eb623ef86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:58.108747 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:58.234779 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25e9c9-493e-4cfc-a8a1-636eb623ef86 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:50:58.319892 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:58.344711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee57b32-65bb-4c4d-9228-68d505a7ad53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:50:58.345316 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee57b32-65bb-4c4d-9228-68d505a7ad53 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:58.345595 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee57b32-65bb-4c4d-9228-68d505a7ad53 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:58.345867 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee57b32-65bb-4c4d-9228-68d505a7ad53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:58.348074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2ee57b32-65bb-4c4d-9228-68d505a7ad53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:58.435292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee57b32-65bb-4c4d-9228-68d505a7ad53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:50:58.436931 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee57b32-65bb-4c4d-9228-68d505a7ad53 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:50:58.455207 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 709/1432] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:50:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:50:59.551689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac936f2-dfbd-48f6-ae44-976a2c50f44b None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:59.552298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac936f2-dfbd-48f6-ae44-976a2c50f44b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:59.552298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac936f2-dfbd-48f6-ae44-976a2c50f44b None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:59.553609 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 724/1433] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 22:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:50:59.559672 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0b494-893b-4dff-9575-c485b43295bc None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:50:59.560127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0b494-893b-4dff-9575-c485b43295bc None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:50:59.560254 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0b494-893b-4dff-9575-c485b43295bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:50:59.636109 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c0a0b494-893b-4dff-9575-c485b43295bc None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:50:59.637324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c0a0b494-893b-4dff-9575-c485b43295bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:50:59.677949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:59.733322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 710/1434] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 22:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:50:59.883847 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac936f2-dfbd-48f6-ae44-976a2c50f44b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:50:59.885434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1ac936f2-dfbd-48f6-ae44-976a2c50f44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:00.025016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac936f2-dfbd-48f6-ae44-976a2c50f44b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:51:00.078314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:00.136992 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79bc3b-9e5d-4677-9a08-a4d265c43c90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:51:00.137534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79bc3b-9e5d-4677-9a08-a4d265c43c90 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:00.137810 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79bc3b-9e5d-4677-9a08-a4d265c43c90 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:00.138078 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79bc3b-9e5d-4677-9a08-a4d265c43c90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:00.139644 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9a79bc3b-9e5d-4677-9a08-a4d265c43c90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:00.226665 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79bc3b-9e5d-4677-9a08-a4d265c43c90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:51:00.228251 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79bc3b-9e5d-4677-9a08-a4d265c43c90 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:51:00.246210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 725/1435] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:51:01.359922 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f3f47-78b6-428b-b047-a8cc367a560f None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:01.360467 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f3f47-78b6-428b-b047-a8cc367a560f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:01.360467 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f3f47-78b6-428b-b047-a8cc367a560f None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:01.361798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 711/1436] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 22:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:51:01.368524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd47be6-8c98-435a-8f28-f3fa72552216 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:01.368958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd47be6-8c98-435a-8f28-f3fa72552216 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:01.369064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd47be6-8c98-435a-8f28-f3fa72552216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:01.447424 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-ebd47be6-8c98-435a-8f28-f3fa72552216 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:51:01.448658 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ebd47be6-8c98-435a-8f28-f3fa72552216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:01.450681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:01.545325 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 726/1437] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 22:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:51:01.696782 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f3f47-78b6-428b-b047-a8cc367a560f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:51:01.698216 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-302f3f47-78b6-428b-b047-a8cc367a560f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:01.841981 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f3f47-78b6-428b-b047-a8cc367a560f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:51:01.868602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:01.953438 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43cad0-80fd-4a81-8b02-ee38943008bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:51:01.953996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43cad0-80fd-4a81-8b02-ee38943008bf service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:01.954269 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43cad0-80fd-4a81-8b02-ee38943008bf service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:01.954534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43cad0-80fd-4a81-8b02-ee38943008bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:01.956124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1e43cad0-80fd-4a81-8b02-ee38943008bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:02.042360 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43cad0-80fd-4a81-8b02-ee38943008bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:51:02.043962 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43cad0-80fd-4a81-8b02-ee38943008bf service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:51:02.062030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 712/1438] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:51:04.119141 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1d7a7-343c-4a5d-a429-7f93e5585a74 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:04.119668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1d7a7-343c-4a5d-a429-7f93e5585a74 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:04.119668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1d7a7-343c-4a5d-a429-7f93e5585a74 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:04.121041 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 727/1439] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 22:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:51:04.126265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f890e09-420a-4777-bb3e-a352405d4b3b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:04.126651 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f890e09-420a-4777-bb3e-a352405d4b3b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:04.126818 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f890e09-420a-4777-bb3e-a352405d4b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:04.167746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:04.191744 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7f890e09-420a-4777-bb3e-a352405d4b3b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:51:04.192976 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7f890e09-420a-4777-bb3e-a352405d4b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:04.287971 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 713/1440] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 22:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:51:04.569737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1d7a7-343c-4a5d-a429-7f93e5585a74 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:51:04.571263 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-24c1d7a7-343c-4a5d-a429-7f93e5585a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:04.673151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1d7a7-343c-4a5d-a429-7f93e5585a74 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:51:04.704396 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:04.745979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb7acb-b523-4ace-914c-455f60c89001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:51:04.746591 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb7acb-b523-4ace-914c-455f60c89001 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:04.746873 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb7acb-b523-4ace-914c-455f60c89001 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:04.747143 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb7acb-b523-4ace-914c-455f60c89001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:04.748751 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-85bb7acb-b523-4ace-914c-455f60c89001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:04.860544 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb7acb-b523-4ace-914c-455f60c89001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:51:04.860544 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb7acb-b523-4ace-914c-455f60c89001 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:51:04.876647 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 728/1441] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:51:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:51:07.175376 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689ca89-1573-4581-ae9b-fe73c2cda90a None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:07.175898 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689ca89-1573-4581-ae9b-fe73c2cda90a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:07.175898 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689ca89-1573-4581-ae9b-fe73c2cda90a None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:07.177839 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 714/1442] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 22:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:51:07.183324 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91dce-f44a-4670-9914-9fc5e76f3763 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:07.183756 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91dce-f44a-4670-9914-9fc5e76f3763 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:07.183863 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91dce-f44a-4670-9914-9fc5e76f3763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:07.249983 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-92c91dce-f44a-4670-9914-9fc5e76f3763 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:51:07.251198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-92c91dce-f44a-4670-9914-9fc5e76f3763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:07.265754 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:07.352875 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 729/1443] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 22:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:51:07.635278 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689ca89-1573-4581-ae9b-fe73c2cda90a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:51:07.636854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0689ca89-1573-4581-ae9b-fe73c2cda90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:07.740982 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689ca89-1573-4581-ae9b-fe73c2cda90a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:51:07.752917 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:07.813347 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbe42e-c8c0-4674-8b07-0d9df1c4198d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:51:07.813962 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbe42e-c8c0-4674-8b07-0d9df1c4198d service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:07.814239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbe42e-c8c0-4674-8b07-0d9df1c4198d service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:07.814511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbe42e-c8c0-4674-8b07-0d9df1c4198d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:07.816104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8dbbe42e-c8c0-4674-8b07-0d9df1c4198d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:07.928014 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbe42e-c8c0-4674-8b07-0d9df1c4198d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:51:07.929435 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbe42e-c8c0-4674-8b07-0d9df1c4198d service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:51:07.947223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 715/1444] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:51:10.501835 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffec295-ff46-473d-bb56-2e614a35bddc None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:10.502356 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffec295-ff46-473d-bb56-2e614a35bddc None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:10.502475 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffec295-ff46-473d-bb56-2e614a35bddc None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:10.503729 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 730/1445] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 22:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:51:10.509047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173517d4-8c30-4d53-ae8e-83710a5dde18 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:10.509503 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173517d4-8c30-4d53-ae8e-83710a5dde18 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:10.509614 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173517d4-8c30-4d53-ae8e-83710a5dde18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:10.557959 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:10.575117 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-173517d4-8c30-4d53-ae8e-83710a5dde18 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:51:10.584975 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-173517d4-8c30-4d53-ae8e-83710a5dde18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:10.671330 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 716/1446] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 22:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:51:10.953735 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffec295-ff46-473d-bb56-2e614a35bddc None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:51:10.955274 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3ffec295-ff46-473d-bb56-2e614a35bddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:11.056983 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffec295-ff46-473d-bb56-2e614a35bddc None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:51:11.097199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:11.131175 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c515bab-94c8-4370-beb0-bbf82add268b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:51:11.131789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c515bab-94c8-4370-beb0-bbf82add268b service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:11.132068 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c515bab-94c8-4370-beb0-bbf82add268b service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:11.132340 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c515bab-94c8-4370-beb0-bbf82add268b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:11.133968 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0c515bab-94c8-4370-beb0-bbf82add268b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:11.239970 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c515bab-94c8-4370-beb0-bbf82add268b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:51:11.241352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c515bab-94c8-4370-beb0-bbf82add268b service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:51:11.259386 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 731/1447] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:51:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:51:13.529457 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9141526-251d-4ebe-b2c4-73b75e71d23b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:13.530017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9141526-251d-4ebe-b2c4-73b75e71d23b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:13.530017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9141526-251d-4ebe-b2c4-73b75e71d23b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:13.531358 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 717/1448] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 22:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:51:13.536770 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489013db-c99b-4249-aa51-8447cd696524 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:13.537207 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489013db-c99b-4249-aa51-8447cd696524 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:13.537312 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489013db-c99b-4249-aa51-8447cd696524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:13.602132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-489013db-c99b-4249-aa51-8447cd696524 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:51:13.603327 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-489013db-c99b-4249-aa51-8447cd696524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:13.623558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:13.697484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 732/1449] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 22:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:51:13.980202 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9141526-251d-4ebe-b2c4-73b75e71d23b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:51:13.981777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a9141526-251d-4ebe-b2c4-73b75e71d23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:14.085229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9141526-251d-4ebe-b2c4-73b75e71d23b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:51:14.105763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:14.159374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a1ea3-481d-4c33-a228-bbc1a02193b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:51:14.159919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a1ea3-481d-4c33-a228-bbc1a02193b5 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:14.160197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a1ea3-481d-4c33-a228-bbc1a02193b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:14.161057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a1ea3-481d-4c33-a228-bbc1a02193b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:14.162652 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-478a1ea3-481d-4c33-a228-bbc1a02193b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:14.269271 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a1ea3-481d-4c33-a228-bbc1a02193b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:51:14.271312 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a1ea3-481d-4c33-a228-bbc1a02193b5 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:51:14.288957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 718/1450] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:51:16.573773 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35809bd-56c7-496c-9701-9865ac348f3e None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:16.574343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35809bd-56c7-496c-9701-9865ac348f3e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:16.574343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35809bd-56c7-496c-9701-9865ac348f3e None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:16.575704 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 733/1451] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 22:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:51:16.581459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282674c-bad7-4252-9b30-aaa0147f88ad None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:16.581842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282674c-bad7-4252-9b30-aaa0147f88ad None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:16.582659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282674c-bad7-4252-9b30-aaa0147f88ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:16.646277 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:16.649154 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9282674c-bad7-4252-9b30-aaa0147f88ad None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:51:16.650367 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9282674c-bad7-4252-9b30-aaa0147f88ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:16.744876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 719/1452] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 22:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:51:17.031357 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35809bd-56c7-496c-9701-9865ac348f3e None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:51:17.032945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d35809bd-56c7-496c-9701-9865ac348f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:17.135970 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35809bd-56c7-496c-9701-9865ac348f3e None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:51:17.184295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:17.209162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabe01b-e7ee-4c33-9956-e34c72d0a45e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:51:17.209778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabe01b-e7ee-4c33-9956-e34c72d0a45e service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:17.210058 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabe01b-e7ee-4c33-9956-e34c72d0a45e service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:17.210331 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabe01b-e7ee-4c33-9956-e34c72d0a45e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:17.211925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-2fabe01b-e7ee-4c33-9956-e34c72d0a45e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:17.319076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabe01b-e7ee-4c33-9956-e34c72d0a45e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:51:17.320538 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabe01b-e7ee-4c33-9956-e34c72d0a45e service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:51:17.338772 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 734/1453] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:51:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:51:19.527456 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbb4f5-dd02-4477-aabd-8294c3f731f1 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:19.528028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbb4f5-dd02-4477-aabd-8294c3f731f1 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:19.528028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbb4f5-dd02-4477-aabd-8294c3f731f1 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:19.529396 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 720/1454] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 22:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:51:19.534650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ddef7-4ebf-4e09-90ad-234f7ca14eb6 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:19.535558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ddef7-4ebf-4e09-90ad-234f7ca14eb6 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:19.535714 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ddef7-4ebf-4e09-90ad-234f7ca14eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:19.600561 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-178ddef7-4ebf-4e09-90ad-234f7ca14eb6 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:51:19.601773 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-178ddef7-4ebf-4e09-90ad-234f7ca14eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:19.630447 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:19.699603 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 735/1455] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 22:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:51:19.979049 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbb4f5-dd02-4477-aabd-8294c3f731f1 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:51:19.980642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6fcbb4f5-dd02-4477-aabd-8294c3f731f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:20.082373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbb4f5-dd02-4477-aabd-8294c3f731f1 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:51:20.110416 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:20.154966 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd91b34-2020-4402-9fc0-aec6e79ca1af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:51:20.155569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd91b34-2020-4402-9fc0-aec6e79ca1af service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:20.155846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd91b34-2020-4402-9fc0-aec6e79ca1af service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:20.156117 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd91b34-2020-4402-9fc0-aec6e79ca1af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:20.157729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1bd91b34-2020-4402-9fc0-aec6e79ca1af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:20.265091 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd91b34-2020-4402-9fc0-aec6e79ca1af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:51:20.266534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd91b34-2020-4402-9fc0-aec6e79ca1af service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:51:20.284474 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 721/1456] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:51:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:51:22.486565 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a2e20-e3fc-446a-8343-c698e7af7295 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:22.487172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a2e20-e3fc-446a-8343-c698e7af7295 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:22.487172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a2e20-e3fc-446a-8343-c698e7af7295 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:22.489053 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 736/1457] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 22:51:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:51:22.494288 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7534abb-ffd3-4605-80f5-7afd44276afb None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:22.494670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7534abb-ffd3-4605-80f5-7afd44276afb None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:22.494835 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7534abb-ffd3-4605-80f5-7afd44276afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:22.560209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b7534abb-ffd3-4605-80f5-7afd44276afb None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:51:22.561450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b7534abb-ffd3-4605-80f5-7afd44276afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:22.569715 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:22.657498 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 722/1458] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 22:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:51:22.949971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a2e20-e3fc-446a-8343-c698e7af7295 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:51:22.951519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-dc5a2e20-e3fc-446a-8343-c698e7af7295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:23.057674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a2e20-e3fc-446a-8343-c698e7af7295 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:51:23.112523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:23.130573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1edcd-ee09-4f6f-a853-559007cdd96e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:51:23.131186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1edcd-ee09-4f6f-a853-559007cdd96e service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:23.131461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1edcd-ee09-4f6f-a853-559007cdd96e service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:23.131725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1edcd-ee09-4f6f-a853-559007cdd96e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:23.133357 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-fac1edcd-ee09-4f6f-a853-559007cdd96e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:23.239580 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1edcd-ee09-4f6f-a853-559007cdd96e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:51:23.240958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1edcd-ee09-4f6f-a853-559007cdd96e service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:51:23.259366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 737/1459] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:51:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:51:25.493710 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e666e7-4012-45bd-8498-9f0bf5daf961 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:25.494296 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e666e7-4012-45bd-8498-9f0bf5daf961 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:25.494296 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e666e7-4012-45bd-8498-9f0bf5daf961 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:25.495588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 723/1460] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 22:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:51:25.500986 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fd605-7a52-4715-8139-89c9cf2680ff None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:25.501424 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fd605-7a52-4715-8139-89c9cf2680ff None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:25.501562 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fd605-7a52-4715-8139-89c9cf2680ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:25.566349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-a03fd605-7a52-4715-8139-89c9cf2680ff None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:51:25.567593 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-a03fd605-7a52-4715-8139-89c9cf2680ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:25.605516 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:25.661916 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 738/1461] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 22:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:51:25.942316 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e666e7-4012-45bd-8498-9f0bf5daf961 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:51:25.943953 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-65e666e7-4012-45bd-8498-9f0bf5daf961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:26.045892 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e666e7-4012-45bd-8498-9f0bf5daf961 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:51:26.083632 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:26.119435 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3e12c-1dfa-4e2b-b692-244720eaadad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:51:26.120051 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3e12c-1dfa-4e2b-b692-244720eaadad service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:26.120331 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3e12c-1dfa-4e2b-b692-244720eaadad service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:26.120631 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3e12c-1dfa-4e2b-b692-244720eaadad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:26.122231 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6dc3e12c-1dfa-4e2b-b692-244720eaadad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:26.228975 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3e12c-1dfa-4e2b-b692-244720eaadad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:51:26.230384 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3e12c-1dfa-4e2b-b692-244720eaadad service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:51:26.249462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 724/1462] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:51:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:51:28.401207 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053de87-9f53-4506-944e-b2b91f022ac8 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:28.401749 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053de87-9f53-4506-944e-b2b91f022ac8 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:28.401749 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053de87-9f53-4506-944e-b2b91f022ac8 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:28.403097 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 739/1463] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 22:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:51:28.408521 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8239f-4a10-4cc6-94b5-01e255914c8c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:28.408927 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8239f-4a10-4cc6-94b5-01e255914c8c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:28.409073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8239f-4a10-4cc6-94b5-01e255914c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:28.474916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c3c8239f-4a10-4cc6-94b5-01e255914c8c None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:51:28.476117 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c3c8239f-4a10-4cc6-94b5-01e255914c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:28.494192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:28.571480 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 725/1464] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 22:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:51:28.859137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053de87-9f53-4506-944e-b2b91f022ac8 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:51:28.860736 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c053de87-9f53-4506-944e-b2b91f022ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:28.966546 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053de87-9f53-4506-944e-b2b91f022ac8 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:51:29.037847 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:29.044445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb687ac8-1e2d-408f-8c5e-c096142be38c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:51:29.047190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb687ac8-1e2d-408f-8c5e-c096142be38c service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:29.047190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb687ac8-1e2d-408f-8c5e-c096142be38c service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:29.047190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb687ac8-1e2d-408f-8c5e-c096142be38c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:29.047190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-cb687ac8-1e2d-408f-8c5e-c096142be38c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:29.155584 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb687ac8-1e2d-408f-8c5e-c096142be38c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:51:29.157054 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb687ac8-1e2d-408f-8c5e-c096142be38c service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:51:29.175017 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 740/1465] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:51:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:51:31.321007 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351b28d-5630-4a91-8ea9-42384961a962 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:31.321485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351b28d-5630-4a91-8ea9-42384961a962 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:31.321595 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351b28d-5630-4a91-8ea9-42384961a962 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:31.322901 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 726/1466] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 22:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:51:31.328459 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1c1af-7cc1-4d80-8a50-a8664a1e6862 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:31.328908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1c1af-7cc1-4d80-8a50-a8664a1e6862 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:31.329015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1c1af-7cc1-4d80-8a50-a8664a1e6862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:31.393837 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-2ac1c1af-7cc1-4d80-8a50-a8664a1e6862 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:51:31.394956 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-2ac1c1af-7cc1-4d80-8a50-a8664a1e6862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:31.442346 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:31.489481 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 741/1467] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 22:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:51:31.768006 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351b28d-5630-4a91-8ea9-42384961a962 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:51:31.769657 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1351b28d-5630-4a91-8ea9-42384961a962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:31.871966 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351b28d-5630-4a91-8ea9-42384961a962 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:51:31.919324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:31.946593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71866d-110b-48cd-a788-dc40df340f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:51:31.947206 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71866d-110b-48cd-a788-dc40df340f99 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:31.947481 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71866d-110b-48cd-a788-dc40df340f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:31.947747 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71866d-110b-48cd-a788-dc40df340f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:31.949378 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bd71866d-110b-48cd-a788-dc40df340f99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:32.056649 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71866d-110b-48cd-a788-dc40df340f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:51:32.058089 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71866d-110b-48cd-a788-dc40df340f99 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:51:32.076527 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 727/1468] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:51:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:51:41.490790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=22 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:42.074221 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=66 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:51.916726 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f89254-022f-4f03-b9fc-6ba3a540582d None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:51.917296 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f89254-022f-4f03-b9fc-6ba3a540582d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:51.917296 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f89254-022f-4f03-b9fc-6ba3a540582d None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:51.918667 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 742/1469] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:51:51.923979 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08057afd-e64f-4d15-8d1e-3571fd4715ec None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:51.924398 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08057afd-e64f-4d15-8d1e-3571fd4715ec None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:51.924569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08057afd-e64f-4d15-8d1e-3571fd4715ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:51.994018 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-08057afd-e64f-4d15-8d1e-3571fd4715ec None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:51:51.995261 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-08057afd-e64f-4d15-8d1e-3571fd4715ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:52.094019 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 728/1470] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:51:52.393258 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e938b-34ae-47a1-89d3-abf6f36feccc None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:52.393548 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e938b-34ae-47a1-89d3-abf6f36feccc None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:52.393827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e938b-34ae-47a1-89d3-abf6f36feccc None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:52.395176 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 743/1471] 10.222.0.30 () {54 vars in 961 bytes} [Tue Sep 6 22:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:51:52.400033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5a198-c144-40f8-9a91-7bacc0ce5dce None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:52.400319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5a198-c144-40f8-9a91-7bacc0ce5dce None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:52.400624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5a198-c144-40f8-9a91-7bacc0ce5dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:52.475702 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-6df5a198-c144-40f8-9a91-7bacc0ce5dce None None] MFA Rules not processed for user `4a2c1f1668814a5e9e654c6308fa0628`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:51:52.476950 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6df5a198-c144-40f8-9a91-7bacc0ce5dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:52.497883 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:52.554500 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 729/1472] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Sep 6 22:51:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:51:52.562186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e938b-34ae-47a1-89d3-abf6f36feccc None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:51:52.563796 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-085e938b-34ae-47a1-89d3-abf6f36feccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:52.667715 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e938b-34ae-47a1-89d3-abf6f36feccc None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:51:52.740751 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba242be-ca7b-4690-843d-4a1cdd8213f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a2c1f1668814a5e9e654c6308fa0628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:51:52.741352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba242be-ca7b-4690-843d-4a1cdd8213f8 service glance] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:52.741627 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba242be-ca7b-4690-843d-4a1cdd8213f8 service glance] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:52.741894 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba242be-ca7b-4690-843d-4a1cdd8213f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:52.743504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0ba242be-ca7b-4690-843d-4a1cdd8213f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:52.795997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:52.851372 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba242be-ca7b-4690-843d-4a1cdd8213f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:51:52.852835 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba242be-ca7b-4690-843d-4a1cdd8213f8 service glance] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:51:52.871394 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 744/1473] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:51:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:51:55.103693 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68eb6a-315e-488a-a2f5-6e80ac37daf6 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:55.104325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68eb6a-315e-488a-a2f5-6e80ac37daf6 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:55.104325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68eb6a-315e-488a-a2f5-6e80ac37daf6 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:55.105618 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 730/1474] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:51:55.114357 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e4756-86b3-41bc-8cb3-09510b9aa453 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:55.115320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e4756-86b3-41bc-8cb3-09510b9aa453 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:55.115555 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e4756-86b3-41bc-8cb3-09510b9aa453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:55.189486 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-4b9e4756-86b3-41bc-8cb3-09510b9aa453 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:51:55.190709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4b9e4756-86b3-41bc-8cb3-09510b9aa453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:55.286634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 745/1475] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:51:55.565476 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68eb6a-315e-488a-a2f5-6e80ac37daf6 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:51:55.567015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3a68eb6a-315e-488a-a2f5-6e80ac37daf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:55.690189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68eb6a-315e-488a-a2f5-6e80ac37daf6 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:51:55.740972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:55.789672 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c442a-df4a-43b8-8506-f8988da38d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:51:55.790287 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c442a-df4a-43b8-8506-f8988da38d90 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:55.790561 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c442a-df4a-43b8-8506-f8988da38d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:55.790828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c442a-df4a-43b8-8506-f8988da38d90 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:55.791457 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c442a-df4a-43b8-8506-f8988da38d90 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:51:55.793213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: WARNING py.warnings [None req-4e5c442a-df4a-43b8-8506-f8988da38d90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 22:51:55.793213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: warnings.warn(msg) Sep 06 22:51:55.793213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: Sep 06 22:51:55.794366 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c442a-df4a-43b8-8506-f8988da38d90 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:51:55.813015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 731/1476] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Sep 6 22:51:55 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:51:57.954961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bdf61-14a7-4517-a8ef-7471a1c1038c None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:57.955528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bdf61-14a7-4517-a8ef-7471a1c1038c None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:57.955528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bdf61-14a7-4517-a8ef-7471a1c1038c None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:57.956921 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 746/1477] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:51:57.962635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5cb4b-7b4e-418b-8276-263f90e1835c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:57.963060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5cb4b-7b4e-418b-8276-263f90e1835c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:57.963192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5cb4b-7b4e-418b-8276-263f90e1835c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:58.028267 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-bbe5cb4b-7b4e-418b-8276-263f90e1835c None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:51:58.029529 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bbe5cb4b-7b4e-418b-8276-263f90e1835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:58.127011 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 732/1478] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:51:58.415872 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bdf61-14a7-4517-a8ef-7471a1c1038c None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:51:58.417431 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b81bdf61-14a7-4517-a8ef-7471a1c1038c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:58.427702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:58.562517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bdf61-14a7-4517-a8ef-7471a1c1038c None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:51:58.643184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:58.675944 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee452c11-b1b9-44be-9272-f06d11916cf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:51:58.676839 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452c11-b1b9-44be-9272-f06d11916cf6 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:51:58.678227 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452c11-b1b9-44be-9272-f06d11916cf6 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:51:58.678227 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452c11-b1b9-44be-9272-f06d11916cf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:51:58.680176 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ee452c11-b1b9-44be-9272-f06d11916cf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:51:58.766088 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee452c11-b1b9-44be-9272-f06d11916cf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:51:58.767673 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee452c11-b1b9-44be-9272-f06d11916cf6 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:51:58.785495 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 747/1479] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:51:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:52:01.087216 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b55ca6-3c37-4939-b265-6f4eb44ea077 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:52:01.087779 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b55ca6-3c37-4939-b265-6f4eb44ea077 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:52:01.087779 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b55ca6-3c37-4939-b265-6f4eb44ea077 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:52:01.089124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 733/1480] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:52:01.094405 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe1c6-7815-417a-bbeb-bfb924c2ecb9 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:52:01.095383 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe1c6-7815-417a-bbeb-bfb924c2ecb9 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:52:01.095493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe1c6-7815-417a-bbeb-bfb924c2ecb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:52:01.161153 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-4adfe1c6-7815-417a-bbeb-bfb924c2ecb9 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:52:01.162373 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4adfe1c6-7815-417a-bbeb-bfb924c2ecb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:52:01.208172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:52:01.256368 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 748/1481] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:52:01.541997 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b55ca6-3c37-4939-b265-6f4eb44ea077 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:52:01.543539 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-37b55ca6-3c37-4939-b265-6f4eb44ea077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:52:01.567271 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:52:01.646087 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b55ca6-3c37-4939-b265-6f4eb44ea077 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:52:01.718885 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de9967-2e09-49a5-bb94-6cf81e7907ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:52:01.719498 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de9967-2e09-49a5-bb94-6cf81e7907ce service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:52:01.720327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de9967-2e09-49a5-bb94-6cf81e7907ce service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:52:01.720711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de9967-2e09-49a5-bb94-6cf81e7907ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:52:01.722317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-50de9967-2e09-49a5-bb94-6cf81e7907ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:52:01.795801 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:52:01.830638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de9967-2e09-49a5-bb94-6cf81e7907ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:52:01.832092 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de9967-2e09-49a5-bb94-6cf81e7907ce service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:52:01.853611 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 734/1482] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:52:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:52:04.034478 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b2bb3-ad39-4ee5-9354-715f74b018b5 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:52:04.035024 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b2bb3-ad39-4ee5-9354-715f74b018b5 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:52:04.035142 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b2bb3-ad39-4ee5-9354-715f74b018b5 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:52:04.036474 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 749/1483] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:52:04.041628 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20713d-0575-4526-bf3b-32b2aa524469 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:52:04.042084 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20713d-0575-4526-bf3b-32b2aa524469 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:52:04.042192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20713d-0575-4526-bf3b-32b2aa524469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:52:04.108876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-5f20713d-0575-4526-bf3b-32b2aa524469 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:52:04.110919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5f20713d-0575-4526-bf3b-32b2aa524469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:52:04.209546 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 735/1484] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:52:04.501309 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b2bb3-ad39-4ee5-9354-715f74b018b5 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:52:04.502829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-6a0b2bb3-ad39-4ee5-9354-715f74b018b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:52:04.604645 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b2bb3-ad39-4ee5-9354-715f74b018b5 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:52:04.674603 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:52:04.676447 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36f2f0-3eae-4102-8d93-1cd1522f53db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:52:04.677068 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36f2f0-3eae-4102-8d93-1cd1522f53db service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:52:04.677344 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36f2f0-3eae-4102-8d93-1cd1522f53db service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:52:04.677612 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36f2f0-3eae-4102-8d93-1cd1522f53db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:52:04.679231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3e36f2f0-3eae-4102-8d93-1cd1522f53db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:52:04.786594 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36f2f0-3eae-4102-8d93-1cd1522f53db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:52:04.787939 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36f2f0-3eae-4102-8d93-1cd1522f53db service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:52:04.805980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 750/1485] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:52:07.050281 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1770cad-f156-4500-aada-2efe6ab089ce None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:52:07.050848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1770cad-f156-4500-aada-2efe6ab089ce None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:52:07.050848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1770cad-f156-4500-aada-2efe6ab089ce None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:52:07.052168 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 736/1486] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:52:07.057365 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d75535-6ba4-41c0-8c3c-ccf31ac23283 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:52:07.057813 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d75535-6ba4-41c0-8c3c-ccf31ac23283 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:52:07.057923 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d75535-6ba4-41c0-8c3c-ccf31ac23283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:52:07.124694 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-e7d75535-6ba4-41c0-8c3c-ccf31ac23283 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:52:07.126550 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e7d75535-6ba4-41c0-8c3c-ccf31ac23283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:52:07.183921 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:52:07.227702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 751/1487] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:52:07.516998 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1770cad-f156-4500-aada-2efe6ab089ce None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:52:07.518590 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b1770cad-f156-4500-aada-2efe6ab089ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:52:07.554592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:52:07.621004 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1770cad-f156-4500-aada-2efe6ab089ce None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:52:07.692393 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2a4cc-877f-485a-aeaa-1d89b5ca3c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:52:07.693022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2a4cc-877f-485a-aeaa-1d89b5ca3c2e service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:52:07.693300 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2a4cc-877f-485a-aeaa-1d89b5ca3c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:52:07.693570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2a4cc-877f-485a-aeaa-1d89b5ca3c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:52:07.695168 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ccd2a4cc-877f-485a-aeaa-1d89b5ca3c2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:52:07.772891 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:52:07.801956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2a4cc-877f-485a-aeaa-1d89b5ca3c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:52:07.803679 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2a4cc-877f-485a-aeaa-1d89b5ca3c2e service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:52:07.821409 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 737/1488] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:52:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:52:10.397585 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da737d98-4a92-4e7b-b5c8-f9d94d39c418 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:52:10.398094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da737d98-4a92-4e7b-b5c8-f9d94d39c418 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:52:10.398094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da737d98-4a92-4e7b-b5c8-f9d94d39c418 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:52:10.399403 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 752/1489] 10.222.0.30 () {54 vars in 927 bytes} [Tue Sep 6 22:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:52:10.404872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96702d7a-e581-4330-ab19-947b58096a6a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:52:10.405300 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96702d7a-e581-4330-ab19-947b58096a6a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:52:10.405412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96702d7a-e581-4330-ab19-947b58096a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:52:10.479592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-96702d7a-e581-4330-ab19-947b58096a6a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:52:10.481078 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-96702d7a-e581-4330-ab19-947b58096a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:52:10.577445 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 738/1490] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Sep 6 22:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:52:10.870731 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da737d98-4a92-4e7b-b5c8-f9d94d39c418 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:52:10.872309 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-da737d98-4a92-4e7b-b5c8-f9d94d39c418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:52:10.975026 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da737d98-4a92-4e7b-b5c8-f9d94d39c418 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:52:11.047511 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff92ed9-05d3-464d-94c9-2db632620ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:52:11.048117 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff92ed9-05d3-464d-94c9-2db632620ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:52:11.048397 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff92ed9-05d3-464d-94c9-2db632620ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:52:11.048698 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff92ed9-05d3-464d-94c9-2db632620ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:52:11.050291 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-fff92ed9-05d3-464d-94c9-2db632620ec0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:52:11.059213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:52:11.165998 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff92ed9-05d3-464d-94c9-2db632620ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:52:11.167349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff92ed9-05d3-464d-94c9-2db632620ec0 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:52:11.189513 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 753/1491] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:52:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:52:20.575338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=82 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:52:21.187031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=50 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:31.740025 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2082d52-ed6a-46fc-a1f0-7f92bed9d3be None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:53:31.740617 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2082d52-ed6a-46fc-a1f0-7f92bed9d3be None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:53:31.740617 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2082d52-ed6a-46fc-a1f0-7f92bed9d3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:53:31.815165 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e2082d52-ed6a-46fc-a1f0-7f92bed9d3be None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:53:31.816379 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e2082d52-ed6a-46fc-a1f0-7f92bed9d3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:53:31.912076 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 739/1492] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:53:31.920672 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125801d-1209-44ce-af7e-9e3e513a1d18 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:53:31.921180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125801d-1209-44ce-af7e-9e3e513a1d18 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:53:31.921288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125801d-1209-44ce-af7e-9e3e513a1d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:53:32.001427 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-5125801d-1209-44ce-af7e-9e3e513a1d18 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:53:32.002643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-5125801d-1209-44ce-af7e-9e3e513a1d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:53:32.100349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 754/1493] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:53:32.105537 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2082d52-ed6a-46fc-a1f0-7f92bed9d3be None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:53:32.106741 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e2082d52-ed6a-46fc-a1f0-7f92bed9d3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:53:32.118062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2082d52-ed6a-46fc-a1f0-7f92bed9d3be None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:53:32.179032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:32.214200 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3905a6-02c1-4b58-9ee8-2e931b3bd1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:53:32.214789 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3905a6-02c1-4b58-9ee8-2e931b3bd1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:53:32.215064 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3905a6-02c1-4b58-9ee8-2e931b3bd1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:53:32.215333 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3905a6-02c1-4b58-9ee8-2e931b3bd1b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:53:32.215971 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3905a6-02c1-4b58-9ee8-2e931b3bd1b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:53:32.216270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3905a6-02c1-4b58-9ee8-2e931b3bd1b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:53:32.217301 dv-cinder-852208-20-smb devstack@keystone.service[88077]: WARNING py.warnings [None req-ba3905a6-02c1-4b58-9ee8-2e931b3bd1b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 22:53:32.217301 dv-cinder-852208-20-smb devstack@keystone.service[88077]: warnings.warn(msg) Sep 06 22:53:32.217301 dv-cinder-852208-20-smb devstack@keystone.service[88077]: Sep 06 22:53:32.218188 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3905a6-02c1-4b58-9ee8-2e931b3bd1b9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:53:32.229136 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 740/1494] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:53:32.238192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125801d-1209-44ce-af7e-9e3e513a1d18 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:53:32.247492 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125801d-1209-44ce-af7e-9e3e513a1d18 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:53:32.307364 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:32.341123 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcd366-af7e-48f6-b05d-624832950384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:53:32.341726 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcd366-af7e-48f6-b05d-624832950384 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:53:32.342002 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcd366-af7e-48f6-b05d-624832950384 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:53:32.342268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcd366-af7e-48f6-b05d-624832950384 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:53:32.342891 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbcd366-af7e-48f6-b05d-624832950384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:53:32.344704 dv-cinder-852208-20-smb devstack@keystone.service[88078]: WARNING py.warnings [None req-7bbcd366-af7e-48f6-b05d-624832950384 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 22:53:32.344704 dv-cinder-852208-20-smb devstack@keystone.service[88078]: warnings.warn(msg) Sep 06 22:53:32.344704 dv-cinder-852208-20-smb devstack@keystone.service[88078]: Sep 06 22:53:32.345906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbcd366-af7e-48f6-b05d-624832950384 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:53:32.472272 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 755/1495] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:53:32 2022] POST /identity/v3/projects => generated 379 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:53:32.476367 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3905a6-02c1-4b58-9ee8-2e931b3bd1b9 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:53:32.477900 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ba3905a6-02c1-4b58-9ee8-2e931b3bd1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:53:32.511786 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3905a6-02c1-4b58-9ee8-2e931b3bd1b9 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:53:32.608730 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e97de-769c-4bf9-859d-255d7ece22c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:53:32.609243 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e97de-769c-4bf9-859d-255d7ece22c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:53:32.609517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e97de-769c-4bf9-859d-255d7ece22c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:53:32.609785 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e97de-769c-4bf9-859d-255d7ece22c9 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:53:32.610424 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e97de-769c-4bf9-859d-255d7ece22c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:53:32.611417 dv-cinder-852208-20-smb devstack@keystone.service[88077]: WARNING py.warnings [None req-fb6e97de-769c-4bf9-859d-255d7ece22c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 22:53:32.611417 dv-cinder-852208-20-smb devstack@keystone.service[88077]: warnings.warn(msg) Sep 06 22:53:32.611417 dv-cinder-852208-20-smb devstack@keystone.service[88077]: Sep 06 22:53:32.612648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e97de-769c-4bf9-859d-255d7ece22c9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:53:32.863052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 741/1496] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:53:32 2022] POST /identity/v3/users => generated 290 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:53:32.867163 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcd366-af7e-48f6-b05d-624832950384 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:53:32.868708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7bbcd366-af7e-48f6-b05d-624832950384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:53:32.930737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcd366-af7e-48f6-b05d-624832950384 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:53:33.012737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:33.022790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c494c1e-54b8-4cc8-8f24-5e411bccf0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:53:33.023849 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c494c1e-54b8-4cc8-8f24-5e411bccf0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:53:33.023849 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c494c1e-54b8-4cc8-8f24-5e411bccf0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:53:33.024025 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c494c1e-54b8-4cc8-8f24-5e411bccf0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:53:33.024660 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c494c1e-54b8-4cc8-8f24-5e411bccf0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:53:33.025654 dv-cinder-852208-20-smb devstack@keystone.service[88078]: WARNING py.warnings [None req-3c494c1e-54b8-4cc8-8f24-5e411bccf0c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 22:53:33.025654 dv-cinder-852208-20-smb devstack@keystone.service[88078]: warnings.warn(msg) Sep 06 22:53:33.025654 dv-cinder-852208-20-smb devstack@keystone.service[88078]: Sep 06 22:53:33.027056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c494c1e-54b8-4cc8-8f24-5e411bccf0c3 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:53:33.039057 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 756/1497] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:53:33.043775 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e97de-769c-4bf9-859d-255d7ece22c9 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:53:33.045350 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fb6e97de-769c-4bf9-859d-255d7ece22c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:53:33.056505 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e97de-769c-4bf9-859d-255d7ece22c9 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:53:33.082008 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:33.149770 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af31c6-c428-4d2c-b98b-78db2daaf362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:53:33.150295 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af31c6-c428-4d2c-b98b-78db2daaf362 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:53:33.150567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af31c6-c428-4d2c-b98b-78db2daaf362 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:53:33.150832 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af31c6-c428-4d2c-b98b-78db2daaf362 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:53:33.152034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af31c6-c428-4d2c-b98b-78db2daaf362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:53:33.153570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: WARNING py.warnings [None req-a0af31c6-c428-4d2c-b98b-78db2daaf362 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 22:53:33.153570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: warnings.warn(msg) Sep 06 22:53:33.153570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: Sep 06 22:53:33.154959 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af31c6-c428-4d2c-b98b-78db2daaf362 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:53:33.167874 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 742/1498] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:53:33.172051 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c494c1e-54b8-4cc8-8f24-5e411bccf0c3 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:53:33.173663 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3c494c1e-54b8-4cc8-8f24-5e411bccf0c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:53:33.207349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c494c1e-54b8-4cc8-8f24-5e411bccf0c3 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:53:33.299176 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecefad3-1312-4543-a651-e9397b902dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:53:33.299833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecefad3-1312-4543-a651-e9397b902dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:53:33.300110 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecefad3-1312-4543-a651-e9397b902dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:53:33.300381 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecefad3-1312-4543-a651-e9397b902dbc admin admin] PATH_INFO: `/v3/projects/f617beb1aed04ae1ae337fcb5de463b5/users/242d6bd229514988a9481942be94e2bc/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:53:33.321433 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecefad3-1312-4543-a651-e9397b902dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f617beb1aed04ae1ae337fcb5de463b5, user_id=242d6bd229514988a9481942be94e2bc, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:53:33.322446 dv-cinder-852208-20-smb devstack@keystone.service[88078]: WARNING py.warnings [None req-cecefad3-1312-4543-a651-e9397b902dbc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 22:53:33.322446 dv-cinder-852208-20-smb devstack@keystone.service[88078]: warnings.warn(msg) Sep 06 22:53:33.322446 dv-cinder-852208-20-smb devstack@keystone.service[88078]: Sep 06 22:53:33.324479 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecefad3-1312-4543-a651-e9397b902dbc admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:53:33.404707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 757/1499] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:53:33 2022] PUT /identity/v3/projects/f617beb1aed04ae1ae337fcb5de463b5/users/242d6bd229514988a9481942be94e2bc/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:53:33.417015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda621-d46d-464d-94bb-b292f974a154 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:53:33.417320 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda621-d46d-464d-94bb-b292f974a154 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:53:33.417595 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda621-d46d-464d-94bb-b292f974a154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:53:33.473049 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-73eda621-d46d-464d-94bb-b292f974a154 None None] MFA Rules not processed for user `242d6bd229514988a9481942be94e2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:53:33.474240 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-73eda621-d46d-464d-94bb-b292f974a154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:53:33.549694 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 743/1500] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:53:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:53:33.562925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b000ca-7614-4df1-bddb-0e07ac61838e None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:53:33.563217 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b000ca-7614-4df1-bddb-0e07ac61838e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:53:33.563493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b000ca-7614-4df1-bddb-0e07ac61838e None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:53:33.564898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 758/1501] 10.222.0.30 () {54 vars in 964 bytes} [Tue Sep 6 22:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:53:33.569728 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c316a4-489c-45cf-a7fe-b307309dbfe9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:53:33.570013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c316a4-489c-45cf-a7fe-b307309dbfe9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:53:33.570286 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c316a4-489c-45cf-a7fe-b307309dbfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:53:33.602304 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:33.645683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-16c316a4-489c-45cf-a7fe-b307309dbfe9 None None] MFA Rules not processed for user `5ef596f83ce54fab8779e4e0f3899abc`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:53:33.646897 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-16c316a4-489c-45cf-a7fe-b307309dbfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:53:33.724353 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 744/1502] 10.222.0.30 () {58 vars in 1061 bytes} [Tue Sep 6 22:53:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:53:33.732167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b000ca-7614-4df1-bddb-0e07ac61838e None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:53:33.733706 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-78b000ca-7614-4df1-bddb-0e07ac61838e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:53:33.783833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:33.838184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b000ca-7614-4df1-bddb-0e07ac61838e None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:53:33.914121 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c504b-4247-4dc4-8b29-67fb51ca87c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:53:33.914737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c504b-4247-4dc4-8b29-67fb51ca87c0 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:53:33.915018 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c504b-4247-4dc4-8b29-67fb51ca87c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:53:33.915304 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c504b-4247-4dc4-8b29-67fb51ca87c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:53:33.916954 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-006c504b-4247-4dc4-8b29-67fb51ca87c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:53:34.016292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c504b-4247-4dc4-8b29-67fb51ca87c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:53:34.017795 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c504b-4247-4dc4-8b29-67fb51ca87c0 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:53:34.021340 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:34.035345 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 759/1503] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:53:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:53:34.310855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59151a2-335e-44c5-a7f7-53b9d1a8f880 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:53:34.311303 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59151a2-335e-44c5-a7f7-53b9d1a8f880 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:53:34.311413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59151a2-335e-44c5-a7f7-53b9d1a8f880 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:53:34.312723 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 745/1504] 10.222.0.30 () {52 vars in 830 bytes} [Tue Sep 6 22:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:53:34.316221 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c504b-4247-4dc4-8b29-67fb51ca87c0 service cinder] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:53:34.317509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-006c504b-4247-4dc4-8b29-67fb51ca87c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:53:34.413999 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c504b-4247-4dc4-8b29-67fb51ca87c0 service cinder] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:53:34.506108 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81bd6a-da47-487b-ab97-1958c1bbf606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:53:34.506736 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81bd6a-da47-487b-ab97-1958c1bbf606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:53:34.507012 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81bd6a-da47-487b-ab97-1958c1bbf606 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:53:34.507281 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81bd6a-da47-487b-ab97-1958c1bbf606 admin admin] PATH_INFO: `/v3/users/242d6bd229514988a9481942be94e2bc` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:53:34.519132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81bd6a-da47-487b-ab97-1958c1bbf606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=242d6bd229514988a9481942be94e2bc)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:53:34.520137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: WARNING py.warnings [None req-1e81bd6a-da47-487b-ab97-1958c1bbf606 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 22:53:34.520137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: warnings.warn(msg) Sep 06 22:53:34.520137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: Sep 06 22:53:34.521459 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81bd6a-da47-487b-ab97-1958c1bbf606 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:53:34.531406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:34.743195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-1e81bd6a-da47-487b-ab97-1958c1bbf606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '242d6bd229514988a9481942be94e2bc'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:53:34.826513 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-1e81bd6a-da47-487b-ab97-1958c1bbf606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '242d6bd229514988a9481942be94e2bc'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:53:34.826944 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-1e81bd6a-da47-487b-ab97-1958c1bbf606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '242d6bd229514988a9481942be94e2bc'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:53:34.850454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-1e81bd6a-da47-487b-ab97-1958c1bbf606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '242d6bd229514988a9481942be94e2bc'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:53:34.850995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-1e81bd6a-da47-487b-ab97-1958c1bbf606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '242d6bd229514988a9481942be94e2bc'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:53:34.870224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 760/1505] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:53:34 2022] DELETE /identity/v3/users/242d6bd229514988a9481942be94e2bc => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:53:34.874657 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98174e-fead-449c-b35e-88409f1185ef None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:53:34.874945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98174e-fead-449c-b35e-88409f1185ef None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:53:34.875216 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98174e-fead-449c-b35e-88409f1185ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:53:34.931062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-8d98174e-fead-449c-b35e-88409f1185ef None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:53:34.932267 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8d98174e-fead-449c-b35e-88409f1185ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:53:35.005399 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:35.018046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 746/1506] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:53:35.032468 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba4000-50e8-47e9-8731-8e5c85dde285 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:53:35.032975 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba4000-50e8-47e9-8731-8e5c85dde285 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:53:35.033074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba4000-50e8-47e9-8731-8e5c85dde285 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:53:35.034410 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 761/1507] 10.222.0.30 () {54 vars in 965 bytes} [Tue Sep 6 22:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:53:35.039896 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1cf42-4ce5-4709-bc4a-e1f69c1b57ed None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:53:35.040178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1cf42-4ce5-4709-bc4a-e1f69c1b57ed None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:53:35.040482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1cf42-4ce5-4709-bc4a-e1f69c1b57ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:53:35.115123 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-34e1cf42-4ce5-4709-bc4a-e1f69c1b57ed None None] MFA Rules not processed for user `314bb14d5fa1414a832efb6d37c0446d`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:53:35.116342 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-34e1cf42-4ce5-4709-bc4a-e1f69c1b57ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:53:35.190407 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 747/1508] 10.222.0.30 () {58 vars in 1062 bytes} [Tue Sep 6 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:53:35.199466 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba4000-50e8-47e9-8731-8e5c85dde285 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:53:35.201279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d4ba4000-50e8-47e9-8731-8e5c85dde285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:53:35.301099 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba4000-50e8-47e9-8731-8e5c85dde285 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:53:35.351139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:35.373769 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d937e40-ad6a-4d4e-8b93-3bd909aaaaf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:53:35.374375 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d937e40-ad6a-4d4e-8b93-3bd909aaaaf9 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:53:35.374657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d937e40-ad6a-4d4e-8b93-3bd909aaaaf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:53:35.374928 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d937e40-ad6a-4d4e-8b93-3bd909aaaaf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:53:35.376538 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-6d937e40-ad6a-4d4e-8b93-3bd909aaaaf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:53:35.485218 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d937e40-ad6a-4d4e-8b93-3bd909aaaaf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:53:35.486656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d937e40-ad6a-4d4e-8b93-3bd909aaaaf9 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:53:35.505290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 762/1509] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:53:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:53:36.131326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1cf42-4ce5-4709-bc4a-e1f69c1b57ed None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:53:36.132593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-34e1cf42-4ce5-4709-bc4a-e1f69c1b57ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:53:36.215875 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:36.249936 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1cf42-4ce5-4709-bc4a-e1f69c1b57ed None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:53:36.343325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb859a-423b-47e6-81a7-1ea164e03898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:53:36.343955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb859a-423b-47e6-81a7-1ea164e03898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:53:36.344233 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb859a-423b-47e6-81a7-1ea164e03898 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:53:36.344589 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb859a-423b-47e6-81a7-1ea164e03898 admin admin] PATH_INFO: `/v3/projects/f617beb1aed04ae1ae337fcb5de463b5` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:53:36.354729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb859a-423b-47e6-81a7-1ea164e03898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f617beb1aed04ae1ae337fcb5de463b5)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:53:36.355780 dv-cinder-852208-20-smb devstack@keystone.service[88077]: WARNING py.warnings [None req-f8fb859a-423b-47e6-81a7-1ea164e03898 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 22:53:36.355780 dv-cinder-852208-20-smb devstack@keystone.service[88077]: warnings.warn(msg) Sep 06 22:53:36.355780 dv-cinder-852208-20-smb devstack@keystone.service[88077]: Sep 06 22:53:36.357035 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb859a-423b-47e6-81a7-1ea164e03898 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:53:36.469301 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f8fb859a-423b-47e6-81a7-1ea164e03898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f617beb1aed04ae1ae337fcb5de463b5', 'request_id': 'req-f8fb859a-423b-47e6-81a7-1ea164e03898'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:53:36.482450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f8fb859a-423b-47e6-81a7-1ea164e03898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f617beb1aed04ae1ae337fcb5de463b5', 'request_id': 'req-f8fb859a-423b-47e6-81a7-1ea164e03898'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:53:36.546418 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f8fb859a-423b-47e6-81a7-1ea164e03898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f617beb1aed04ae1ae337fcb5de463b5', 'request_id': 'req-f8fb859a-423b-47e6-81a7-1ea164e03898'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:53:36.571527 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f8fb859a-423b-47e6-81a7-1ea164e03898 admin admin] The token cache is being invalidate because project f617beb1aed04ae1ae337fcb5de463b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:53:36.572080 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f8fb859a-423b-47e6-81a7-1ea164e03898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:53:36.573327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f8fb859a-423b-47e6-81a7-1ea164e03898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:53:36.575010 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 748/1510] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:53:36 2022] DELETE /identity/v3/projects/f617beb1aed04ae1ae337fcb5de463b5 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:53:45.502985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=64 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:46.569309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:55:08.371428 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2978a8c-5116-4dc0-9a63-0dbf76c6b49e None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:08.371997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2978a8c-5116-4dc0-9a63-0dbf76c6b49e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:08.371997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2978a8c-5116-4dc0-9a63-0dbf76c6b49e None None] PATH_INFO: `/v3` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:08.373289 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 763/1511] 10.222.0.25 () {54 vars in 925 bytes} [Tue Sep 6 22:55:08 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:55:08.389735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de0b73-814c-4558-8b85-d9d453c6c254 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:08.390156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de0b73-814c-4558-8b85-d9d453c6c254 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:08.390283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de0b73-814c-4558-8b85-d9d453c6c254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:08.471749 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f4de0b73-814c-4558-8b85-d9d453c6c254 None None] MFA Rules not processed for user `4f6bd5bbbf65461990c9bb2747dbe5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:55:08.473041 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f4de0b73-814c-4558-8b85-d9d453c6c254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:55:08.589325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 749/1512] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Sep 6 22:55:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:55:09.977045 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d4037-a9c2-4bf4-8af7-2f34d3a450a9 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:09.977645 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d4037-a9c2-4bf4-8af7-2f34d3a450a9 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:09.977645 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d4037-a9c2-4bf4-8af7-2f34d3a450a9 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:09.978923 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 764/1513] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 22:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:55:09.983829 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8f0b9-e845-4fe1-9019-afd23b82e0cc None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:09.984247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8f0b9-e845-4fe1-9019-afd23b82e0cc None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:09.984385 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8f0b9-e845-4fe1-9019-afd23b82e0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:10.043941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-65e8f0b9-e845-4fe1-9019-afd23b82e0cc None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:55:10.045168 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-65e8f0b9-e845-4fe1-9019-afd23b82e0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:55:10.063934 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:55:10.123233 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 750/1514] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 22:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:55:10.274711 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d4037-a9c2-4bf4-8af7-2f34d3a450a9 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:55:10.276862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-395d4037-a9c2-4bf4-8af7-2f34d3a450a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:55:10.376901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d4037-a9c2-4bf4-8af7-2f34d3a450a9 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:55:10.382840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9baf8-0503-449d-a969-f4b6042902a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:55:10.383442 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9baf8-0503-449d-a969-f4b6042902a9 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:10.383725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9baf8-0503-449d-a969-f4b6042902a9 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:10.384001 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9baf8-0503-449d-a969-f4b6042902a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:10.391847 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9baf8-0503-449d-a969-f4b6042902a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:55:10.393449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9baf8-0503-449d-a969-f4b6042902a9 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:55:10.403153 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 765/1515] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:55:11.469345 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b755e-50e0-4842-842e-254530b65e89 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:11.469852 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b755e-50e0-4842-842e-254530b65e89 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:11.469957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b755e-50e0-4842-842e-254530b65e89 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:11.471256 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 751/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 22:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:55:11.478176 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b965465-c1b4-4416-9977-1caa4d419bde None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:11.478636 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b965465-c1b4-4416-9977-1caa4d419bde None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:11.478752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b965465-c1b4-4416-9977-1caa4d419bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:11.497821 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-6b965465-c1b4-4416-9977-1caa4d419bde None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:55:11.499006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-6b965465-c1b4-4416-9977-1caa4d419bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:55:11.507205 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 766/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 22:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:55:11.655749 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b755e-50e0-4842-842e-254530b65e89 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:55:11.670097 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b755e-50e0-4842-842e-254530b65e89 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:55:11.675126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa56f0-643c-4c7a-bd4a-26056b590ad4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:55:11.675715 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa56f0-643c-4c7a-bd4a-26056b590ad4 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:11.675991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa56f0-643c-4c7a-bd4a-26056b590ad4 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:11.676262 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa56f0-643c-4c7a-bd4a-26056b590ad4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:11.684355 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa56f0-643c-4c7a-bd4a-26056b590ad4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:55:11.688660 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa56f0-643c-4c7a-bd4a-26056b590ad4 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:55:11.695649 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 752/1518] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:55:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:55:15.556043 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb769b-7c9c-42cd-a402-232fe5715611 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:15.556493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb769b-7c9c-42cd-a402-232fe5715611 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:15.556606 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb769b-7c9c-42cd-a402-232fe5715611 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:15.557991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 767/1519] 10.222.0.30 () {54 vars in 961 bytes} [Tue Sep 6 22:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:55:15.562854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f427e-2309-49d3-99dd-3ae283684054 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:15.563314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f427e-2309-49d3-99dd-3ae283684054 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:15.563423 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f427e-2309-49d3-99dd-3ae283684054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:15.583499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-1a1f427e-2309-49d3-99dd-3ae283684054 None None] MFA Rules not processed for user `4f6bd5bbbf65461990c9bb2747dbe5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:55:15.585362 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1a1f427e-2309-49d3-99dd-3ae283684054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:55:15.593862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 753/1520] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Sep 6 22:55:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:55:15.601349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb769b-7c9c-42cd-a402-232fe5715611 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:55:15.614348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb769b-7c9c-42cd-a402-232fe5715611 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:55:15.619280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ffb75-6b48-4a5d-a9d6-03566794f072 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bd5bbbf65461990c9bb2747dbe5e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:55:15.619867 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ffb75-6b48-4a5d-a9d6-03566794f072 service placement] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:15.620143 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ffb75-6b48-4a5d-a9d6-03566794f072 service placement] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:15.620414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ffb75-6b48-4a5d-a9d6-03566794f072 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:15.628477 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ffb75-6b48-4a5d-a9d6-03566794f072 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:55:15.630043 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ffb75-6b48-4a5d-a9d6-03566794f072 service placement] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:55:15.640110 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 768/1521] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:55:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:55:23.176296 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b377057-dc91-4a78-a741-efa0cabb3f7b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:23.176894 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b377057-dc91-4a78-a741-efa0cabb3f7b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:23.176894 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b377057-dc91-4a78-a741-efa0cabb3f7b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:23.178746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 754/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 22:55:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:55:23.184709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2ad76-151a-4cce-8cde-35d39d0cfa3f None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:23.185103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2ad76-151a-4cce-8cde-35d39d0cfa3f None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:23.185259 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2ad76-151a-4cce-8cde-35d39d0cfa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:23.205119 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-95b2ad76-151a-4cce-8cde-35d39d0cfa3f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:55:23.206318 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-95b2ad76-151a-4cce-8cde-35d39d0cfa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:55:23.214037 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 769/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 22:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:55:23.366001 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b377057-dc91-4a78-a741-efa0cabb3f7b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:55:23.380342 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b377057-dc91-4a78-a741-efa0cabb3f7b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:55:23.387940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d662e6c-fbf8-495d-b495-904afd946603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:55:23.388711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d662e6c-fbf8-495d-b495-904afd946603 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:23.388984 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d662e6c-fbf8-495d-b495-904afd946603 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:23.389255 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d662e6c-fbf8-495d-b495-904afd946603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:23.399102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d662e6c-fbf8-495d-b495-904afd946603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:55:23.400763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d662e6c-fbf8-495d-b495-904afd946603 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:55:23.410946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 755/1524] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:55:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:55:24.480216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d7f0f-cb4c-47e5-bfb7-01f763c5e249 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:24.480801 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d7f0f-cb4c-47e5-bfb7-01f763c5e249 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:24.480801 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d7f0f-cb4c-47e5-bfb7-01f763c5e249 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:24.482083 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 770/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 22:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:55:24.489718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13800c7c-23af-42b3-ad03-6da79f6ffecd None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:24.490261 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13800c7c-23af-42b3-ad03-6da79f6ffecd None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:24.490718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13800c7c-23af-42b3-ad03-6da79f6ffecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:24.514328 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-13800c7c-23af-42b3-ad03-6da79f6ffecd None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:55:24.515729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-13800c7c-23af-42b3-ad03-6da79f6ffecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:55:24.524450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 756/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 22:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:55:24.673613 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d7f0f-cb4c-47e5-bfb7-01f763c5e249 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:55:24.688394 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d7f0f-cb4c-47e5-bfb7-01f763c5e249 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:55:24.694681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc20d19-4a03-49f7-97ea-01ffdfeaf778 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:55:24.695282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc20d19-4a03-49f7-97ea-01ffdfeaf778 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:24.695594 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc20d19-4a03-49f7-97ea-01ffdfeaf778 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:24.695867 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc20d19-4a03-49f7-97ea-01ffdfeaf778 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:24.704220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc20d19-4a03-49f7-97ea-01ffdfeaf778 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:55:24.705848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc20d19-4a03-49f7-97ea-01ffdfeaf778 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:55:24.715143 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 771/1527] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:55:28.657860 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec2f52-d303-4a90-83fb-d45dd6fca212 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:28.658403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec2f52-d303-4a90-83fb-d45dd6fca212 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:28.658403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec2f52-d303-4a90-83fb-d45dd6fca212 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:28.659745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 757/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 22:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:55:28.666049 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064aa45-7f8e-4514-80d9-6a7565dc1263 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:28.666472 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064aa45-7f8e-4514-80d9-6a7565dc1263 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:28.666596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064aa45-7f8e-4514-80d9-6a7565dc1263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:28.685739 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-5064aa45-7f8e-4514-80d9-6a7565dc1263 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:55:28.686941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-5064aa45-7f8e-4514-80d9-6a7565dc1263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:55:28.694706 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 772/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 22:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:55:28.997246 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec2f52-d303-4a90-83fb-d45dd6fca212 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:55:28.998971 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2aec2f52-d303-4a90-83fb-d45dd6fca212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:55:29.078451 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec2f52-d303-4a90-83fb-d45dd6fca212 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:55:29.082072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080697e-1d41-41e0-9c40-094e2d0c8cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:55:29.082680 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080697e-1d41-41e0-9c40-094e2d0c8cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:29.082963 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080697e-1d41-41e0-9c40-094e2d0c8cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:29.083248 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080697e-1d41-41e0-9c40-094e2d0c8cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:29.092985 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080697e-1d41-41e0-9c40-094e2d0c8cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:55:29.094435 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080697e-1d41-41e0-9c40-094e2d0c8cc9 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:55:29.103786 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 758/1530] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:55:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:55:31.247278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7238d45-b199-4cfe-8018-c2d44d495700 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:31.247893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7238d45-b199-4cfe-8018-c2d44d495700 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:31.247893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7238d45-b199-4cfe-8018-c2d44d495700 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:31.249237 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 773/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 22:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:55:31.254679 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7759b-0ff5-4bb5-9f33-9e13935e43e1 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:31.255112 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7759b-0ff5-4bb5-9f33-9e13935e43e1 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:31.255219 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7759b-0ff5-4bb5-9f33-9e13935e43e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:31.275543 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-eba7759b-0ff5-4bb5-9f33-9e13935e43e1 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:55:31.276782 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-eba7759b-0ff5-4bb5-9f33-9e13935e43e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:55:31.284633 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 759/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 22:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:55:31.592812 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7238d45-b199-4cfe-8018-c2d44d495700 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:55:31.604050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7238d45-b199-4cfe-8018-c2d44d495700 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:55:31.607475 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09687e75-7678-4db0-8b3d-19ea95b40c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:55:31.608064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09687e75-7678-4db0-8b3d-19ea95b40c5c service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:31.608340 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09687e75-7678-4db0-8b3d-19ea95b40c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:31.608705 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09687e75-7678-4db0-8b3d-19ea95b40c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:31.617360 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09687e75-7678-4db0-8b3d-19ea95b40c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:55:31.618769 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09687e75-7678-4db0-8b3d-19ea95b40c5c service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:55:31.628048 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 774/1533] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:55:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:55:35.509924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3e779-f11c-4bbe-bb36-33f3b182d487 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:35.510482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3e779-f11c-4bbe-bb36-33f3b182d487 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:35.510482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3e779-f11c-4bbe-bb36-33f3b182d487 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:35.511844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 760/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 22:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:55:35.516954 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cf36c-4421-4778-a1a2-3ddd0827c6aa None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:35.517350 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cf36c-4421-4778-a1a2-3ddd0827c6aa None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:35.517505 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cf36c-4421-4778-a1a2-3ddd0827c6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:35.537277 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-4f3cf36c-4421-4778-a1a2-3ddd0827c6aa None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:55:35.538492 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4f3cf36c-4421-4778-a1a2-3ddd0827c6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:55:35.546105 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 775/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 22:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:55:35.849209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3e779-f11c-4bbe-bb36-33f3b182d487 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:55:35.850967 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ebd3e779-f11c-4bbe-bb36-33f3b182d487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:55:35.897995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:55:35.928310 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3e779-f11c-4bbe-bb36-33f3b182d487 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:55:35.932098 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbf86e-54f0-4faa-845a-5b956b48ddc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:55:35.932828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbf86e-54f0-4faa-845a-5b956b48ddc1 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:35.933064 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbf86e-54f0-4faa-845a-5b956b48ddc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:35.933342 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbf86e-54f0-4faa-845a-5b956b48ddc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:35.942749 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbf86e-54f0-4faa-845a-5b956b48ddc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:55:35.945827 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbf86e-54f0-4faa-845a-5b956b48ddc1 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:55:35.954558 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 761/1536] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:55:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:55:38.084856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d30a96-8c4d-48d4-aa88-3362ebae771a None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:38.085444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d30a96-8c4d-48d4-aa88-3362ebae771a None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:38.085444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d30a96-8c4d-48d4-aa88-3362ebae771a None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:38.086797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 776/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 22:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 22:55:38.092707 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efe2fb-0496-4dc8-82d2-bf4cb97a441f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:38.093142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efe2fb-0496-4dc8-82d2-bf4cb97a441f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:38.093252 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efe2fb-0496-4dc8-82d2-bf4cb97a441f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:38.113793 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f0efe2fb-0496-4dc8-82d2-bf4cb97a441f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:55:38.115556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f0efe2fb-0496-4dc8-82d2-bf4cb97a441f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:55:38.123371 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 762/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 22:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:55:38.423116 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d30a96-8c4d-48d4-aa88-3362ebae771a None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:55:38.424870 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-50d30a96-8c4d-48d4-aa88-3362ebae771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:55:38.432409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=77 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:55:38.438042 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d30a96-8c4d-48d4-aa88-3362ebae771a None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:55:38.442864 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b129a-c51c-40bf-999a-3cac80fba91f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:55:38.442864 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b129a-c51c-40bf-999a-3cac80fba91f service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:55:38.442864 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b129a-c51c-40bf-999a-3cac80fba91f service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:55:38.442864 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b129a-c51c-40bf-999a-3cac80fba91f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:55:38.452292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b129a-c51c-40bf-999a-3cac80fba91f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:55:38.453794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b129a-c51c-40bf-999a-3cac80fba91f service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:55:38.465476 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 777/1539] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:55:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:55:48.108402 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=18 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:55:48.461512 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=5 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:07.199503 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96b96f-38f3-4a0a-9f5e-b5116a1953a5 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.200144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96b96f-38f3-4a0a-9f5e-b5116a1953a5 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.200144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96b96f-38f3-4a0a-9f5e-b5116a1953a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.229436 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ca96b96f-38f3-4a0a-9f5e-b5116a1953a5 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:07.230785 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ca96b96f-38f3-4a0a-9f5e-b5116a1953a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:07.242189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 763/1540] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:07.251636 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59905f4-ca11-41b9-814e-ed506c5f9365 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.253022 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59905f4-ca11-41b9-814e-ed506c5f9365 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.253396 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59905f4-ca11-41b9-814e-ed506c5f9365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.290612 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-c59905f4-ca11-41b9-814e-ed506c5f9365 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:07.292290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c59905f4-ca11-41b9-814e-ed506c5f9365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:07.306439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 778/1541] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:07.311386 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96b96f-38f3-4a0a-9f5e-b5116a1953a5 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:07.327084 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96b96f-38f3-4a0a-9f5e-b5116a1953a5 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:07.336877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af51af-36b2-4a53-ae93-7467f688bd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:07.337514 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af51af-36b2-4a53-ae93-7467f688bd33 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.337800 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af51af-36b2-4a53-ae93-7467f688bd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.338072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af51af-36b2-4a53-ae93-7467f688bd33 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.338937 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af51af-36b2-4a53-ae93-7467f688bd33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:57:07.339190 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af51af-36b2-4a53-ae93-7467f688bd33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:07.340855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af51af-36b2-4a53-ae93-7467f688bd33 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:07.359466 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd34978-69f1-422e-a4dd-944ba441b474 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.360025 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd34978-69f1-422e-a4dd-944ba441b474 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.360533 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd34978-69f1-422e-a4dd-944ba441b474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.363358 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 764/1542] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:57:07.379530 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af51af-36b2-4a53-ae93-7467f688bd33 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:07.397991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-8bd34978-69f1-422e-a4dd-944ba441b474 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:07.400667 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-8bd34978-69f1-422e-a4dd-944ba441b474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:07.404179 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af51af-36b2-4a53-ae93-7467f688bd33 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:07.423336 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d0ba9-5c75-4ec5-a779-0d68f1335743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:07.424313 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d0ba9-5c75-4ec5-a779-0d68f1335743 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.426376 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d0ba9-5c75-4ec5-a779-0d68f1335743 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.426866 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d0ba9-5c75-4ec5-a779-0d68f1335743 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.427730 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d0ba9-5c75-4ec5-a779-0d68f1335743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:07.428147 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 779/1543] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:57:07.431559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ec209-49a4-4b98-83a0-a1f40880159d None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.433238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: WARNING py.warnings [None req-d32d0ba9-5c75-4ec5-a779-0d68f1335743 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 22:57:07.433238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: warnings.warn(msg) Sep 06 22:57:07.433238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: Sep 06 22:57:07.433930 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ec209-49a4-4b98-83a0-a1f40880159d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.435241 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ec209-49a4-4b98-83a0-a1f40880159d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.439305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d0ba9-5c75-4ec5-a779-0d68f1335743 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:07.482002 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-a39ec209-49a4-4b98-83a0-a1f40880159d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:07.484291 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-a39ec209-49a4-4b98-83a0-a1f40880159d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:07.497136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 780/1544] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:07.498950 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784a50f-c6e5-4f62-b045-d58689deb953 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.500002 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784a50f-c6e5-4f62-b045-d58689deb953 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.500590 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784a50f-c6e5-4f62-b045-d58689deb953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.520716 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-7784a50f-c6e5-4f62-b045-d58689deb953 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:07.521954 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7784a50f-c6e5-4f62-b045-d58689deb953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:07.530569 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 781/1545] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:07.531705 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea01597-8fd4-4ecb-8efc-713197e6233c None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.531993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea01597-8fd4-4ecb-8efc-713197e6233c None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.532266 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea01597-8fd4-4ecb-8efc-713197e6233c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.553961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-fea01597-8fd4-4ecb-8efc-713197e6233c None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:07.555167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-fea01597-8fd4-4ecb-8efc-713197e6233c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:07.566036 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 782/1546] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:07.567347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0223c-0ba4-427d-9033-0addd4c674e1 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.567623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0223c-0ba4-427d-9033-0addd4c674e1 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.567905 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0223c-0ba4-427d-9033-0addd4c674e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.570542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 765/1547] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:07 2022] POST /identity/v3/projects => generated 405 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:57:07.574172 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be183-a186-4f1d-9809-e8d8dbb16b1c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.574172 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be183-a186-4f1d-9809-e8d8dbb16b1c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.574172 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be183-a186-4f1d-9809-e8d8dbb16b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.600150 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-9ac0223c-0ba4-427d-9033-0addd4c674e1 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:07.601321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9ac0223c-0ba4-427d-9033-0addd4c674e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:07.603233 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-627be183-a186-4f1d-9809-e8d8dbb16b1c None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:07.604972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-627be183-a186-4f1d-9809-e8d8dbb16b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:07.660961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 783/1548] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:07.662507 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d2f13-1c2c-4c90-b63f-b11991b63bb8 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.662961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d2f13-1c2c-4c90-b63f-b11991b63bb8 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.663409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d2f13-1c2c-4c90-b63f-b11991b63bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.665379 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 766/1549] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:07.666614 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b98dea-1d4f-48fc-82b2-d2964b6ddc81 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.666895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b98dea-1d4f-48fc-82b2-d2964b6ddc81 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.667166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b98dea-1d4f-48fc-82b2-d2964b6ddc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.686588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-12b98dea-1d4f-48fc-82b2-d2964b6ddc81 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:07.687779 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-12b98dea-1d4f-48fc-82b2-d2964b6ddc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:07.688547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-f57d2f13-1c2c-4c90-b63f-b11991b63bb8 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:07.689713 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f57d2f13-1c2c-4c90-b63f-b11991b63bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:07.695955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 767/1550] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:07.696800 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b98dea-1d4f-48fc-82b2-d2964b6ddc81 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:07.697906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 784/1551] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:07.701527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d2f13-1c2c-4c90-b63f-b11991b63bb8 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:07.706573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b98dea-1d4f-48fc-82b2-d2964b6ddc81 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:07.711722 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b901b99-a7b9-47f8-b11c-8a6fc1ec0d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:07.712805 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b901b99-a7b9-47f8-b11c-8a6fc1ec0d27 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.713122 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b901b99-a7b9-47f8-b11c-8a6fc1ec0d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.713389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b901b99-a7b9-47f8-b11c-8a6fc1ec0d27 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.713945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d2f13-1c2c-4c90-b63f-b11991b63bb8 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:07.714060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b901b99-a7b9-47f8-b11c-8a6fc1ec0d27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:57:07.714316 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b901b99-a7b9-47f8-b11c-8a6fc1ec0d27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:07.715915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b901b99-a7b9-47f8-b11c-8a6fc1ec0d27 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:07.719190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3875ea-ddbd-4d6e-97d1-bf95f3eb29c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:07.719823 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3875ea-ddbd-4d6e-97d1-bf95f3eb29c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.720082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3875ea-ddbd-4d6e-97d1-bf95f3eb29c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.720376 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3875ea-ddbd-4d6e-97d1-bf95f3eb29c1 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.721592 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3875ea-ddbd-4d6e-97d1-bf95f3eb29c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:07.722714 dv-cinder-852208-20-smb devstack@keystone.service[88078]: WARNING py.warnings [None req-fb3875ea-ddbd-4d6e-97d1-bf95f3eb29c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 22:57:07.722714 dv-cinder-852208-20-smb devstack@keystone.service[88078]: warnings.warn(msg) Sep 06 22:57:07.722714 dv-cinder-852208-20-smb devstack@keystone.service[88078]: Sep 06 22:57:07.724330 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3875ea-ddbd-4d6e-97d1-bf95f3eb29c1 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:07.728887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 768/1552] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:57:07.730889 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135eaf3-5bb7-4f7a-944b-7734b53d9e1a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.731177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135eaf3-5bb7-4f7a-944b-7734b53d9e1a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.731544 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135eaf3-5bb7-4f7a-944b-7734b53d9e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.753776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c135eaf3-5bb7-4f7a-944b-7734b53d9e1a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:07.754976 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c135eaf3-5bb7-4f7a-944b-7734b53d9e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:07.762890 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 769/1553] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:07.764041 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a7b25-c7a7-4ff2-b01d-d7cf0100a6c2 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.764320 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a7b25-c7a7-4ff2-b01d-d7cf0100a6c2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.764674 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a7b25-c7a7-4ff2-b01d-d7cf0100a6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.784050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-538a7b25-c7a7-4ff2-b01d-d7cf0100a6c2 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:07.785254 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-538a7b25-c7a7-4ff2-b01d-d7cf0100a6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:07.793068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 770/1554] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:07.794330 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89faae-030d-48fd-af72-87207c0c37aa None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.794610 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89faae-030d-48fd-af72-87207c0c37aa None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.794879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89faae-030d-48fd-af72-87207c0c37aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.814110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-df89faae-030d-48fd-af72-87207c0c37aa None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:07.815274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-df89faae-030d-48fd-af72-87207c0c37aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:07.823221 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 771/1555] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:07.824535 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568cf5d-96f2-4f5b-a88b-0fd89a3fb4e7 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.824811 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568cf5d-96f2-4f5b-a88b-0fd89a3fb4e7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.825084 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568cf5d-96f2-4f5b-a88b-0fd89a3fb4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.834370 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 785/1556] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:07 2022] POST /identity/v3/users => generated 303 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:07.835420 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3875ea-ddbd-4d6e-97d1-bf95f3eb29c1 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:07.844845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f568cf5d-96f2-4f5b-a88b-0fd89a3fb4e7 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:07.845084 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3875ea-ddbd-4d6e-97d1-bf95f3eb29c1 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:07.846035 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f568cf5d-96f2-4f5b-a88b-0fd89a3fb4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:07.849824 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25c97d-14bf-4901-8095-65c4977543eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:07.850474 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25c97d-14bf-4901-8095-65c4977543eb admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.850824 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25c97d-14bf-4901-8095-65c4977543eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.851102 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25c97d-14bf-4901-8095-65c4977543eb admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.851789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25c97d-14bf-4901-8095-65c4977543eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:57:07.852127 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25c97d-14bf-4901-8095-65c4977543eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:07.853099 dv-cinder-852208-20-smb devstack@keystone.service[88078]: WARNING py.warnings [None req-4e25c97d-14bf-4901-8095-65c4977543eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 22:57:07.853099 dv-cinder-852208-20-smb devstack@keystone.service[88078]: warnings.warn(msg) Sep 06 22:57:07.853099 dv-cinder-852208-20-smb devstack@keystone.service[88078]: Sep 06 22:57:07.853997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25c97d-14bf-4901-8095-65c4977543eb admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:07.854121 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 772/1557] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:07.857321 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568cf5d-96f2-4f5b-a88b-0fd89a3fb4e7 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:07.866563 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568cf5d-96f2-4f5b-a88b-0fd89a3fb4e7 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:07.867079 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 786/1558] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:57:07.868036 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25c97d-14bf-4901-8095-65c4977543eb admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:07.877625 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61b99a-7644-4498-a584-b9d1179d1772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:07.877986 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25c97d-14bf-4901-8095-65c4977543eb admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:07.878252 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61b99a-7644-4498-a584-b9d1179d1772 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.878590 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61b99a-7644-4498-a584-b9d1179d1772 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.878789 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61b99a-7644-4498-a584-b9d1179d1772 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.879435 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61b99a-7644-4498-a584-b9d1179d1772 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:57:07.879757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61b99a-7644-4498-a584-b9d1179d1772 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:07.881465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61b99a-7644-4498-a584-b9d1179d1772 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:07.882608 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59c877-2d67-4c91-afbc-e404701bed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:07.883188 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59c877-2d67-4c91-afbc-e404701bed7a admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.883465 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59c877-2d67-4c91-afbc-e404701bed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.883737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59c877-2d67-4c91-afbc-e404701bed7a admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.884358 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59c877-2d67-4c91-afbc-e404701bed7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:07.886285 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59c877-2d67-4c91-afbc-e404701bed7a admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:07.894017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 773/1559] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:57:07.895283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4db98-2626-4821-8ded-6c997ca49f62 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.895578 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4db98-2626-4821-8ded-6c997ca49f62 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.895846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4db98-2626-4821-8ded-6c997ca49f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.915639 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9ca4db98-2626-4821-8ded-6c997ca49f62 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:07.916907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9ca4db98-2626-4821-8ded-6c997ca49f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:07.924726 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 774/1560] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:07.925996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba7f9e-d230-4782-8cce-2d25f7acff43 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.926276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba7f9e-d230-4782-8cce-2d25f7acff43 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.926559 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba7f9e-d230-4782-8cce-2d25f7acff43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.945772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-bfba7f9e-d230-4782-8cce-2d25f7acff43 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:07.946913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bfba7f9e-d230-4782-8cce-2d25f7acff43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:07.955205 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 775/1561] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:07.956073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba7f9e-d230-4782-8cce-2d25f7acff43 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:07.965365 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba7f9e-d230-4782-8cce-2d25f7acff43 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:07.970189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae6aa7-efed-41b3-8a5d-21e0e8396b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:07.970757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae6aa7-efed-41b3-8a5d-21e0e8396b31 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:07.971032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae6aa7-efed-41b3-8a5d-21e0e8396b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:07.971302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae6aa7-efed-41b3-8a5d-21e0e8396b31 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:07.971926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae6aa7-efed-41b3-8a5d-21e0e8396b31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:57:07.972237 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae6aa7-efed-41b3-8a5d-21e0e8396b31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:07.973853 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae6aa7-efed-41b3-8a5d-21e0e8396b31 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:07.985158 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 776/1562] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:57:07.986230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae6aa7-efed-41b3-8a5d-21e0e8396b31 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:07.995259 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 787/1563] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:07 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:08.000669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59c877-2d67-4c91-afbc-e404701bed7a admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:08.000793 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae6aa7-efed-41b3-8a5d-21e0e8396b31 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:08.022346 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:08.059308 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0c1d6-222c-464b-8311-bd743530143f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:08.059918 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0c1d6-222c-464b-8311-bd743530143f admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:08.060206 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0c1d6-222c-464b-8311-bd743530143f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:08.060509 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0c1d6-222c-464b-8311-bd743530143f admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:08.061157 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0c1d6-222c-464b-8311-bd743530143f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:08.063308 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0c1d6-222c-464b-8311-bd743530143f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:08.064442 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59c877-2d67-4c91-afbc-e404701bed7a admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:08.069273 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511e1b8-d8b0-404c-a301-1f94d09ea9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:08.070244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511e1b8-d8b0-404c-a301-1f94d09ea9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:08.070575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511e1b8-d8b0-404c-a301-1f94d09ea9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:08.070851 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511e1b8-d8b0-404c-a301-1f94d09ea9a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:08.071499 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511e1b8-d8b0-404c-a301-1f94d09ea9a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:57:08.071803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511e1b8-d8b0-404c-a301-1f94d09ea9a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:08.073423 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511e1b8-d8b0-404c-a301-1f94d09ea9a4 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:08.073821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 777/1564] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:08.074462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0c1d6-222c-464b-8311-bd743530143f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:08.086918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 788/1565] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:57:08.087945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511e1b8-d8b0-404c-a301-1f94d09ea9a4 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:08.089559 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0c1d6-222c-464b-8311-bd743530143f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:08.096653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:08.097383 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ad10e-08f3-4f07-9ead-3f2b85f47a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:08.097383 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ad10e-08f3-4f07-9ead-3f2b85f47a87 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:08.097383 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ad10e-08f3-4f07-9ead-3f2b85f47a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:08.097383 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ad10e-08f3-4f07-9ead-3f2b85f47a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:08.097750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ad10e-08f3-4f07-9ead-3f2b85f47a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:08.099234 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ad10e-08f3-4f07-9ead-3f2b85f47a87 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:08.099881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511e1b8-d8b0-404c-a301-1f94d09ea9a4 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:08.104867 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88603d8-e6df-46f0-b23d-7c42565d4323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:08.105654 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88603d8-e6df-46f0-b23d-7c42565d4323 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:08.106042 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88603d8-e6df-46f0-b23d-7c42565d4323 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:08.106389 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88603d8-e6df-46f0-b23d-7c42565d4323 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:08.107095 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88603d8-e6df-46f0-b23d-7c42565d4323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:08.109719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88603d8-e6df-46f0-b23d-7c42565d4323 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:08.194316 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 778/1566] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:08 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:08.195435 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ad10e-08f3-4f07-9ead-3f2b85f47a87 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:08.214557 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 789/1567] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:08 2022] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:08.214557 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88603d8-e6df-46f0-b23d-7c42565d4323 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:08.261983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ad10e-08f3-4f07-9ead-3f2b85f47a87 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:08.272227 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88603d8-e6df-46f0-b23d-7c42565d4323 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:08.276989 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4610e-7ab7-4940-9b2b-c69dc99d71c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:08.277629 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4610e-7ab7-4940-9b2b-c69dc99d71c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:08.277910 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4610e-7ab7-4940-9b2b-c69dc99d71c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:08.278185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4610e-7ab7-4940-9b2b-c69dc99d71c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:08.278834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4610e-7ab7-4940-9b2b-c69dc99d71c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:57:08.279137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4610e-7ab7-4940-9b2b-c69dc99d71c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:08.280818 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4610e-7ab7-4940-9b2b-c69dc99d71c8 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:08.300021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 790/1568] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:57:08.300021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4610e-7ab7-4940-9b2b-c69dc99d71c8 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:08.303366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4610e-7ab7-4940-9b2b-c69dc99d71c8 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:08.308193 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1b84a-b253-4c2a-9308-a9bb321cfc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:08.308861 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1b84a-b253-4c2a-9308-a9bb321cfc0b admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:08.309116 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1b84a-b253-4c2a-9308-a9bb321cfc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:08.309384 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1b84a-b253-4c2a-9308-a9bb321cfc0b admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:08.310002 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1b84a-b253-4c2a-9308-a9bb321cfc0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:08.312723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1b84a-b253-4c2a-9308-a9bb321cfc0b admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:08.326696 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47663ea-22ee-4b12-904d-14f973a7a8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:08.327311 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47663ea-22ee-4b12-904d-14f973a7a8dc admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:08.327591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47663ea-22ee-4b12-904d-14f973a7a8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:08.327862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47663ea-22ee-4b12-904d-14f973a7a8dc admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:08.328548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47663ea-22ee-4b12-904d-14f973a7a8dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:57:08.328851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47663ea-22ee-4b12-904d-14f973a7a8dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:08.330456 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47663ea-22ee-4b12-904d-14f973a7a8dc admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:08.341893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 779/1569] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:57:08.342662 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47663ea-22ee-4b12-904d-14f973a7a8dc admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:08.352114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47663ea-22ee-4b12-904d-14f973a7a8dc admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:08.356800 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9ea2e-4bf6-45c1-bb5e-e9d4d197765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:08.357316 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9ea2e-4bf6-45c1-bb5e-e9d4d197765e admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:08.357591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9ea2e-4bf6-45c1-bb5e-e9d4d197765e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:08.357861 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9ea2e-4bf6-45c1-bb5e-e9d4d197765e admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:08.359090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9ea2e-4bf6-45c1-bb5e-e9d4d197765e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:08.361038 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9ea2e-4bf6-45c1-bb5e-e9d4d197765e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:08.383280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 791/1570] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:08 2022] POST /identity/v3/projects => generated 393 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:08.384109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1b84a-b253-4c2a-9308-a9bb321cfc0b admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:08.444049 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1b84a-b253-4c2a-9308-a9bb321cfc0b admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:08.448936 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba1b57-7caa-4930-8555-f61fccfde505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:08.449559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba1b57-7caa-4930-8555-f61fccfde505 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:08.449837 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba1b57-7caa-4930-8555-f61fccfde505 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:08.450107 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba1b57-7caa-4930-8555-f61fccfde505 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:08.450779 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba1b57-7caa-4930-8555-f61fccfde505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:08.452405 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba1b57-7caa-4930-8555-f61fccfde505 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:08.459081 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 780/1571] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:08 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:08.459081 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9ea2e-4bf6-45c1-bb5e-e9d4d197765e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:08.465677 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 792/1572] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:08.465677 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba1b57-7caa-4930-8555-f61fccfde505 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:08.470393 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9ea2e-4bf6-45c1-bb5e-e9d4d197765e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:08.473791 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba1b57-7caa-4930-8555-f61fccfde505 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:08.475409 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f2cb0-5d87-4792-9996-19cc6c65535c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:08.476014 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f2cb0-5d87-4792-9996-19cc6c65535c admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:08.476288 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f2cb0-5d87-4792-9996-19cc6c65535c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:08.476624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f2cb0-5d87-4792-9996-19cc6c65535c admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:08.477258 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f2cb0-5d87-4792-9996-19cc6c65535c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:08.478788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf07f7-42d8-4afe-a5d5-8cdd1e83599b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:08.479175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f2cb0-5d87-4792-9996-19cc6c65535c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:08.479385 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf07f7-42d8-4afe-a5d5-8cdd1e83599b admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:08.479663 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf07f7-42d8-4afe-a5d5-8cdd1e83599b admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:08.479935 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf07f7-42d8-4afe-a5d5-8cdd1e83599b admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:08.480590 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf07f7-42d8-4afe-a5d5-8cdd1e83599b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:08.482512 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf07f7-42d8-4afe-a5d5-8cdd1e83599b admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:08.575367 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 793/1573] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:08 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:08.576167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf07f7-42d8-4afe-a5d5-8cdd1e83599b admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:08.587472 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf07f7-42d8-4afe-a5d5-8cdd1e83599b admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:08.592006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d09ad-a49b-493f-a2c3-ee4f56eb040c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:08.592609 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d09ad-a49b-493f-a2c3-ee4f56eb040c admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:08.593406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d09ad-a49b-493f-a2c3-ee4f56eb040c admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:08.593678 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d09ad-a49b-493f-a2c3-ee4f56eb040c admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:08.594294 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d09ad-a49b-493f-a2c3-ee4f56eb040c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:08.596211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d09ad-a49b-493f-a2c3-ee4f56eb040c admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:08.599383 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:08.605936 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 781/1574] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:08 2022] POST /identity/v3/projects => generated 393 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:08.609128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f2cb0-5d87-4792-9996-19cc6c65535c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:08.669094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f2cb0-5d87-4792-9996-19cc6c65535c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:08.674540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b28484-5e01-48e0-9d0b-fcefb1f7bc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:08.675146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b28484-5e01-48e0-9d0b-fcefb1f7bc43 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:08.675423 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b28484-5e01-48e0-9d0b-fcefb1f7bc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:08.675693 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b28484-5e01-48e0-9d0b-fcefb1f7bc43 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:08.676320 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b28484-5e01-48e0-9d0b-fcefb1f7bc43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:08.678325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b28484-5e01-48e0-9d0b-fcefb1f7bc43 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:08.683075 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 794/1575] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:08 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:08.683075 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d09ad-a49b-493f-a2c3-ee4f56eb040c admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:08.690501 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d09ad-a49b-493f-a2c3-ee4f56eb040c admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:08.695303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfff79-f7fa-40fd-b68e-3e3f00fe2f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:08.695890 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfff79-f7fa-40fd-b68e-3e3f00fe2f2b admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:08.696165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfff79-f7fa-40fd-b68e-3e3f00fe2f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:08.696466 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfff79-f7fa-40fd-b68e-3e3f00fe2f2b admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:08.697198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfff79-f7fa-40fd-b68e-3e3f00fe2f2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:08.699080 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfff79-f7fa-40fd-b68e-3e3f00fe2f2b admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:08.710008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:08.742459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 782/1576] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:08 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:08.743439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b28484-5e01-48e0-9d0b-fcefb1f7bc43 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:08.760103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 795/1577] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:08 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:08.764091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfff79-f7fa-40fd-b68e-3e3f00fe2f2b admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:08.806044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b28484-5e01-48e0-9d0b-fcefb1f7bc43 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:08.828740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfff79-f7fa-40fd-b68e-3e3f00fe2f2b admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:08.833417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c700d95-b483-48d5-9ef8-717a72734616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:08.834059 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c700d95-b483-48d5-9ef8-717a72734616 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:08.834342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c700d95-b483-48d5-9ef8-717a72734616 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:08.834614 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c700d95-b483-48d5-9ef8-717a72734616 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:08.835252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c700d95-b483-48d5-9ef8-717a72734616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:08.836889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c700d95-b483-48d5-9ef8-717a72734616 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:08.847166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 796/1578] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:08.847955 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c700d95-b483-48d5-9ef8-717a72734616 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:08.857719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c700d95-b483-48d5-9ef8-717a72734616 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:08.862433 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e553d1a-1ccd-4954-9951-e65914eeb61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:08.863012 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e553d1a-1ccd-4954-9951-e65914eeb61f admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:08.863287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e553d1a-1ccd-4954-9951-e65914eeb61f admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:08.863555 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e553d1a-1ccd-4954-9951-e65914eeb61f admin admin] PATH_INFO: `/v3/projects/c6913a91c8e54107a52714d21e8b99cd/users/d3b0816fdfc14eecab07a55a035064a0/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:08.863758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56c634-8bca-4400-97e8-54a3980cc155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:08.864489 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56c634-8bca-4400-97e8-54a3980cc155 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:08.864884 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56c634-8bca-4400-97e8-54a3980cc155 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:08.865160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56c634-8bca-4400-97e8-54a3980cc155 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:08.865789 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56c634-8bca-4400-97e8-54a3980cc155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:08.867730 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56c634-8bca-4400-97e8-54a3980cc155 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:08.877997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e553d1a-1ccd-4954-9951-e65914eeb61f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6913a91c8e54107a52714d21e8b99cd, user_id=d3b0816fdfc14eecab07a55a035064a0, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:08.880708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e553d1a-1ccd-4954-9951-e65914eeb61f admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:08.941121 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 783/1579] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:08 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:08.941945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56c634-8bca-4400-97e8-54a3980cc155 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:08.951937 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56c634-8bca-4400-97e8-54a3980cc155 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:08.953342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 797/1580] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:08 2022] PUT /identity/v3/projects/c6913a91c8e54107a52714d21e8b99cd/users/d3b0816fdfc14eecab07a55a035064a0/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:08.954298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e553d1a-1ccd-4954-9951-e65914eeb61f admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:08.972909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:09.010354 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34c65d-5e8b-40b5-934b-dcbdeb018f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.010984 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34c65d-5e8b-40b5-934b-dcbdeb018f7f admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.011264 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34c65d-5e8b-40b5-934b-dcbdeb018f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.011553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34c65d-5e8b-40b5-934b-dcbdeb018f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.012180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34c65d-5e8b-40b5-934b-dcbdeb018f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.013879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34c65d-5e8b-40b5-934b-dcbdeb018f7f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.014248 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e553d1a-1ccd-4954-9951-e65914eeb61f admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.019449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab8ec6-0b75-4325-9ce2-ccf68d2bfe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.020061 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab8ec6-0b75-4325-9ce2-ccf68d2bfe0e admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.020345 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab8ec6-0b75-4325-9ce2-ccf68d2bfe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.020649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab8ec6-0b75-4325-9ce2-ccf68d2bfe0e admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.021420 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab8ec6-0b75-4325-9ce2-ccf68d2bfe0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.023335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab8ec6-0b75-4325-9ce2-ccf68d2bfe0e admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.024067 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 784/1581] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:09.024963 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34c65d-5e8b-40b5-934b-dcbdeb018f7f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:09.034969 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34c65d-5e8b-40b5-934b-dcbdeb018f7f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.040263 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe7143-b2a6-4c8f-8724-8b5eafe67fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.041307 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe7143-b2a6-4c8f-8724-8b5eafe67fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.041307 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe7143-b2a6-4c8f-8724-8b5eafe67fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.041537 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe7143-b2a6-4c8f-8724-8b5eafe67fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.042149 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe7143-b2a6-4c8f-8724-8b5eafe67fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.043763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe7143-b2a6-4c8f-8724-8b5eafe67fa9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.053388 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 785/1582] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:09.054189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe7143-b2a6-4c8f-8724-8b5eafe67fa9 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:09.063417 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe7143-b2a6-4c8f-8724-8b5eafe67fa9 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.068121 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f68ed-ec86-46ee-bb78-8bb4d0316df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.068736 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f68ed-ec86-46ee-bb78-8bb4d0316df4 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.069013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f68ed-ec86-46ee-bb78-8bb4d0316df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.069283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f68ed-ec86-46ee-bb78-8bb4d0316df4 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.070171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f68ed-ec86-46ee-bb78-8bb4d0316df4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.072067 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f68ed-ec86-46ee-bb78-8bb4d0316df4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.097037 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 798/1583] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:08 2022] POST /identity/v3/users => generated 297 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:09.099010 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab8ec6-0b75-4325-9ce2-ccf68d2bfe0e admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:09.108161 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab8ec6-0b75-4325-9ce2-ccf68d2bfe0e admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.113099 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04e404-6860-4248-884d-89efe2aa39e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.113631 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04e404-6860-4248-884d-89efe2aa39e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.113906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04e404-6860-4248-884d-89efe2aa39e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.114175 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04e404-6860-4248-884d-89efe2aa39e7 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.114785 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04e404-6860-4248-884d-89efe2aa39e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.116725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04e404-6860-4248-884d-89efe2aa39e7 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.152576 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 786/1584] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:09 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:09.153399 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f68ed-ec86-46ee-bb78-8bb4d0316df4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:09.163312 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f68ed-ec86-46ee-bb78-8bb4d0316df4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.167797 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cedff-6fc8-4434-9eb2-670b39c4eee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.168399 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cedff-6fc8-4434-9eb2-670b39c4eee4 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.168728 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cedff-6fc8-4434-9eb2-670b39c4eee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.168999 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cedff-6fc8-4434-9eb2-670b39c4eee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.169617 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cedff-6fc8-4434-9eb2-670b39c4eee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.171182 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cedff-6fc8-4434-9eb2-670b39c4eee4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.181179 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 787/1585] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:09.181895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cedff-6fc8-4434-9eb2-670b39c4eee4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:09.190826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cedff-6fc8-4434-9eb2-670b39c4eee4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.195525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212c7e1-7da0-4f0c-8c2b-4c7c4b4434e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.196057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212c7e1-7da0-4f0c-8c2b-4c7c4b4434e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.196332 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212c7e1-7da0-4f0c-8c2b-4c7c4b4434e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.196640 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212c7e1-7da0-4f0c-8c2b-4c7c4b4434e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.197278 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212c7e1-7da0-4f0c-8c2b-4c7c4b4434e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.198751 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212c7e1-7da0-4f0c-8c2b-4c7c4b4434e3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.208744 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 788/1586] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:09.209831 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b999aa-b20e-41cd-a60c-f6d5da0ea89f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.210106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b999aa-b20e-41cd-a60c-f6d5da0ea89f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.210375 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b999aa-b20e-41cd-a60c-f6d5da0ea89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.228760 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a4b999aa-b20e-41cd-a60c-f6d5da0ea89f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:09.229933 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a4b999aa-b20e-41cd-a60c-f6d5da0ea89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:09.239095 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 789/1587] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:09.239696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 799/1588] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:09 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:09.240671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b999aa-b20e-41cd-a60c-f6d5da0ea89f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:09.243744 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04e404-6860-4248-884d-89efe2aa39e7 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:09.253762 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04e404-6860-4248-884d-89efe2aa39e7 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.258362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903535aa-40e9-4027-b1cf-dea22a491667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.258967 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903535aa-40e9-4027-b1cf-dea22a491667 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.259244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903535aa-40e9-4027-b1cf-dea22a491667 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.259518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903535aa-40e9-4027-b1cf-dea22a491667 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.260153 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903535aa-40e9-4027-b1cf-dea22a491667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.261701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b999aa-b20e-41cd-a60c-f6d5da0ea89f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.261884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903535aa-40e9-4027-b1cf-dea22a491667 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.267030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402edbfe-3359-48bb-83ac-b26f1bdb7d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.267651 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402edbfe-3359-48bb-83ac-b26f1bdb7d1e admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.267921 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402edbfe-3359-48bb-83ac-b26f1bdb7d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.268193 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402edbfe-3359-48bb-83ac-b26f1bdb7d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.268874 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402edbfe-3359-48bb-83ac-b26f1bdb7d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.270640 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402edbfe-3359-48bb-83ac-b26f1bdb7d1e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.276814 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 800/1589] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:09.276814 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903535aa-40e9-4027-b1cf-dea22a491667 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:09.285189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 790/1590] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:09.285189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402edbfe-3359-48bb-83ac-b26f1bdb7d1e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:09.290552 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903535aa-40e9-4027-b1cf-dea22a491667 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.292293 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbaa141-42c7-4172-a754-0c268190b4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.292956 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaa141-42c7-4172-a754-0c268190b4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.293238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaa141-42c7-4172-a754-0c268190b4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.293515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaa141-42c7-4172-a754-0c268190b4b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.294205 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbaa141-42c7-4172-a754-0c268190b4b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.294767 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402edbfe-3359-48bb-83ac-b26f1bdb7d1e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.295835 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbaa141-42c7-4172-a754-0c268190b4b6 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.299382 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ce0a0-98a5-4e2d-bd25-9ab1397decda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.299966 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ce0a0-98a5-4e2d-bd25-9ab1397decda admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.300244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ce0a0-98a5-4e2d-bd25-9ab1397decda admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.300538 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ce0a0-98a5-4e2d-bd25-9ab1397decda admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.301176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ce0a0-98a5-4e2d-bd25-9ab1397decda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.302736 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ce0a0-98a5-4e2d-bd25-9ab1397decda admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.306281 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 801/1591] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:09.307194 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbaa141-42c7-4172-a754-0c268190b4b6 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:09.314594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 791/1592] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:09.314594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ce0a0-98a5-4e2d-bd25-9ab1397decda admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:09.318188 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbaa141-42c7-4172-a754-0c268190b4b6 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.322756 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a031f36-1576-47e1-bb26-fdabd2fcaf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.323525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a031f36-1576-47e1-bb26-fdabd2fcaf7f admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.323770 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ce0a0-98a5-4e2d-bd25-9ab1397decda admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.324016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a031f36-1576-47e1-bb26-fdabd2fcaf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.324401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a031f36-1576-47e1-bb26-fdabd2fcaf7f admin admin] PATH_INFO: `/v3/projects/791a282713c44cb0b39f5d0c81fa3fc9/users/ad52861013c14098826162b8ea3740d4/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.328948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ed149-f017-45ce-aeca-d10febac5a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.329523 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ed149-f017-45ce-aeca-d10febac5a62 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.329803 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ed149-f017-45ce-aeca-d10febac5a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.330069 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ed149-f017-45ce-aeca-d10febac5a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.330694 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ed149-f017-45ce-aeca-d10febac5a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.332281 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ed149-f017-45ce-aeca-d10febac5a62 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.337153 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:09.340802 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a031f36-1576-47e1-bb26-fdabd2fcaf7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=791a282713c44cb0b39f5d0c81fa3fc9, user_id=ad52861013c14098826162b8ea3740d4, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.343001 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 792/1593] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:09.344991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ed149-f017-45ce-aeca-d10febac5a62 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:09.345090 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a031f36-1576-47e1-bb26-fdabd2fcaf7f admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.353162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ed149-f017-45ce-aeca-d10febac5a62 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.357706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f085030-77c3-4669-9931-fcbdc8e60a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.358281 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f085030-77c3-4669-9931-fcbdc8e60a61 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.358561 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f085030-77c3-4669-9931-fcbdc8e60a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.358835 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f085030-77c3-4669-9931-fcbdc8e60a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.359458 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f085030-77c3-4669-9931-fcbdc8e60a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.361073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f085030-77c3-4669-9931-fcbdc8e60a61 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.371128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 793/1594] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:09.371952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f085030-77c3-4669-9931-fcbdc8e60a61 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:09.421140 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 802/1595] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:09 2022] PUT /identity/v3/projects/791a282713c44cb0b39f5d0c81fa3fc9/users/ad52861013c14098826162b8ea3740d4/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:09.421957 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a031f36-1576-47e1-bb26-fdabd2fcaf7f admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:09.426407 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f085030-77c3-4669-9931-fcbdc8e60a61 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.459037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:09.477747 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a501c-d954-4d80-a87e-cdf12d183e96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.478371 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a501c-d954-4d80-a87e-cdf12d183e96 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.478650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a501c-d954-4d80-a87e-cdf12d183e96 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.478922 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a501c-d954-4d80-a87e-cdf12d183e96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.486762 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a031f36-1576-47e1-bb26-fdabd2fcaf7f admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.487880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a501c-d954-4d80-a87e-cdf12d183e96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.489391 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a501c-d954-4d80-a87e-cdf12d183e96 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.491532 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e29dca-7f4b-4922-9402-a724dd30773b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.492192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e29dca-7f4b-4922-9402-a724dd30773b admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.492509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e29dca-7f4b-4922-9402-a724dd30773b admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.492786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e29dca-7f4b-4922-9402-a724dd30773b admin admin] PATH_INFO: `/v3/projects/01180a7896ce42c9a0b42167d6c49512/users/07a7969f07564904bc69fe0d026c6fb3/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.499472 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 794/1596] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:09.500247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a501c-d954-4d80-a87e-cdf12d183e96 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:09.509507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a501c-d954-4d80-a87e-cdf12d183e96 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.509933 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e29dca-7f4b-4922-9402-a724dd30773b admin admin] RBAC: Authorizing `identity:create_grant(project_id=01180a7896ce42c9a0b42167d6c49512, user_id=07a7969f07564904bc69fe0d026c6fb3, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.512817 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e29dca-7f4b-4922-9402-a724dd30773b admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.514242 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1901a5d-1baa-4a24-a3a3-4e8c981c3b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.515475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1901a5d-1baa-4a24-a3a3-4e8c981c3b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.515759 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1901a5d-1baa-4a24-a3a3-4e8c981c3b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.516036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1901a5d-1baa-4a24-a3a3-4e8c981c3b9c admin admin] PATH_INFO: `/v3/projects/03584e607ce74fa398f793b8fdb1145e/users/5655757c28a446ed8f7468a4146aa09c/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.531798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1901a5d-1baa-4a24-a3a3-4e8c981c3b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=03584e607ce74fa398f793b8fdb1145e, user_id=5655757c28a446ed8f7468a4146aa09c, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.532894 dv-cinder-852208-20-smb devstack@keystone.service[88077]: WARNING py.warnings [None req-d1901a5d-1baa-4a24-a3a3-4e8c981c3b9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 22:57:09.532894 dv-cinder-852208-20-smb devstack@keystone.service[88077]: warnings.warn(msg) Sep 06 22:57:09.532894 dv-cinder-852208-20-smb devstack@keystone.service[88077]: Sep 06 22:57:09.534957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1901a5d-1baa-4a24-a3a3-4e8c981c3b9c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.558876 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 803/1597] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:09 2022] PUT /identity/v3/projects/01180a7896ce42c9a0b42167d6c49512/users/07a7969f07564904bc69fe0d026c6fb3/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:09.559712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e29dca-7f4b-4922-9402-a724dd30773b admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:09.630329 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e29dca-7f4b-4922-9402-a724dd30773b admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.635253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98f324-ae5f-4278-aded-333f47fc9db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.635881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98f324-ae5f-4278-aded-333f47fc9db8 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.636160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98f324-ae5f-4278-aded-333f47fc9db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.636445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98f324-ae5f-4278-aded-333f47fc9db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.637169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98f324-ae5f-4278-aded-333f47fc9db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.638738 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98f324-ae5f-4278-aded-333f47fc9db8 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.643784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 795/1598] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:09 2022] PUT /identity/v3/projects/03584e607ce74fa398f793b8fdb1145e/users/5655757c28a446ed8f7468a4146aa09c/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:09.644865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1901a5d-1baa-4a24-a3a3-4e8c981c3b9c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:09.649723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 804/1599] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:09.653634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98f324-ae5f-4278-aded-333f47fc9db8 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:09.663601 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98f324-ae5f-4278-aded-333f47fc9db8 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.711602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1901a5d-1baa-4a24-a3a3-4e8c981c3b9c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.716565 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71525a62-bdcc-4de3-b3ae-5202cac243bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.717297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71525a62-bdcc-4de3-b3ae-5202cac243bd admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.717698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71525a62-bdcc-4de3-b3ae-5202cac243bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.717976 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71525a62-bdcc-4de3-b3ae-5202cac243bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.718625 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71525a62-bdcc-4de3-b3ae-5202cac243bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.720286 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71525a62-bdcc-4de3-b3ae-5202cac243bd admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.723608 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646a3a2-be98-4104-af47-ca3736a0eb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.723837 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646a3a2-be98-4104-af47-ca3736a0eb9f admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.724118 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646a3a2-be98-4104-af47-ca3736a0eb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.724537 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646a3a2-be98-4104-af47-ca3736a0eb9f admin admin] PATH_INFO: `/v3/projects/47f34c30b518437aa90e551119913061/users/622aaaa19ad74935bda142780d375f61/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.730708 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 796/1600] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:09.731554 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71525a62-bdcc-4de3-b3ae-5202cac243bd admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:09.739382 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:09.743070 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71525a62-bdcc-4de3-b3ae-5202cac243bd admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.743600 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646a3a2-be98-4104-af47-ca3736a0eb9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f34c30b518437aa90e551119913061, user_id=622aaaa19ad74935bda142780d375f61, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.746659 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646a3a2-be98-4104-af47-ca3736a0eb9f admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.748443 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161f258-55c7-44de-826b-87cc4f6129ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.752081 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161f258-55c7-44de-826b-87cc4f6129ca admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.752081 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161f258-55c7-44de-826b-87cc4f6129ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.752081 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161f258-55c7-44de-826b-87cc4f6129ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.752081 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161f258-55c7-44de-826b-87cc4f6129ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:09.752678 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161f258-55c7-44de-826b-87cc4f6129ca admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:09.766842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 797/1601] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:09.766842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f321fb-f4e3-493c-a77b-b06aad6dd755 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.766842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f321fb-f4e3-493c-a77b-b06aad6dd755 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.766842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f321fb-f4e3-493c-a77b-b06aad6dd755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.795280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-46f321fb-f4e3-493c-a77b-b06aad6dd755 None None] MFA Rules not processed for user `ad52861013c14098826162b8ea3740d4`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:09.797069 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-46f321fb-f4e3-493c-a77b-b06aad6dd755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:09.854276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 805/1602] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:09 2022] PUT /identity/v3/projects/47f34c30b518437aa90e551119913061/users/622aaaa19ad74935bda142780d375f61/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:09.855678 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c151d32-5375-4b22-b44d-d1f77e0e488b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.855968 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c151d32-5375-4b22-b44d-d1f77e0e488b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.856567 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c151d32-5375-4b22-b44d-d1f77e0e488b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.878533 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-1c151d32-5375-4b22-b44d-d1f77e0e488b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:09.879853 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1c151d32-5375-4b22-b44d-d1f77e0e488b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:09.888622 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 798/1603] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:09.889707 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939071b-f79e-4359-baf8-e88bd59ea6c7 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.889989 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939071b-f79e-4359-baf8-e88bd59ea6c7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.890263 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939071b-f79e-4359-baf8-e88bd59ea6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.911381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2939071b-f79e-4359-baf8-e88bd59ea6c7 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:09.912604 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2939071b-f79e-4359-baf8-e88bd59ea6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:09.935073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:09.962140 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 806/1604] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:09.963136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c151d32-5375-4b22-b44d-d1f77e0e488b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:09.975782 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c151d32-5375-4b22-b44d-d1f77e0e488b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:09.980877 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952121a-7dbb-4720-9df9-9f5f0718f184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:09.982568 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952121a-7dbb-4720-9df9-9f5f0718f184 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:09.982568 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952121a-7dbb-4720-9df9-9f5f0718f184 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:09.982568 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952121a-7dbb-4720-9df9-9f5f0718f184 admin admin] PATH_INFO: `/v3/projects/231688be9b6547999252977eaa6b475d/users/06d2f860bd3c4f5b955ff1671f7ce517/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:09.990484 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 799/1605] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:09.997747 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939071b-f79e-4359-baf8-e88bd59ea6c7 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:10.005895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952121a-7dbb-4720-9df9-9f5f0718f184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=231688be9b6547999252977eaa6b475d, user_id=06d2f860bd3c4f5b955ff1671f7ce517, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:10.009823 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952121a-7dbb-4720-9df9-9f5f0718f184 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:10.014939 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939071b-f79e-4359-baf8-e88bd59ea6c7 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:10.021412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ca6f9-25b9-4e07-a0d9-c0767c1bfd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:10.022117 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ca6f9-25b9-4e07-a0d9-c0767c1bfd46 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:10.027653 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ca6f9-25b9-4e07-a0d9-c0767c1bfd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:10.027653 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ca6f9-25b9-4e07-a0d9-c0767c1bfd46 admin admin] PATH_INFO: `/v3/projects/77a4dfe1b3f04f02a5186b36e8fff072/users/e8a7ebc8c8f64fe897a8dbedcc803eee/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:10.039051 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ca6f9-25b9-4e07-a0d9-c0767c1bfd46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a4dfe1b3f04f02a5186b36e8fff072, user_id=e8a7ebc8c8f64fe897a8dbedcc803eee, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:10.041817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ca6f9-25b9-4e07-a0d9-c0767c1bfd46 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:10.081773 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 807/1606] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:09 2022] PUT /identity/v3/projects/231688be9b6547999252977eaa6b475d/users/06d2f860bd3c4f5b955ff1671f7ce517/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:10.084605 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952121a-7dbb-4720-9df9-9f5f0718f184 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:10.148408 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 800/1607] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:09 2022] PUT /identity/v3/projects/77a4dfe1b3f04f02a5186b36e8fff072/users/e8a7ebc8c8f64fe897a8dbedcc803eee/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:10.152076 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91179d-b2c2-4abd-8d8e-109bf4b8e11a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:10.152076 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91179d-b2c2-4abd-8d8e-109bf4b8e11a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:10.152076 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91179d-b2c2-4abd-8d8e-109bf4b8e11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:10.152771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952121a-7dbb-4720-9df9-9f5f0718f184 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:10.182891 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7f91179d-b2c2-4abd-8d8e-109bf4b8e11a None None] MFA Rules not processed for user `622aaaa19ad74935bda142780d375f61`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:10.184528 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7f91179d-b2c2-4abd-8d8e-109bf4b8e11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:10.218624 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b283a81-9be4-42b1-9f51-20ac33220634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:10.219574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b283a81-9be4-42b1-9f51-20ac33220634 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:10.219574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b283a81-9be4-42b1-9f51-20ac33220634 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:10.219872 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b283a81-9be4-42b1-9f51-20ac33220634 admin admin] PATH_INFO: `/v3/projects/1c262efba5e044cf85196910ffc94a3b/users/f5800e502fcd4262bcd5ec1b9b2c83cc/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:10.237235 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b283a81-9be4-42b1-9f51-20ac33220634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c262efba5e044cf85196910ffc94a3b, user_id=f5800e502fcd4262bcd5ec1b9b2c83cc, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:10.240035 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b283a81-9be4-42b1-9f51-20ac33220634 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:10.264235 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 801/1608] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:10.267985 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91179d-b2c2-4abd-8d8e-109bf4b8e11a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:10.277926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91179d-b2c2-4abd-8d8e-109bf4b8e11a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:10.283124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc49c1-97a0-4dbb-91fb-69cf8557d535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:10.283722 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc49c1-97a0-4dbb-91fb-69cf8557d535 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:10.284001 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc49c1-97a0-4dbb-91fb-69cf8557d535 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:10.284273 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc49c1-97a0-4dbb-91fb-69cf8557d535 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:10.284957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc49c1-97a0-4dbb-91fb-69cf8557d535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:10.286969 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc49c1-97a0-4dbb-91fb-69cf8557d535 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:10.313957 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:10.319931 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 808/1609] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:10 2022] PUT /identity/v3/projects/1c262efba5e044cf85196910ffc94a3b/users/f5800e502fcd4262bcd5ec1b9b2c83cc/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:10.323065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b283a81-9be4-42b1-9f51-20ac33220634 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:10.323065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7b283a81-9be4-42b1-9f51-20ac33220634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:10.379934 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b283a81-9be4-42b1-9f51-20ac33220634 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:10.383841 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbceb0-d0d3-48e3-b805-2563107f2b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:10.391350 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbceb0-d0d3-48e3-b805-2563107f2b3a service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:10.391350 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbceb0-d0d3-48e3-b805-2563107f2b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:10.391350 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbceb0-d0d3-48e3-b805-2563107f2b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:10.425020 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 802/1610] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:10 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:10.426209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc49c1-97a0-4dbb-91fb-69cf8557d535 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:10.451131 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbceb0-d0d3-48e3-b805-2563107f2b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:10.453148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbceb0-d0d3-48e3-b805-2563107f2b3a service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:10.462878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 809/1611] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:10.464142 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a3481-fd3a-4194-9332-9540d2d3bbd5 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:10.464447 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a3481-fd3a-4194-9332-9540d2d3bbd5 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:10.464732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a3481-fd3a-4194-9332-9540d2d3bbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:10.484440 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-8f6a3481-fd3a-4194-9332-9540d2d3bbd5 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:10.485305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc49c1-97a0-4dbb-91fb-69cf8557d535 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:10.485667 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-8f6a3481-fd3a-4194-9332-9540d2d3bbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:10.489743 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec56310-2709-48c1-aa1d-011ac177d95f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:10.490360 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec56310-2709-48c1-aa1d-011ac177d95f service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:10.491043 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec56310-2709-48c1-aa1d-011ac177d95f service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:10.491043 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec56310-2709-48c1-aa1d-011ac177d95f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:10.521925 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:10.550951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 810/1612] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:10.552206 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13d065-8a83-4d08-a3ea-0d2661e6fe4b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:10.552523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13d065-8a83-4d08-a3ea-0d2661e6fe4b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:10.552800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13d065-8a83-4d08-a3ea-0d2661e6fe4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:10.558075 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec56310-2709-48c1-aa1d-011ac177d95f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:10.559551 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec56310-2709-48c1-aa1d-011ac177d95f service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:10.570533 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 803/1613] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:10.573347 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec56310-2709-48c1-aa1d-011ac177d95f service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:10.573523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-0a13d065-8a83-4d08-a3ea-0d2661e6fe4b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:10.574575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0a13d065-8a83-4d08-a3ea-0d2661e6fe4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:10.583279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 811/1614] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:10.584848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec56310-2709-48c1-aa1d-011ac177d95f service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:10.585730 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda1995-b231-4212-a220-bc92684a84c8 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:10.586009 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda1995-b231-4212-a220-bc92684a84c8 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:10.586325 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda1995-b231-4212-a220-bc92684a84c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:10.589947 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630da4e-86f4-478a-9919-3736e0be01f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:10.590817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630da4e-86f4-478a-9919-3736e0be01f4 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:10.591192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630da4e-86f4-478a-9919-3736e0be01f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:10.591496 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630da4e-86f4-478a-9919-3736e0be01f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:10.592244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630da4e-86f4-478a-9919-3736e0be01f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:10.595378 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630da4e-86f4-478a-9919-3736e0be01f4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:10.618089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-cdda1995-b231-4212-a220-bc92684a84c8 None None] MFA Rules not processed for user `f5800e502fcd4262bcd5ec1b9b2c83cc`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:10.620392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-cdda1995-b231-4212-a220-bc92684a84c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:10.653611 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:10.701716 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 804/1615] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:10 2022] POST /identity/v3/projects => generated 393 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:10.701716 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630da4e-86f4-478a-9919-3736e0be01f4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:10.718870 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 812/1616] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:10.725851 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda1995-b231-4212-a220-bc92684a84c8 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:10.735620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda1995-b231-4212-a220-bc92684a84c8 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:10.801818 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851f9df-bf81-48de-a9ea-97d138cc5c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:10.802494 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851f9df-bf81-48de-a9ea-97d138cc5c35 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:10.802829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851f9df-bf81-48de-a9ea-97d138cc5c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:10.803068 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851f9df-bf81-48de-a9ea-97d138cc5c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:10.803184 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630da4e-86f4-478a-9919-3736e0be01f4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:10.811909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bff50-9461-493d-b0b2-63e284735f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:10.812816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bff50-9461-493d-b0b2-63e284735f6c admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:10.813136 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bff50-9461-493d-b0b2-63e284735f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:10.813410 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bff50-9461-493d-b0b2-63e284735f6c admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:10.814232 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bff50-9461-493d-b0b2-63e284735f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:10.814848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851f9df-bf81-48de-a9ea-97d138cc5c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:10.816484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851f9df-bf81-48de-a9ea-97d138cc5c35 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:10.823380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bff50-9461-493d-b0b2-63e284735f6c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:10.836786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 813/1617] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:10.838081 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851f9df-bf81-48de-a9ea-97d138cc5c35 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:10.852969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851f9df-bf81-48de-a9ea-97d138cc5c35 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:10.854541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f1bdb-9d56-4bd4-b88a-c91488690f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:10.855156 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f1bdb-9d56-4bd4-b88a-c91488690f14 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:10.855437 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f1bdb-9d56-4bd4-b88a-c91488690f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:10.855711 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f1bdb-9d56-4bd4-b88a-c91488690f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:10.865042 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f1bdb-9d56-4bd4-b88a-c91488690f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:10.866504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f1bdb-9d56-4bd4-b88a-c91488690f14 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:10.877075 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 814/1618] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:10.878442 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef2f01-ed89-44a2-81c2-dedcb4e58422 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:10.881653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef2f01-ed89-44a2-81c2-dedcb4e58422 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:10.881653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef2f01-ed89-44a2-81c2-dedcb4e58422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:10.917021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 805/1619] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:10 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:10.917021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bff50-9461-493d-b0b2-63e284735f6c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:10.917216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-c7ef2f01-ed89-44a2-81c2-dedcb4e58422 None None] MFA Rules not processed for user `d3b0816fdfc14eecab07a55a035064a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:10.917216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c7ef2f01-ed89-44a2-81c2-dedcb4e58422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:10.927365 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bff50-9461-493d-b0b2-63e284735f6c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:10.934002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090bbf2-2486-47b3-9619-b490d994be9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:10.934903 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090bbf2-2486-47b3-9619-b490d994be9d admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:10.935278 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090bbf2-2486-47b3-9619-b490d994be9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:10.935582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090bbf2-2486-47b3-9619-b490d994be9d admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:10.936888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090bbf2-2486-47b3-9619-b490d994be9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:10.939023 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090bbf2-2486-47b3-9619-b490d994be9d admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:10.994822 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 815/1620] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:10 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:10.995994 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef2f01-ed89-44a2-81c2-dedcb4e58422 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:11.008863 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef2f01-ed89-44a2-81c2-dedcb4e58422 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:11.015336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a7958-427f-4517-ad73-d8f1f3ddb9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:11.016066 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a7958-427f-4517-ad73-d8f1f3ddb9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:11.016688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a7958-427f-4517-ad73-d8f1f3ddb9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:11.016688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a7958-427f-4517-ad73-d8f1f3ddb9f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:11.017453 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a7958-427f-4517-ad73-d8f1f3ddb9f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:11.019627 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a7958-427f-4517-ad73-d8f1f3ddb9f7 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:11.077575 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 806/1621] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:10 2022] POST /identity/v3/users => generated 303 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:11.078706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090bbf2-2486-47b3-9619-b490d994be9d admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:11.094590 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090bbf2-2486-47b3-9619-b490d994be9d admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:11.099981 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1284039-3107-4487-8ed4-8a02527425d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:11.100625 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1284039-3107-4487-8ed4-8a02527425d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:11.100901 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1284039-3107-4487-8ed4-8a02527425d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:11.101172 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1284039-3107-4487-8ed4-8a02527425d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:11.102475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1284039-3107-4487-8ed4-8a02527425d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:11.104096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1284039-3107-4487-8ed4-8a02527425d4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:11.117828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 807/1622] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:11.117828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1284039-3107-4487-8ed4-8a02527425d4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:11.135024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1284039-3107-4487-8ed4-8a02527425d4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:11.141767 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0996d68-1895-4ac1-a0f2-af0f4371b58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:11.143536 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0996d68-1895-4ac1-a0f2-af0f4371b58c admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:11.143842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0996d68-1895-4ac1-a0f2-af0f4371b58c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:11.144261 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0996d68-1895-4ac1-a0f2-af0f4371b58c admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:11.145051 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0996d68-1895-4ac1-a0f2-af0f4371b58c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:11.147354 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0996d68-1895-4ac1-a0f2-af0f4371b58c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:11.150829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 816/1623] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:10 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:11.156792 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a7958-427f-4517-ad73-d8f1f3ddb9f7 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:11.187466 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:11.217736 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a7958-427f-4517-ad73-d8f1f3ddb9f7 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:11.222663 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4980c-d41e-4791-b67d-c7c70ee56df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:11.223279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4980c-d41e-4791-b67d-c7c70ee56df3 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:11.223589 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4980c-d41e-4791-b67d-c7c70ee56df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:11.223862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4980c-d41e-4791-b67d-c7c70ee56df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:11.224533 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4980c-d41e-4791-b67d-c7c70ee56df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:11.226238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4980c-d41e-4791-b67d-c7c70ee56df3 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:11.236768 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 817/1624] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:11.237547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4980c-d41e-4791-b67d-c7c70ee56df3 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:11.254239 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4980c-d41e-4791-b67d-c7c70ee56df3 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:11.259190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88c54a-6793-4899-906f-403a95e1c471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:11.259986 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88c54a-6793-4899-906f-403a95e1c471 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:11.260267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88c54a-6793-4899-906f-403a95e1c471 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:11.260754 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88c54a-6793-4899-906f-403a95e1c471 admin admin] PATH_INFO: `/v3/projects/8d804df902bd467aabaeea09a7366c04/users/e55a2978dc39441f9eb6043b30959449/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:11.275669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 808/1625] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:11 2022] POST /identity/v3/projects => generated 405 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:11.279693 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0996d68-1895-4ac1-a0f2-af0f4371b58c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:11.291680 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88c54a-6793-4899-906f-403a95e1c471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d804df902bd467aabaeea09a7366c04, user_id=e55a2978dc39441f9eb6043b30959449, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:11.296282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88c54a-6793-4899-906f-403a95e1c471 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:11.330712 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:11.356571 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0996d68-1895-4ac1-a0f2-af0f4371b58c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:11.362222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890c95d-1001-46d7-8d49-6dabcafb4cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:11.363162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890c95d-1001-46d7-8d49-6dabcafb4cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:11.363512 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890c95d-1001-46d7-8d49-6dabcafb4cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:11.365105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890c95d-1001-46d7-8d49-6dabcafb4cd6 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:11.365105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890c95d-1001-46d7-8d49-6dabcafb4cd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:11.367411 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890c95d-1001-46d7-8d49-6dabcafb4cd6 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:11.420468 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 818/1626] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:11 2022] PUT /identity/v3/projects/8d804df902bd467aabaeea09a7366c04/users/e55a2978dc39441f9eb6043b30959449/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:11.421957 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88c54a-6793-4899-906f-403a95e1c471 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:11.504649 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 809/1627] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:11 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:11.505765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890c95d-1001-46d7-8d49-6dabcafb4cd6 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:11.513213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88c54a-6793-4899-906f-403a95e1c471 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:11.517810 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890c95d-1001-46d7-8d49-6dabcafb4cd6 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:11.518385 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f448a60-3c5b-419f-bd70-e5b1dd10fb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:11.519129 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f448a60-3c5b-419f-bd70-e5b1dd10fb7a admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:11.519481 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f448a60-3c5b-419f-bd70-e5b1dd10fb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:11.519853 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f448a60-3c5b-419f-bd70-e5b1dd10fb7a admin admin] PATH_INFO: `/v3/projects/e26992d8853f48b58beaafc72b2ccc80/users/068e3bc3e44f4129bb03a20e4d06ea9f/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:11.525393 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a5102-14c7-455b-9dd6-f452470a5709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:11.526107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a5102-14c7-455b-9dd6-f452470a5709 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:11.526456 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a5102-14c7-455b-9dd6-f452470a5709 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:11.526936 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a5102-14c7-455b-9dd6-f452470a5709 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:11.527637 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a5102-14c7-455b-9dd6-f452470a5709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:11.531130 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a5102-14c7-455b-9dd6-f452470a5709 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:11.538927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f448a60-3c5b-419f-bd70-e5b1dd10fb7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26992d8853f48b58beaafc72b2ccc80, user_id=068e3bc3e44f4129bb03a20e4d06ea9f, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:11.542937 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f448a60-3c5b-419f-bd70-e5b1dd10fb7a admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:11.618763 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 819/1628] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:11 2022] PUT /identity/v3/projects/e26992d8853f48b58beaafc72b2ccc80/users/068e3bc3e44f4129bb03a20e4d06ea9f/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:11.625037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 810/1629] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:11 2022] POST /identity/v3/users => generated 309 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:11.625037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a5102-14c7-455b-9dd6-f452470a5709 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:11.625474 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f448a60-3c5b-419f-bd70-e5b1dd10fb7a admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:11.631948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a5102-14c7-455b-9dd6-f452470a5709 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:11.701652 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f448a60-3c5b-419f-bd70-e5b1dd10fb7a admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:11.705294 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1e4aa-c9a2-4f47-ae96-438dc4993a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:11.706114 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1e4aa-c9a2-4f47-ae96-438dc4993a90 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:11.706759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1e4aa-c9a2-4f47-ae96-438dc4993a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:11.707190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1e4aa-c9a2-4f47-ae96-438dc4993a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:11.708814 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1e4aa-c9a2-4f47-ae96-438dc4993a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:11.711437 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1e4aa-c9a2-4f47-ae96-438dc4993a90 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:11.711687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b7fcc-3c84-450d-88d3-f2b3f619a9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:11.712960 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b7fcc-3c84-450d-88d3-f2b3f619a9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:11.712960 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b7fcc-3c84-450d-88d3-f2b3f619a9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:11.712960 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b7fcc-3c84-450d-88d3-f2b3f619a9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:11.713572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b7fcc-3c84-450d-88d3-f2b3f619a9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:11.715851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b7fcc-3c84-450d-88d3-f2b3f619a9f0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:11.725604 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 820/1630] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:11.727001 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1e4aa-c9a2-4f47-ae96-438dc4993a90 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:11.734477 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 811/1631] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:11.736014 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b7fcc-3c84-450d-88d3-f2b3f619a9f0 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:11.739429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1e4aa-c9a2-4f47-ae96-438dc4993a90 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:11.745747 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe22164-0b59-4301-b9b9-ad346a99dbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:11.746262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe22164-0b59-4301-b9b9-ad346a99dbfd admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:11.746540 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe22164-0b59-4301-b9b9-ad346a99dbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:11.746814 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe22164-0b59-4301-b9b9-ad346a99dbfd admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:11.747649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe22164-0b59-4301-b9b9-ad346a99dbfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:11.748700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b7fcc-3c84-450d-88d3-f2b3f619a9f0 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:11.750341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe22164-0b59-4301-b9b9-ad346a99dbfd admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:11.758560 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87644712-dbee-4ea4-b39c-f38ba34d327e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:11.759477 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644712-dbee-4ea4-b39c-f38ba34d327e admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:11.760345 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644712-dbee-4ea4-b39c-f38ba34d327e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:11.762234 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644712-dbee-4ea4-b39c-f38ba34d327e admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:11.762234 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87644712-dbee-4ea4-b39c-f38ba34d327e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:11.763928 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87644712-dbee-4ea4-b39c-f38ba34d327e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:11.766566 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 821/1632] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:11.767764 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe22164-0b59-4301-b9b9-ad346a99dbfd admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:11.786187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 812/1633] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:11.786187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87644712-dbee-4ea4-b39c-f38ba34d327e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:11.791405 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe22164-0b59-4301-b9b9-ad346a99dbfd admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:11.792220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81536ec8-8e30-4faf-bc74-ca55051293be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:11.793194 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81536ec8-8e30-4faf-bc74-ca55051293be admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:11.793331 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81536ec8-8e30-4faf-bc74-ca55051293be admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:11.793527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81536ec8-8e30-4faf-bc74-ca55051293be admin admin] PATH_INFO: `/v3/projects/8d804df902bd467aabaeea09a7366c04/users/e55a2978dc39441f9eb6043b30959449/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:11.795499 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81536ec8-8e30-4faf-bc74-ca55051293be admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d804df902bd467aabaeea09a7366c04, user_id=e55a2978dc39441f9eb6043b30959449, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:11.799154 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87644712-dbee-4ea4-b39c-f38ba34d327e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:11.800532 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81536ec8-8e30-4faf-bc74-ca55051293be admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:11.804867 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:11.805253 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dbc888-8ad5-4c89-adfc-772333801760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:11.806437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbc888-8ad5-4c89-adfc-772333801760 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:11.806738 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbc888-8ad5-4c89-adfc-772333801760 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:11.807082 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbc888-8ad5-4c89-adfc-772333801760 admin admin] PATH_INFO: `/v3/projects/ae062e33fe194e6bb25b76f9f753b0d1/users/f5b8265730d94089a4199e052c3edf42/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:11.828324 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 822/1634] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:11 2022] PUT /identity/v3/projects/8d804df902bd467aabaeea09a7366c04/users/e55a2978dc39441f9eb6043b30959449/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:11.828324 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81536ec8-8e30-4faf-bc74-ca55051293be admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:11.838265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dbc888-8ad5-4c89-adfc-772333801760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae062e33fe194e6bb25b76f9f753b0d1, user_id=f5b8265730d94089a4199e052c3edf42, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:11.842172 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dbc888-8ad5-4c89-adfc-772333801760 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:11.890859 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81536ec8-8e30-4faf-bc74-ca55051293be admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:11.895867 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cdd66-c2c8-4df7-8daa-bf388ad3482d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:11.896659 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cdd66-c2c8-4df7-8daa-bf388ad3482d admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:11.896947 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cdd66-c2c8-4df7-8daa-bf388ad3482d admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:11.897229 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cdd66-c2c8-4df7-8daa-bf388ad3482d admin admin] PATH_INFO: `/v3/projects/e26992d8853f48b58beaafc72b2ccc80/users/068e3bc3e44f4129bb03a20e4d06ea9f/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:11.899438 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cdd66-c2c8-4df7-8daa-bf388ad3482d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26992d8853f48b58beaafc72b2ccc80, user_id=068e3bc3e44f4129bb03a20e4d06ea9f, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:11.902181 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cdd66-c2c8-4df7-8daa-bf388ad3482d admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:11.924943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 823/1635] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:11 2022] PUT /identity/v3/projects/e26992d8853f48b58beaafc72b2ccc80/users/068e3bc3e44f4129bb03a20e4d06ea9f/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:11.924943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cdd66-c2c8-4df7-8daa-bf388ad3482d admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:11.946810 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 813/1636] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:11 2022] PUT /identity/v3/projects/ae062e33fe194e6bb25b76f9f753b0d1/users/f5b8265730d94089a4199e052c3edf42/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:11.950523 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95924a-0dd9-4244-bed5-f24482aec947 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:11.951074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95924a-0dd9-4244-bed5-f24482aec947 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:11.953987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95924a-0dd9-4244-bed5-f24482aec947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:11.998146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-5e95924a-0dd9-4244-bed5-f24482aec947 None None] MFA Rules not processed for user `e55a2978dc39441f9eb6043b30959449`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:12.000331 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5e95924a-0dd9-4244-bed5-f24482aec947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:12.083102 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cdd66-c2c8-4df7-8daa-bf388ad3482d admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:12.112495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:12.124471 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 814/1637] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:12.125923 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b069287-dd43-4b45-a142-eb040352d931 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:12.126310 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b069287-dd43-4b45-a142-eb040352d931 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:12.126687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b069287-dd43-4b45-a142-eb040352d931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:12.167124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3b069287-dd43-4b45-a142-eb040352d931 None None] MFA Rules not processed for user `068e3bc3e44f4129bb03a20e4d06ea9f`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:12.168793 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3b069287-dd43-4b45-a142-eb040352d931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:12.187682 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa82597-b819-4345-849e-b4dd1beaaedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:12.188376 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa82597-b819-4345-849e-b4dd1beaaedc admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:12.188693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa82597-b819-4345-849e-b4dd1beaaedc admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:12.188971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa82597-b819-4345-849e-b4dd1beaaedc admin admin] PATH_INFO: `/v3/projects/60dded07fcfd44e395623ffbb1674a59/users/036de4efcbc143e0bba0bfaa3baea964/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:12.208297 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa82597-b819-4345-849e-b4dd1beaaedc admin admin] RBAC: Authorizing `identity:create_grant(project_id=60dded07fcfd44e395623ffbb1674a59, user_id=036de4efcbc143e0bba0bfaa3baea964, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:12.212962 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa82597-b819-4345-849e-b4dd1beaaedc admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:12.282446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 815/1638] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:12 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:12.284120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b069287-dd43-4b45-a142-eb040352d931 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:12.299990 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 824/1639] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:11 2022] PUT /identity/v3/projects/60dded07fcfd44e395623ffbb1674a59/users/036de4efcbc143e0bba0bfaa3baea964/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:12.300976 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa82597-b819-4345-849e-b4dd1beaaedc admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:12.317875 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b069287-dd43-4b45-a142-eb040352d931 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:12.396863 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa82597-b819-4345-849e-b4dd1beaaedc admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:12.400443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad02c07-d94d-47a6-b3b6-8a27d02df086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:12.401062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad02c07-d94d-47a6-b3b6-8a27d02df086 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:12.401477 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad02c07-d94d-47a6-b3b6-8a27d02df086 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:12.401764 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad02c07-d94d-47a6-b3b6-8a27d02df086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:12.402823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8396db-cd0d-435e-8a2f-3dcba37976c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:12.403446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8396db-cd0d-435e-8a2f-3dcba37976c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:12.403730 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8396db-cd0d-435e-8a2f-3dcba37976c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:12.404006 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8396db-cd0d-435e-8a2f-3dcba37976c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:12.404693 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8396db-cd0d-435e-8a2f-3dcba37976c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:12.406533 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8396db-cd0d-435e-8a2f-3dcba37976c3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:12.421584 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 816/1640] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:12.421584 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8396db-cd0d-435e-8a2f-3dcba37976c3 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:12.432333 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8396db-cd0d-435e-8a2f-3dcba37976c3 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:12.436957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03bdc4-c1f4-4a8d-8820-13e7dd074cdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:12.437738 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03bdc4-c1f4-4a8d-8820-13e7dd074cdd service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:12.438081 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03bdc4-c1f4-4a8d-8820-13e7dd074cdd service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:12.438450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03bdc4-c1f4-4a8d-8820-13e7dd074cdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:12.466697 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad02c07-d94d-47a6-b3b6-8a27d02df086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:12.468122 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad02c07-d94d-47a6-b3b6-8a27d02df086 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:12.477963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 825/1641] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:12.478765 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad02c07-d94d-47a6-b3b6-8a27d02df086 service cinder] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:12.488989 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad02c07-d94d-47a6-b3b6-8a27d02df086 service cinder] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:12.493621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698e491-c00c-4dd7-86ea-073466a611cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:12.494811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698e491-c00c-4dd7-86ea-073466a611cb admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:12.494811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698e491-c00c-4dd7-86ea-073466a611cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:12.494811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698e491-c00c-4dd7-86ea-073466a611cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:12.495396 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698e491-c00c-4dd7-86ea-073466a611cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:12.497020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698e491-c00c-4dd7-86ea-073466a611cb admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:12.507422 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03bdc4-c1f4-4a8d-8820-13e7dd074cdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:12.509014 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03bdc4-c1f4-4a8d-8820-13e7dd074cdd service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:12.512619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 826/1642] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:12.513591 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698e491-c00c-4dd7-86ea-073466a611cb admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:12.522977 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 817/1643] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:12 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:12.524405 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698e491-c00c-4dd7-86ea-073466a611cb admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:12.537105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03bdc4-c1f4-4a8d-8820-13e7dd074cdd service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:12.537558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25fcdd-e0ca-439e-b2bb-086b5d149570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:12.537558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25fcdd-e0ca-439e-b2bb-086b5d149570 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:12.537558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25fcdd-e0ca-439e-b2bb-086b5d149570 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:12.537558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25fcdd-e0ca-439e-b2bb-086b5d149570 admin admin] PATH_INFO: `/v3/projects/ae062e33fe194e6bb25b76f9f753b0d1/users/f5b8265730d94089a4199e052c3edf42/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:12.537887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25fcdd-e0ca-439e-b2bb-086b5d149570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae062e33fe194e6bb25b76f9f753b0d1, user_id=f5b8265730d94089a4199e052c3edf42, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:12.537887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25fcdd-e0ca-439e-b2bb-086b5d149570 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:12.538513 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03bdc4-c1f4-4a8d-8820-13e7dd074cdd service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:12.543239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b2f2e-58f6-4639-8b30-a9fa6da68e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:12.543903 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2f2e-58f6-4639-8b30-a9fa6da68e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:12.544186 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2f2e-58f6-4639-8b30-a9fa6da68e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:12.544498 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2f2e-58f6-4639-8b30-a9fa6da68e45 admin admin] PATH_INFO: `/v3/projects/60dded07fcfd44e395623ffbb1674a59/users/036de4efcbc143e0bba0bfaa3baea964/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:12.546799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b2f2e-58f6-4639-8b30-a9fa6da68e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60dded07fcfd44e395623ffbb1674a59, user_id=036de4efcbc143e0bba0bfaa3baea964, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:12.549866 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b2f2e-58f6-4639-8b30-a9fa6da68e45 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:12.877717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 827/1644] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:12 2022] PUT /identity/v3/projects/ae062e33fe194e6bb25b76f9f753b0d1/users/f5b8265730d94089a4199e052c3edf42/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:12.877717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:12.877717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796a1a9-1aba-42d4-879f-8d606d758b93 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:12.877717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796a1a9-1aba-42d4-879f-8d606d758b93 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:12.877717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796a1a9-1aba-42d4-879f-8d606d758b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:12.881043 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 818/1645] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:12 2022] PUT /identity/v3/projects/60dded07fcfd44e395623ffbb1674a59/users/036de4efcbc143e0bba0bfaa3baea964/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:12.881668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-d796a1a9-1aba-42d4-879f-8d606d758b93 None None] MFA Rules not processed for user `f5b8265730d94089a4199e052c3edf42`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:12.881668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d796a1a9-1aba-42d4-879f-8d606d758b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:12.882246 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b2f2e-58f6-4639-8b30-a9fa6da68e45 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:12.882823 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 828/1646] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:57:12.883662 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b2f2e-58f6-4639-8b30-a9fa6da68e45 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:12.883662 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e1a91-9118-418f-945e-411424a9f631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:12.883662 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e1a91-9118-418f-945e-411424a9f631 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:12.883662 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e1a91-9118-418f-945e-411424a9f631 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:12.884199 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e1a91-9118-418f-945e-411424a9f631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:12.884199 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e1a91-9118-418f-945e-411424a9f631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:12.884199 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e1a91-9118-418f-945e-411424a9f631 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:12.884199 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 819/1647] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:57:12.927402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796a1a9-1aba-42d4-879f-8d606d758b93 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:12.942608 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796a1a9-1aba-42d4-879f-8d606d758b93 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:12.951094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e94e4b-4e90-4997-82c9-f2bb6d75feb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:12.952859 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e94e4b-4e90-4997-82c9-f2bb6d75feb3 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:12.958556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e94e4b-4e90-4997-82c9-f2bb6d75feb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:12.958556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e94e4b-4e90-4997-82c9-f2bb6d75feb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:12.965887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e94e4b-4e90-4997-82c9-f2bb6d75feb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:12.968235 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e94e4b-4e90-4997-82c9-f2bb6d75feb3 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:12.994861 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 829/1648] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:13.044288 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:13.402803 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e1a91-9118-418f-945e-411424a9f631 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:13.422848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e1a91-9118-418f-945e-411424a9f631 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:13.427237 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63269803-bb99-49f8-95cf-b3184a024ffe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:13.427879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63269803-bb99-49f8-95cf-b3184a024ffe service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:13.428202 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63269803-bb99-49f8-95cf-b3184a024ffe service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:13.428540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63269803-bb99-49f8-95cf-b3184a024ffe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:13.513691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63269803-bb99-49f8-95cf-b3184a024ffe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:13.515331 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63269803-bb99-49f8-95cf-b3184a024ffe service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:13.525784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 820/1649] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:57:15.021378 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9b0a1-d51a-42aa-915e-f2964abf33aa None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:15.022026 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9b0a1-d51a-42aa-915e-f2964abf33aa None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:15.022026 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9b0a1-d51a-42aa-915e-f2964abf33aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:15.052760 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-d5e9b0a1-d51a-42aa-915e-f2964abf33aa None None] MFA Rules not processed for user `036de4efcbc143e0bba0bfaa3baea964`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:15.054042 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d5e9b0a1-d51a-42aa-915e-f2964abf33aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:15.059906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:15.135207 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63269803-bb99-49f8-95cf-b3184a024ffe service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:15.146567 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 830/1650] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:15 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:15.211406 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:15.225995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63269803-bb99-49f8-95cf-b3184a024ffe service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:15.232295 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e67f23-7eb6-4288-a843-e0ac6268dab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:15.235038 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e67f23-7eb6-4288-a843-e0ac6268dab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:15.235038 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e67f23-7eb6-4288-a843-e0ac6268dab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:15.235247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e67f23-7eb6-4288-a843-e0ac6268dab8 admin admin] PATH_INFO: `/v3/users/ad52861013c14098826162b8ea3740d4` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:15.236445 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e67f23-7eb6-4288-a843-e0ac6268dab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad52861013c14098826162b8ea3740d4)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:15.237574 dv-cinder-852208-20-smb devstack@keystone.service[88077]: WARNING py.warnings [None req-f5e67f23-7eb6-4288-a843-e0ac6268dab8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 22:57:15.237574 dv-cinder-852208-20-smb devstack@keystone.service[88077]: warnings.warn(msg) Sep 06 22:57:15.237574 dv-cinder-852208-20-smb devstack@keystone.service[88077]: Sep 06 22:57:15.239018 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e67f23-7eb6-4288-a843-e0ac6268dab8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:15.526092 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f5e67f23-7eb6-4288-a843-e0ac6268dab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad52861013c14098826162b8ea3740d4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:15.627473 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f5e67f23-7eb6-4288-a843-e0ac6268dab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad52861013c14098826162b8ea3740d4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:15.628259 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f5e67f23-7eb6-4288-a843-e0ac6268dab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad52861013c14098826162b8ea3740d4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:15.629124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f5e67f23-7eb6-4288-a843-e0ac6268dab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad52861013c14098826162b8ea3740d4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:15.652964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f5e67f23-7eb6-4288-a843-e0ac6268dab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad52861013c14098826162b8ea3740d4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:15.729714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 821/1651] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:57:15 2022] DELETE /identity/v3/users/ad52861013c14098826162b8ea3740d4 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:15.734524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d06fa1-3c23-4736-9148-8208d0e28d4f None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:15.734950 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d06fa1-3c23-4736-9148-8208d0e28d4f None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:15.735842 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d06fa1-3c23-4736-9148-8208d0e28d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:15.787589 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-a3d06fa1-3c23-4736-9148-8208d0e28d4f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:15.798337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-a3d06fa1-3c23-4736-9148-8208d0e28d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:15.943588 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 831/1652] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:15.961851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e67f23-7eb6-4288-a843-e0ac6268dab8 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:15.963761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f5e67f23-7eb6-4288-a843-e0ac6268dab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:16.087421 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e67f23-7eb6-4288-a843-e0ac6268dab8 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:16.092373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92739c-61a1-46de-8121-b2ec3a036752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:16.093155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92739c-61a1-46de-8121-b2ec3a036752 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:16.094703 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92739c-61a1-46de-8121-b2ec3a036752 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:16.095407 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92739c-61a1-46de-8121-b2ec3a036752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:16.119460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92739c-61a1-46de-8121-b2ec3a036752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:16.121281 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92739c-61a1-46de-8121-b2ec3a036752 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:16.141977 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 822/1653] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:18.171132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dca08a-73ae-47df-b057-121dc03d8025 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:18.171648 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dca08a-73ae-47df-b057-121dc03d8025 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:18.171648 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dca08a-73ae-47df-b057-121dc03d8025 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:18.173383 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 832/1654] 10.222.0.30 () {54 vars in 921 bytes} [Tue Sep 6 22:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:57:18.264602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650eddf4-2c0c-475c-b533-cfa4ad1d51db None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:18.265134 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650eddf4-2c0c-475c-b533-cfa4ad1d51db None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:18.265324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650eddf4-2c0c-475c-b533-cfa4ad1d51db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:18.340758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-650eddf4-2c0c-475c-b533-cfa4ad1d51db None None] MFA Rules not processed for user `4f6bd5bbbf65461990c9bb2747dbe5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:18.343809 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-650eddf4-2c0c-475c-b533-cfa4ad1d51db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:18.537312 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 823/1655] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Sep 6 22:57:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:18.687889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dca08a-73ae-47df-b057-121dc03d8025 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:18.690753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-63dca08a-73ae-47df-b057-121dc03d8025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:18.728287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dca08a-73ae-47df-b057-121dc03d8025 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:18.775239 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fa1a7-a8b3-4b54-8195-cbc22a2b105e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bd5bbbf65461990c9bb2747dbe5e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:18.776052 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fa1a7-a8b3-4b54-8195-cbc22a2b105e service placement] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:18.776751 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fa1a7-a8b3-4b54-8195-cbc22a2b105e service placement] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:18.777191 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fa1a7-a8b3-4b54-8195-cbc22a2b105e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:18.805678 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565fa1a7-a8b3-4b54-8195-cbc22a2b105e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:18.807298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565fa1a7-a8b3-4b54-8195-cbc22a2b105e service placement] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:18.838572 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 833/1656] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:20.222641 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650eddf4-2c0c-475c-b533-cfa4ad1d51db None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:20.224134 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-650eddf4-2c0c-475c-b533-cfa4ad1d51db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:20.258204 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650eddf4-2c0c-475c-b533-cfa4ad1d51db None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:20.268744 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc5d9a-ea36-48f7-8cd3-c6950be0dae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:20.270073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc5d9a-ea36-48f7-8cd3-c6950be0dae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:20.270526 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc5d9a-ea36-48f7-8cd3-c6950be0dae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:20.270945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc5d9a-ea36-48f7-8cd3-c6950be0dae3 admin admin] PATH_INFO: `/v3/projects/791a282713c44cb0b39f5d0c81fa3fc9` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:20.273692 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc5d9a-ea36-48f7-8cd3-c6950be0dae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=791a282713c44cb0b39f5d0c81fa3fc9)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:20.275902 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc5d9a-ea36-48f7-8cd3-c6950be0dae3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:20.292224 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:20.500376 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3bcc5d9a-ea36-48f7-8cd3-c6950be0dae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '791a282713c44cb0b39f5d0c81fa3fc9', 'request_id': 'req-3bcc5d9a-ea36-48f7-8cd3-c6950be0dae3'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:20.513130 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3bcc5d9a-ea36-48f7-8cd3-c6950be0dae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '791a282713c44cb0b39f5d0c81fa3fc9', 'request_id': 'req-3bcc5d9a-ea36-48f7-8cd3-c6950be0dae3'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:20.582981 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3bcc5d9a-ea36-48f7-8cd3-c6950be0dae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '791a282713c44cb0b39f5d0c81fa3fc9', 'request_id': 'req-3bcc5d9a-ea36-48f7-8cd3-c6950be0dae3'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:20.599467 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3bcc5d9a-ea36-48f7-8cd3-c6950be0dae3 admin admin] The token cache is being invalidate because project 791a282713c44cb0b39f5d0c81fa3fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:57:20.599927 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3bcc5d9a-ea36-48f7-8cd3-c6950be0dae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:20.600818 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3bcc5d9a-ea36-48f7-8cd3-c6950be0dae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:20.605524 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 824/1657] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:57:20 2022] DELETE /identity/v3/projects/791a282713c44cb0b39f5d0c81fa3fc9 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:20.609684 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fa1a7-a8b3-4b54-8195-cbc22a2b105e service placement] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:20.630078 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fa1a7-a8b3-4b54-8195-cbc22a2b105e service placement] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:20.776637 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5bf34-58b7-4b82-a4f3-6ac33a33a008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:20.786598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5bf34-58b7-4b82-a4f3-6ac33a33a008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:20.786598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5bf34-58b7-4b82-a4f3-6ac33a33a008 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:20.786598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5bf34-58b7-4b82-a4f3-6ac33a33a008 admin admin] PATH_INFO: `/v3/users/e55a2978dc39441f9eb6043b30959449` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:20.786598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5bf34-58b7-4b82-a4f3-6ac33a33a008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e55a2978dc39441f9eb6043b30959449)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:20.786598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5bf34-58b7-4b82-a4f3-6ac33a33a008 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:21.064056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:21.094749 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-35a5bf34-58b7-4b82-a4f3-6ac33a33a008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e55a2978dc39441f9eb6043b30959449'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:21.160288 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc5d9a-ea36-48f7-8cd3-c6950be0dae3 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:21.161977 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3bcc5d9a-ea36-48f7-8cd3-c6950be0dae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:21.191269 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc5d9a-ea36-48f7-8cd3-c6950be0dae3 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:21.192779 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-35a5bf34-58b7-4b82-a4f3-6ac33a33a008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e55a2978dc39441f9eb6043b30959449'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:21.193526 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-35a5bf34-58b7-4b82-a4f3-6ac33a33a008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e55a2978dc39441f9eb6043b30959449'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:21.209973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eee89b-dd1b-4b5a-933b-aeea2f2557d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:21.211215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eee89b-dd1b-4b5a-933b-aeea2f2557d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:21.211742 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eee89b-dd1b-4b5a-933b-aeea2f2557d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:21.212028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eee89b-dd1b-4b5a-933b-aeea2f2557d0 admin admin] PATH_INFO: `/v3/users/622aaaa19ad74935bda142780d375f61` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:21.216186 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eee89b-dd1b-4b5a-933b-aeea2f2557d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=622aaaa19ad74935bda142780d375f61)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:21.223079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eee89b-dd1b-4b5a-933b-aeea2f2557d0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:21.223733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-35a5bf34-58b7-4b82-a4f3-6ac33a33a008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e55a2978dc39441f9eb6043b30959449'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:21.226032 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-35a5bf34-58b7-4b82-a4f3-6ac33a33a008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e55a2978dc39441f9eb6043b30959449'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:21.272363 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 834/1658] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:57:20 2022] DELETE /identity/v3/users/e55a2978dc39441f9eb6043b30959449 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:21.323129 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f696ccc-2ea9-4787-be13-a7d88e7f6c0a None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:21.323761 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f696ccc-2ea9-4787-be13-a7d88e7f6c0a None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:21.323761 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f696ccc-2ea9-4787-be13-a7d88e7f6c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:21.389318 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-1f696ccc-2ea9-4787-be13-a7d88e7f6c0a None None] MFA Rules not processed for user `e8a7ebc8c8f64fe897a8dbedcc803eee`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:21.390730 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1f696ccc-2ea9-4787-be13-a7d88e7f6c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:21.511392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c4eee89b-dd1b-4b5a-933b-aeea2f2557d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '622aaaa19ad74935bda142780d375f61'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:21.523688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 835/1659] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:21.523688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13453e8b-6d0a-411d-99b4-c5498f4ca305 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:21.523688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13453e8b-6d0a-411d-99b4-c5498f4ca305 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:21.523688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13453e8b-6d0a-411d-99b4-c5498f4ca305 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:21.523688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 836/1660] 10.222.0.30 () {54 vars in 921 bytes} [Tue Sep 6 22:57:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:57:21.532011 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb6194-4096-4b4c-832f-ed99afabe0b1 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:21.532704 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb6194-4096-4b4c-832f-ed99afabe0b1 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:21.533250 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb6194-4096-4b4c-832f-ed99afabe0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:21.576580 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-82fb6194-4096-4b4c-832f-ed99afabe0b1 None None] MFA Rules not processed for user `e8a7ebc8c8f64fe897a8dbedcc803eee`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:21.577944 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-82fb6194-4096-4b4c-832f-ed99afabe0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:21.591535 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 837/1661] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:21.591535 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915e345-7766-40f0-ba1e-e36bcd2bb019 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:21.591535 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915e345-7766-40f0-ba1e-e36bcd2bb019 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:21.591535 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915e345-7766-40f0-ba1e-e36bcd2bb019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:21.626470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-d915e345-7766-40f0-ba1e-e36bcd2bb019 None None] MFA Rules not processed for user `4f6bd5bbbf65461990c9bb2747dbe5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:21.630390 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d915e345-7766-40f0-ba1e-e36bcd2bb019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:21.645948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c4eee89b-dd1b-4b5a-933b-aeea2f2557d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '622aaaa19ad74935bda142780d375f61'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:21.648577 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c4eee89b-dd1b-4b5a-933b-aeea2f2557d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '622aaaa19ad74935bda142780d375f61'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:21.650332 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c4eee89b-dd1b-4b5a-933b-aeea2f2557d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '622aaaa19ad74935bda142780d375f61'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:21.661156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c4eee89b-dd1b-4b5a-933b-aeea2f2557d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '622aaaa19ad74935bda142780d375f61'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:21.685089 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 825/1662] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:57:21 2022] DELETE /identity/v3/users/622aaaa19ad74935bda142780d375f61 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:21.692001 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eee89b-dd1b-4b5a-933b-aeea2f2557d0 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:21.705060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c4eee89b-dd1b-4b5a-933b-aeea2f2557d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:21.788751 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 838/1663] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Sep 6 22:57:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:21.790440 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fcdcb-6b9f-4adc-b4a5-1a0d0f5c54b0 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:21.791073 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fcdcb-6b9f-4adc-b4a5-1a0d0f5c54b0 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:21.791752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fcdcb-6b9f-4adc-b4a5-1a0d0f5c54b0 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:21.793761 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 839/1664] 10.222.0.30 () {54 vars in 962 bytes} [Tue Sep 6 22:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:57:21.796783 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5a68e-6935-4fb1-980c-d55344b11aaa None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:21.799338 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5a68e-6935-4fb1-980c-d55344b11aaa None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:21.799338 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5a68e-6935-4fb1-980c-d55344b11aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:21.832732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eee89b-dd1b-4b5a-933b-aeea2f2557d0 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:21.835478 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-59d5a68e-6935-4fb1-980c-d55344b11aaa None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:21.837008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-59d5a68e-6935-4fb1-980c-d55344b11aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:21.845038 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fbd29-90c8-4afe-b139-f5dec32ba3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:21.845700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fbd29-90c8-4afe-b139-f5dec32ba3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:21.845981 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fbd29-90c8-4afe-b139-f5dec32ba3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:21.846256 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fbd29-90c8-4afe-b139-f5dec32ba3ee admin admin] PATH_INFO: `/v3/users/d3b0816fdfc14eecab07a55a035064a0` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:21.847016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 840/1665] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:21.848498 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66237f0e-979f-4555-8bcf-c3fee7a5ee1e None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:21.848983 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66237f0e-979f-4555-8bcf-c3fee7a5ee1e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:21.849462 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66237f0e-979f-4555-8bcf-c3fee7a5ee1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:21.853731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fbd29-90c8-4afe-b139-f5dec32ba3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b0816fdfc14eecab07a55a035064a0)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:21.856862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fbd29-90c8-4afe-b139-f5dec32ba3ee admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:21.896856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-66237f0e-979f-4555-8bcf-c3fee7a5ee1e None None] MFA Rules not processed for user `b18fd296138349408613004929144e70`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:21.899315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-66237f0e-979f-4555-8bcf-c3fee7a5ee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:22.029293 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 841/1666] 10.222.0.30 () {58 vars in 1059 bytes} [Tue Sep 6 22:57:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:22.042274 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66237f0e-979f-4555-8bcf-c3fee7a5ee1e None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:22.044996 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-66237f0e-979f-4555-8bcf-c3fee7a5ee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:22.091409 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-eb6fbd29-90c8-4afe-b139-f5dec32ba3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b0816fdfc14eecab07a55a035064a0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:22.164204 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-eb6fbd29-90c8-4afe-b139-f5dec32ba3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b0816fdfc14eecab07a55a035064a0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:22.165087 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-eb6fbd29-90c8-4afe-b139-f5dec32ba3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b0816fdfc14eecab07a55a035064a0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:22.165903 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-eb6fbd29-90c8-4afe-b139-f5dec32ba3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b0816fdfc14eecab07a55a035064a0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:22.179834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-eb6fbd29-90c8-4afe-b139-f5dec32ba3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b0816fdfc14eecab07a55a035064a0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:22.216719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66237f0e-979f-4555-8bcf-c3fee7a5ee1e None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:22.217645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 826/1667] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:57:21 2022] DELETE /identity/v3/users/d3b0816fdfc14eecab07a55a035064a0 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:22.218673 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fbd29-90c8-4afe-b139-f5dec32ba3ee admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:22.224067 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-eb6fbd29-90c8-4afe-b139-f5dec32ba3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:22.364010 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fbd29-90c8-4afe-b139-f5dec32ba3ee admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:22.378933 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765d7a2-c0b6-4a8c-9228-8ac11774a949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:22.379761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765d7a2-c0b6-4a8c-9228-8ac11774a949 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:22.380213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765d7a2-c0b6-4a8c-9228-8ac11774a949 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:22.380672 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765d7a2-c0b6-4a8c-9228-8ac11774a949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:22.388108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7765d7a2-c0b6-4a8c-9228-8ac11774a949 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:22.443681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3708bf-d09c-43b2-b9ef-22bfa8fe7cd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bd5bbbf65461990c9bb2747dbe5e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:22.446241 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3708bf-d09c-43b2-b9ef-22bfa8fe7cd0 service placement] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:22.448143 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3708bf-d09c-43b2-b9ef-22bfa8fe7cd0 service placement] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:22.448363 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3708bf-d09c-43b2-b9ef-22bfa8fe7cd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:22.453990 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9f3708bf-d09c-43b2-b9ef-22bfa8fe7cd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:22.481734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3708bf-d09c-43b2-b9ef-22bfa8fe7cd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:22.486093 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3708bf-d09c-43b2-b9ef-22bfa8fe7cd0 service placement] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:22.524712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 842/1668] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:22.525717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3708bf-d09c-43b2-b9ef-22bfa8fe7cd0 service placement] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:22.529810 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9f3708bf-d09c-43b2-b9ef-22bfa8fe7cd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:22.541273 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765d7a2-c0b6-4a8c-9228-8ac11774a949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:22.543024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765d7a2-c0b6-4a8c-9228-8ac11774a949 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:22.585201 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 827/1669] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:22.586318 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765d7a2-c0b6-4a8c-9228-8ac11774a949 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:22.594913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7765d7a2-c0b6-4a8c-9228-8ac11774a949 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:22.617981 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765d7a2-c0b6-4a8c-9228-8ac11774a949 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:22.645541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db50ad-0b8c-436c-9af1-8fc102d15ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:22.646208 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db50ad-0b8c-436c-9af1-8fc102d15ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:22.646482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db50ad-0b8c-436c-9af1-8fc102d15ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:22.646817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db50ad-0b8c-436c-9af1-8fc102d15ff5 admin admin] PATH_INFO: `/v3/projects/8d804df902bd467aabaeea09a7366c04` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:22.649152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db50ad-0b8c-436c-9af1-8fc102d15ff5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d804df902bd467aabaeea09a7366c04)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:22.651339 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db50ad-0b8c-436c-9af1-8fc102d15ff5 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:22.720408 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3708bf-d09c-43b2-b9ef-22bfa8fe7cd0 service placement] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:22.730010 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:22.732861 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b18ea2-659e-434e-bdab-4495df850a74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:22.733910 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b18ea2-659e-434e-bdab-4495df850a74 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:22.733910 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b18ea2-659e-434e-bdab-4495df850a74 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:22.734143 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b18ea2-659e-434e-bdab-4495df850a74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:22.738159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d8b18ea2-659e-434e-bdab-4495df850a74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:22.850305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:22.882360 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-15db50ad-0b8c-436c-9af1-8fc102d15ff5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d804df902bd467aabaeea09a7366c04', 'request_id': 'req-15db50ad-0b8c-436c-9af1-8fc102d15ff5'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:22.894484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b18ea2-659e-434e-bdab-4495df850a74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:22.895023 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-15db50ad-0b8c-436c-9af1-8fc102d15ff5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d804df902bd467aabaeea09a7366c04', 'request_id': 'req-15db50ad-0b8c-436c-9af1-8fc102d15ff5'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:22.896140 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b18ea2-659e-434e-bdab-4495df850a74 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:22.923039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 843/1670] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:22.943977 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b18ea2-659e-434e-bdab-4495df850a74 service nova] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:22.948206 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d8b18ea2-659e-434e-bdab-4495df850a74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:22.967719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b18ea2-659e-434e-bdab-4495df850a74 service nova] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:22.986285 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-15db50ad-0b8c-436c-9af1-8fc102d15ff5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d804df902bd467aabaeea09a7366c04', 'request_id': 'req-15db50ad-0b8c-436c-9af1-8fc102d15ff5'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:23.002425 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-15db50ad-0b8c-436c-9af1-8fc102d15ff5 admin admin] The token cache is being invalidate because project 8d804df902bd467aabaeea09a7366c04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:57:23.002878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-15db50ad-0b8c-436c-9af1-8fc102d15ff5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:23.004330 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-15db50ad-0b8c-436c-9af1-8fc102d15ff5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:23.011105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 828/1671] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:57:22 2022] DELETE /identity/v3/projects/8d804df902bd467aabaeea09a7366c04 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:23.012698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd8dd1-b680-4965-a8e3-eb60faef2e6a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:23.014347 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd8dd1-b680-4965-a8e3-eb60faef2e6a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:23.015064 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd8dd1-b680-4965-a8e3-eb60faef2e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:23.061050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f4cd8dd1-b680-4965-a8e3-eb60faef2e6a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:23.063516 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f4cd8dd1-b680-4965-a8e3-eb60faef2e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:23.106303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5463a-8730-4d67-9353-01d26ac83db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:23.107224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5463a-8730-4d67-9353-01d26ac83db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:23.107683 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5463a-8730-4d67-9353-01d26ac83db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:23.108555 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5463a-8730-4d67-9353-01d26ac83db7 admin admin] PATH_INFO: `/v3/projects/c6913a91c8e54107a52714d21e8b99cd` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:23.111055 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5463a-8730-4d67-9353-01d26ac83db7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6913a91c8e54107a52714d21e8b99cd)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:23.116790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: WARNING py.warnings [None req-59c5463a-8730-4d67-9353-01d26ac83db7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 22:57:23.116790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: warnings.warn(msg) Sep 06 22:57:23.116790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: Sep 06 22:57:23.118573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5463a-8730-4d67-9353-01d26ac83db7 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:23.217310 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 829/1672] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:23.219462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b03be1-5efe-4b7f-88c4-7cb7da5219f9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:23.219758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b03be1-5efe-4b7f-88c4-7cb7da5219f9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:23.220039 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b03be1-5efe-4b7f-88c4-7cb7da5219f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:23.286001 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-27b03be1-5efe-4b7f-88c4-7cb7da5219f9 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:23.288370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-27b03be1-5efe-4b7f-88c4-7cb7da5219f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:23.331495 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-59c5463a-8730-4d67-9353-01d26ac83db7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6913a91c8e54107a52714d21e8b99cd', 'request_id': 'req-59c5463a-8730-4d67-9353-01d26ac83db7'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:23.358611 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-59c5463a-8730-4d67-9353-01d26ac83db7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6913a91c8e54107a52714d21e8b99cd', 'request_id': 'req-59c5463a-8730-4d67-9353-01d26ac83db7'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:23.421026 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-59c5463a-8730-4d67-9353-01d26ac83db7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6913a91c8e54107a52714d21e8b99cd', 'request_id': 'req-59c5463a-8730-4d67-9353-01d26ac83db7'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:23.441148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-59c5463a-8730-4d67-9353-01d26ac83db7 admin admin] The token cache is being invalidate because project c6913a91c8e54107a52714d21e8b99cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:57:23.441455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-59c5463a-8730-4d67-9353-01d26ac83db7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:23.442911 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-59c5463a-8730-4d67-9353-01d26ac83db7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:23.445494 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 844/1673] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:57:22 2022] DELETE /identity/v3/projects/c6913a91c8e54107a52714d21e8b99cd => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:23.450384 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5463a-8730-4d67-9353-01d26ac83db7 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:23.455335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-59c5463a-8730-4d67-9353-01d26ac83db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:23.462533 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 830/1674] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:23.464492 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b03be1-5efe-4b7f-88c4-7cb7da5219f9 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:23.480704 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5463a-8730-4d67-9353-01d26ac83db7 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:23.493175 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705dc15-bc84-4356-b7fb-90a73485b270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:23.494143 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705dc15-bc84-4356-b7fb-90a73485b270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:23.494603 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705dc15-bc84-4356-b7fb-90a73485b270 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:23.495018 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705dc15-bc84-4356-b7fb-90a73485b270 admin admin] PATH_INFO: `/v3/users/036de4efcbc143e0bba0bfaa3baea964` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:23.498914 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705dc15-bc84-4356-b7fb-90a73485b270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=036de4efcbc143e0bba0bfaa3baea964)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:23.504509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705dc15-bc84-4356-b7fb-90a73485b270 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:23.504753 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b03be1-5efe-4b7f-88c4-7cb7da5219f9 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:23.527203 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544af83-c093-4254-b16a-ac219bb77096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:23.527203 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544af83-c093-4254-b16a-ac219bb77096 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:23.527203 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544af83-c093-4254-b16a-ac219bb77096 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:23.527203 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544af83-c093-4254-b16a-ac219bb77096 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:23.535972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544af83-c093-4254-b16a-ac219bb77096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:57:23.536788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544af83-c093-4254-b16a-ac219bb77096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:23.541370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544af83-c093-4254-b16a-ac219bb77096 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:23.605478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 831/1675] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:57:23.606684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544af83-c093-4254-b16a-ac219bb77096 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:23.612051 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3544af83-c093-4254-b16a-ac219bb77096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:23.667203 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544af83-c093-4254-b16a-ac219bb77096 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:23.687708 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87bcb4f-4e44-45ac-8e2c-5696d2e7dd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:23.688616 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bcb4f-4e44-45ac-8e2c-5696d2e7dd42 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:23.690421 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bcb4f-4e44-45ac-8e2c-5696d2e7dd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:23.690864 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bcb4f-4e44-45ac-8e2c-5696d2e7dd42 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:23.691670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87bcb4f-4e44-45ac-8e2c-5696d2e7dd42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:23.704315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87bcb4f-4e44-45ac-8e2c-5696d2e7dd42 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:23.756472 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-e705dc15-bc84-4356-b7fb-90a73485b270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036de4efcbc143e0bba0bfaa3baea964'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:23.838370 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-e705dc15-bc84-4356-b7fb-90a73485b270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036de4efcbc143e0bba0bfaa3baea964'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:23.839256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-e705dc15-bc84-4356-b7fb-90a73485b270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036de4efcbc143e0bba0bfaa3baea964'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:23.852695 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 832/1676] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:23 2022] POST /identity/v3/projects => generated 367 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:23.857877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e964-9108-44d9-a143-74b489ac1fae None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:23.858198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e964-9108-44d9-a143-74b489ac1fae None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:23.858481 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e964-9108-44d9-a143-74b489ac1fae None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:23.862140 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 833/1677] 10.222.0.30 () {54 vars in 912 bytes} [Tue Sep 6 22:57:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:57:23.863091 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892e964-9108-44d9-a143-74b489ac1fae None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:23.864566 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-e705dc15-bc84-4356-b7fb-90a73485b270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036de4efcbc143e0bba0bfaa3baea964'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:23.866042 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-e705dc15-bc84-4356-b7fb-90a73485b270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036de4efcbc143e0bba0bfaa3baea964'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:23.866718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6892e964-9108-44d9-a143-74b489ac1fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:23.901372 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 845/1678] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:57:23 2022] DELETE /identity/v3/users/036de4efcbc143e0bba0bfaa3baea964 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:57:23.903298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c596ab-1e08-4bcb-8bbb-70fbf43b1e1d None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:23.904400 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c596ab-1e08-4bcb-8bbb-70fbf43b1e1d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:23.905052 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c596ab-1e08-4bcb-8bbb-70fbf43b1e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:23.960630 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-e8c596ab-1e08-4bcb-8bbb-70fbf43b1e1d None None] MFA Rules not processed for user `b18fd296138349408613004929144e70`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:23.962229 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e8c596ab-1e08-4bcb-8bbb-70fbf43b1e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:23.977926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892e964-9108-44d9-a143-74b489ac1fae None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:24.131462 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 846/1679] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Sep 6 22:57:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:24.139045 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36157d41-3ed3-4201-8dd6-2dabd9ee4baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:24.140561 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36157d41-3ed3-4201-8dd6-2dabd9ee4baf admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:24.142786 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36157d41-3ed3-4201-8dd6-2dabd9ee4baf admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:24.143305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36157d41-3ed3-4201-8dd6-2dabd9ee4baf admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:24.144737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36157d41-3ed3-4201-8dd6-2dabd9ee4baf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:24.146998 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c596ab-1e08-4bcb-8bbb-70fbf43b1e1d None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:24.147512 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e8c596ab-1e08-4bcb-8bbb-70fbf43b1e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:24.149245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36157d41-3ed3-4201-8dd6-2dabd9ee4baf admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:24.247891 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:24.289839 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 834/1680] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:23 2022] POST /identity/v3/users => generated 284 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:24.293318 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36157d41-3ed3-4201-8dd6-2dabd9ee4baf admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:24.315274 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c596ab-1e08-4bcb-8bbb-70fbf43b1e1d None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:24.327972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36157d41-3ed3-4201-8dd6-2dabd9ee4baf admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:24.329695 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6e497-9428-4de6-9ca9-28451b22c2c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a2c1f1668814a5e9e654c6308fa0628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:24.330336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6e497-9428-4de6-9ca9-28451b22c2c0 service glance] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:24.331888 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6e497-9428-4de6-9ca9-28451b22c2c0 service glance] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:24.331888 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6e497-9428-4de6-9ca9-28451b22c2c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:24.343898 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fceda5-9e13-4f31-877f-7496fcb7d535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:24.345468 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fceda5-9e13-4f31-877f-7496fcb7d535 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:24.348622 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fceda5-9e13-4f31-877f-7496fcb7d535 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:24.348838 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6e497-9428-4de6-9ca9-28451b22c2c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:24.350291 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6e497-9428-4de6-9ca9-28451b22c2c0 service glance] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:24.353465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fceda5-9e13-4f31-877f-7496fcb7d535 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:24.355893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fceda5-9e13-4f31-877f-7496fcb7d535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:24.365712 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fceda5-9e13-4f31-877f-7496fcb7d535 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:24.375723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 847/1681] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:57:24.397170 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6e497-9428-4de6-9ca9-28451b22c2c0 service glance] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:24.414180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 835/1682] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:24.415467 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:24.419488 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6e497-9428-4de6-9ca9-28451b22c2c0 service glance] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:24.431101 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fceda5-9e13-4f31-877f-7496fcb7d535 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:24.435340 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-37fceda5-9e13-4f31-877f-7496fcb7d535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:24.461850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ab83d-44f4-4828-a8c1-6dbb8cde7e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:24.476617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ab83d-44f4-4828-a8c1-6dbb8cde7e10 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:24.478570 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ab83d-44f4-4828-a8c1-6dbb8cde7e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:24.481278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ab83d-44f4-4828-a8c1-6dbb8cde7e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:24.482729 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ab83d-44f4-4828-a8c1-6dbb8cde7e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:24.490921 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ab83d-44f4-4828-a8c1-6dbb8cde7e10 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:24.502594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fceda5-9e13-4f31-877f-7496fcb7d535 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:24.516317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 848/1683] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:57:24.519421 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28b9f5-5a8f-4ebf-8030-f2abd88b8b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:24.519800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ab83d-44f4-4828-a8c1-6dbb8cde7e10 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:24.519889 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28b9f5-5a8f-4ebf-8030-f2abd88b8b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:24.519889 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28b9f5-5a8f-4ebf-8030-f2abd88b8b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:24.519889 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28b9f5-5a8f-4ebf-8030-f2abd88b8b88 admin admin] PATH_INFO: `/v3/projects/47f34c30b518437aa90e551119913061` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:24.523070 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28b9f5-5a8f-4ebf-8030-f2abd88b8b88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f34c30b518437aa90e551119913061)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:24.527854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28b9f5-5a8f-4ebf-8030-f2abd88b8b88 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:24.548796 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ab83d-44f4-4828-a8c1-6dbb8cde7e10 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:24.553488 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6470b-96da-4a83-bf77-5411e1acffec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:24.554464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6470b-96da-4a83-bf77-5411e1acffec admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:24.554911 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6470b-96da-4a83-bf77-5411e1acffec admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:24.555378 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6470b-96da-4a83-bf77-5411e1acffec admin admin] PATH_INFO: `/v3/projects/848d8cbfbecc45bc8d5f3304d1d8745e/users/374a55993be849209bee3030e0953c16/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:24.589121 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6470b-96da-4a83-bf77-5411e1acffec admin admin] RBAC: Authorizing `identity:create_grant(project_id=848d8cbfbecc45bc8d5f3304d1d8745e, user_id=374a55993be849209bee3030e0953c16, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:24.593354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6470b-96da-4a83-bf77-5411e1acffec admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:24.688339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 849/1684] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:24 2022] PUT /identity/v3/projects/848d8cbfbecc45bc8d5f3304d1d8745e/users/374a55993be849209bee3030e0953c16/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:24.689730 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6470b-96da-4a83-bf77-5411e1acffec admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:24.700092 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-89b6470b-96da-4a83-bf77-5411e1acffec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:24.717777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5b28b9f5-5a8f-4ebf-8030-f2abd88b8b88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f34c30b518437aa90e551119913061', 'request_id': 'req-5b28b9f5-5a8f-4ebf-8030-f2abd88b8b88'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:24.739932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5b28b9f5-5a8f-4ebf-8030-f2abd88b8b88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f34c30b518437aa90e551119913061', 'request_id': 'req-5b28b9f5-5a8f-4ebf-8030-f2abd88b8b88'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:24.762393 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:24.810575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6470b-96da-4a83-bf77-5411e1acffec admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:24.844638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5b28b9f5-5a8f-4ebf-8030-f2abd88b8b88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f34c30b518437aa90e551119913061', 'request_id': 'req-5b28b9f5-5a8f-4ebf-8030-f2abd88b8b88'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:24.860143 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5b28b9f5-5a8f-4ebf-8030-f2abd88b8b88 admin admin] The token cache is being invalidate because project 47f34c30b518437aa90e551119913061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:57:24.860450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5b28b9f5-5a8f-4ebf-8030-f2abd88b8b88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:24.861850 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5b28b9f5-5a8f-4ebf-8030-f2abd88b8b88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:24.870550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 836/1685] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:57:24 2022] DELETE /identity/v3/projects/47f34c30b518437aa90e551119913061 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:24.870550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa5b19-1f43-49c3-9929-cc0b0ee2bcea None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:24.870550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa5b19-1f43-49c3-9929-cc0b0ee2bcea None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:24.870550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa5b19-1f43-49c3-9929-cc0b0ee2bcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:24.921060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822aeee-3fb3-4cbc-8f5e-2e5cd1469429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:24.921778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822aeee-3fb3-4cbc-8f5e-2e5cd1469429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:24.930998 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822aeee-3fb3-4cbc-8f5e-2e5cd1469429 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:24.930998 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822aeee-3fb3-4cbc-8f5e-2e5cd1469429 admin admin] PATH_INFO: `/v3/projects/60dded07fcfd44e395623ffbb1674a59` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:24.930998 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822aeee-3fb3-4cbc-8f5e-2e5cd1469429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60dded07fcfd44e395623ffbb1674a59)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:24.930998 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822aeee-3fb3-4cbc-8f5e-2e5cd1469429 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:24.931537 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-93fa5b19-1f43-49c3-9929-cc0b0ee2bcea None None] MFA Rules not processed for user `374a55993be849209bee3030e0953c16`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:24.931537 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-93fa5b19-1f43-49c3-9929-cc0b0ee2bcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:25.065954 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f822aeee-3fb3-4cbc-8f5e-2e5cd1469429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60dded07fcfd44e395623ffbb1674a59', 'request_id': 'req-f822aeee-3fb3-4cbc-8f5e-2e5cd1469429'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:25.081459 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f822aeee-3fb3-4cbc-8f5e-2e5cd1469429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60dded07fcfd44e395623ffbb1674a59', 'request_id': 'req-f822aeee-3fb3-4cbc-8f5e-2e5cd1469429'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:25.101764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 837/1686] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:25.101764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa5b19-1f43-49c3-9929-cc0b0ee2bcea None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:25.101764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-93fa5b19-1f43-49c3-9929-cc0b0ee2bcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:25.116223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa5b19-1f43-49c3-9929-cc0b0ee2bcea None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:25.146545 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f822aeee-3fb3-4cbc-8f5e-2e5cd1469429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60dded07fcfd44e395623ffbb1674a59', 'request_id': 'req-f822aeee-3fb3-4cbc-8f5e-2e5cd1469429'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:25.166162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f822aeee-3fb3-4cbc-8f5e-2e5cd1469429 admin admin] The token cache is being invalidate because project 60dded07fcfd44e395623ffbb1674a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:57:25.166474 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f822aeee-3fb3-4cbc-8f5e-2e5cd1469429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:25.168458 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f822aeee-3fb3-4cbc-8f5e-2e5cd1469429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:25.170416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 850/1687] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:57:24 2022] DELETE /identity/v3/projects/60dded07fcfd44e395623ffbb1674a59 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:25.176738 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822aeee-3fb3-4cbc-8f5e-2e5cd1469429 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:25.180818 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f822aeee-3fb3-4cbc-8f5e-2e5cd1469429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:25.254559 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3c832-1917-4adc-bd92-175b8f490ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:25.255503 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3c832-1917-4adc-bd92-175b8f490ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:25.256063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3c832-1917-4adc-bd92-175b8f490ede admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:25.256461 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3c832-1917-4adc-bd92-175b8f490ede admin admin] PATH_INFO: `/v3/users/068e3bc3e44f4129bb03a20e4d06ea9f` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:25.259060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3c832-1917-4adc-bd92-175b8f490ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=068e3bc3e44f4129bb03a20e4d06ea9f)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:25.262716 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3c832-1917-4adc-bd92-175b8f490ede admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:25.362707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822aeee-3fb3-4cbc-8f5e-2e5cd1469429 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:25.368785 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de706e3-237a-42e9-8bc9-03209b019510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:25.369779 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de706e3-237a-42e9-8bc9-03209b019510 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:25.370329 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de706e3-237a-42e9-8bc9-03209b019510 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:25.370936 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de706e3-237a-42e9-8bc9-03209b019510 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:25.372040 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de706e3-237a-42e9-8bc9-03209b019510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:25.375333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de706e3-237a-42e9-8bc9-03209b019510 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:25.494296 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 851/1688] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:25 2022] POST /identity/v3/projects => generated 367 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:25.500856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac069c60-ae87-47da-9f53-0e645cb2c0b5 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:25.501145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac069c60-ae87-47da-9f53-0e645cb2c0b5 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:25.501582 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac069c60-ae87-47da-9f53-0e645cb2c0b5 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:25.503385 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 852/1689] 10.222.0.30 () {54 vars in 912 bytes} [Tue Sep 6 22:57:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:57:25.504463 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a59d0-4a24-4f3d-b8a5-05904ee67766 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:25.504781 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a59d0-4a24-4f3d-b8a5-05904ee67766 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:25.506564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a59d0-4a24-4f3d-b8a5-05904ee67766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:25.549116 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c1e3c832-1917-4adc-bd92-175b8f490ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '068e3bc3e44f4129bb03a20e4d06ea9f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:25.551805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-083a59d0-4a24-4f3d-b8a5-05904ee67766 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:25.553063 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-083a59d0-4a24-4f3d-b8a5-05904ee67766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:25.649080 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c1e3c832-1917-4adc-bd92-175b8f490ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '068e3bc3e44f4129bb03a20e4d06ea9f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:25.649701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c1e3c832-1917-4adc-bd92-175b8f490ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '068e3bc3e44f4129bb03a20e4d06ea9f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:25.650314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c1e3c832-1917-4adc-bd92-175b8f490ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '068e3bc3e44f4129bb03a20e4d06ea9f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:25.662487 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c1e3c832-1917-4adc-bd92-175b8f490ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '068e3bc3e44f4129bb03a20e4d06ea9f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:25.696731 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 853/1690] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:25.697616 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a59d0-4a24-4f3d-b8a5-05904ee67766 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:25.703138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-083a59d0-4a24-4f3d-b8a5-05904ee67766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:25.735287 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 838/1691] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:57:25 2022] DELETE /identity/v3/users/068e3bc3e44f4129bb03a20e4d06ea9f => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:25.737082 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb029a13-e900-4f1a-913f-5f2cd714bd2f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:25.740671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb029a13-e900-4f1a-913f-5f2cd714bd2f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:25.741114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb029a13-e900-4f1a-913f-5f2cd714bd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:25.770011 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a59d0-4a24-4f3d-b8a5-05904ee67766 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:25.962686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-cb029a13-e900-4f1a-913f-5f2cd714bd2f None None] MFA Rules not processed for user `314bb14d5fa1414a832efb6d37c0446d`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:25.963945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cb029a13-e900-4f1a-913f-5f2cd714bd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:26.047584 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c23bd-30c5-4763-a397-00eaf60b5d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:26.054762 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c23bd-30c5-4763-a397-00eaf60b5d92 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:26.054762 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c23bd-30c5-4763-a397-00eaf60b5d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:26.056983 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c23bd-30c5-4763-a397-00eaf60b5d92 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:26.058601 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c23bd-30c5-4763-a397-00eaf60b5d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:26.062185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c23bd-30c5-4763-a397-00eaf60b5d92 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:26.082256 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:26.178266 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 854/1692] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:25 2022] POST /identity/v3/users => generated 290 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:26.182622 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d12e0-522c-46b4-bd43-bf986b534db6 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:26.182914 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d12e0-522c-46b4-bd43-bf986b534db6 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:26.183194 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d12e0-522c-46b4-bd43-bf986b534db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:26.215151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 839/1693] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Sep 6 22:57:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:26.216354 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb029a13-e900-4f1a-913f-5f2cd714bd2f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:26.244632 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb029a13-e900-4f1a-913f-5f2cd714bd2f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:26.256952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:26.270238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2289999-ebd8-4d9c-b7fb-f09d153c8993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:26.270809 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2289999-ebd8-4d9c-b7fb-f09d153c8993 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:26.271089 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2289999-ebd8-4d9c-b7fb-f09d153c8993 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:26.271361 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2289999-ebd8-4d9c-b7fb-f09d153c8993 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:26.272732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2289999-ebd8-4d9c-b7fb-f09d153c8993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:26.276076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-ec5d12e0-522c-46b4-bd43-bf986b534db6 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:26.282529 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2289999-ebd8-4d9c-b7fb-f09d153c8993 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:26.290226 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ec5d12e0-522c-46b4-bd43-bf986b534db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:26.316010 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 840/1694] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:26.317210 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2289999-ebd8-4d9c-b7fb-f09d153c8993 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:26.328015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a2289999-ebd8-4d9c-b7fb-f09d153c8993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:26.328357 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 855/1695] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:26.331888 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d12e0-522c-46b4-bd43-bf986b534db6 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:26.363524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d12e0-522c-46b4-bd43-bf986b534db6 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:26.366168 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2289999-ebd8-4d9c-b7fb-f09d153c8993 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:26.379572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8549e2-5006-4f81-8182-57679387a2f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:26.380448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8549e2-5006-4f81-8182-57679387a2f5 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:26.383611 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8549e2-5006-4f81-8182-57679387a2f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:26.383611 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8549e2-5006-4f81-8182-57679387a2f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:26.383998 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c9e6e-3420-41b7-8704-9867c225e091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:26.385264 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c9e6e-3420-41b7-8704-9867c225e091 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:26.385556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c9e6e-3420-41b7-8704-9867c225e091 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:26.387802 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c9e6e-3420-41b7-8704-9867c225e091 admin admin] PATH_INFO: `/v3/projects/8eab87d942c647afb10136ff5bd74861/users/bfa97d7948f943ed806fae4e5fc53745/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:26.400797 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8549e2-5006-4f81-8182-57679387a2f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:26.402768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8549e2-5006-4f81-8182-57679387a2f5 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:26.425700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 841/1696] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:26.430928 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8549e2-5006-4f81-8182-57679387a2f5 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:26.443831 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c9e6e-3420-41b7-8704-9867c225e091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eab87d942c647afb10136ff5bd74861, user_id=bfa97d7948f943ed806fae4e5fc53745, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:26.447197 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c9e6e-3420-41b7-8704-9867c225e091 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:26.464473 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8549e2-5006-4f81-8182-57679387a2f5 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:26.476467 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12f449-779e-4bfa-8a41-b3510c45e92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:26.477170 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12f449-779e-4bfa-8a41-b3510c45e92e admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:26.477451 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12f449-779e-4bfa-8a41-b3510c45e92e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:26.477725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12f449-779e-4bfa-8a41-b3510c45e92e admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:26.478386 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12f449-779e-4bfa-8a41-b3510c45e92e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:57:26.478747 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12f449-779e-4bfa-8a41-b3510c45e92e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:26.480371 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12f449-779e-4bfa-8a41-b3510c45e92e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:26.513842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 842/1697] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:57:26.517832 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12f449-779e-4bfa-8a41-b3510c45e92e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:26.539230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12f449-779e-4bfa-8a41-b3510c45e92e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:26.552903 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131aaa81-c63f-4181-a7ce-57f69a4a9b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:26.555384 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131aaa81-c63f-4181-a7ce-57f69a4a9b15 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:26.558427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131aaa81-c63f-4181-a7ce-57f69a4a9b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:26.558427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131aaa81-c63f-4181-a7ce-57f69a4a9b15 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:26.558898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 856/1698] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:26 2022] PUT /identity/v3/projects/8eab87d942c647afb10136ff5bd74861/users/bfa97d7948f943ed806fae4e5fc53745/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:26.559057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131aaa81-c63f-4181-a7ce-57f69a4a9b15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:26.560926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c9e6e-3420-41b7-8704-9867c225e091 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:26.563771 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131aaa81-c63f-4181-a7ce-57f69a4a9b15 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:26.702399 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 843/1699] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:26 2022] POST /identity/v3/projects => generated 361 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:57:26.707006 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131aaa81-c63f-4181-a7ce-57f69a4a9b15 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:26.732554 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c9e6e-3420-41b7-8704-9867c225e091 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:26.815193 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b151191-1ed3-415d-a86d-e304804dd4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:26.816710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b151191-1ed3-415d-a86d-e304804dd4fe admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:26.819469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b151191-1ed3-415d-a86d-e304804dd4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:26.819469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b151191-1ed3-415d-a86d-e304804dd4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:26.824461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b151191-1ed3-415d-a86d-e304804dd4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:26.827689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b151191-1ed3-415d-a86d-e304804dd4fe admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:26.844803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 857/1700] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:26.846522 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b151191-1ed3-415d-a86d-e304804dd4fe admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:26.858283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b151191-1ed3-415d-a86d-e304804dd4fe admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:26.863578 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe59af2-d448-4dbf-9b80-01c9d7bcbd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:26.864953 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59af2-d448-4dbf-9b80-01c9d7bcbd34 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:26.865468 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59af2-d448-4dbf-9b80-01c9d7bcbd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:26.865948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59af2-d448-4dbf-9b80-01c9d7bcbd34 admin admin] PATH_INFO: `/v3/projects/8eab87d942c647afb10136ff5bd74861/users/bfa97d7948f943ed806fae4e5fc53745/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:26.868486 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe59af2-d448-4dbf-9b80-01c9d7bcbd34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eab87d942c647afb10136ff5bd74861, user_id=bfa97d7948f943ed806fae4e5fc53745, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:26.872144 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe59af2-d448-4dbf-9b80-01c9d7bcbd34 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:26.900909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131aaa81-c63f-4181-a7ce-57f69a4a9b15 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:26.901882 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 858/1701] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:26 2022] PUT /identity/v3/projects/8eab87d942c647afb10136ff5bd74861/users/bfa97d7948f943ed806fae4e5fc53745/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:26.904264 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc2cd7-8a0b-4f72-afe1-5e075fb0cd94 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:26.905345 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc2cd7-8a0b-4f72-afe1-5e075fb0cd94 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:26.905841 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc2cd7-8a0b-4f72-afe1-5e075fb0cd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:26.943571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-e0cc2cd7-8a0b-4f72-afe1-5e075fb0cd94 None None] MFA Rules not processed for user `bfa97d7948f943ed806fae4e5fc53745`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:26.946487 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e0cc2cd7-8a0b-4f72-afe1-5e075fb0cd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:27.040443 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8349c4-69bc-483e-b0c9-57081db9bfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:27.040780 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8349c4-69bc-483e-b0c9-57081db9bfc1 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:27.041514 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8349c4-69bc-483e-b0c9-57081db9bfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:27.041514 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8349c4-69bc-483e-b0c9-57081db9bfc1 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:27.043354 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8349c4-69bc-483e-b0c9-57081db9bfc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:27.046990 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8349c4-69bc-483e-b0c9-57081db9bfc1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:27.056053 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 859/1702] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:27.070637 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc2cd7-8a0b-4f72-afe1-5e075fb0cd94 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:27.072534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e0cc2cd7-8a0b-4f72-afe1-5e075fb0cd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:27.169282 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 844/1703] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:26 2022] POST /identity/v3/users => generated 281 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:27.178250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8349c4-69bc-483e-b0c9-57081db9bfc1 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:27.184288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc2cd7-8a0b-4f72-afe1-5e075fb0cd94 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:27.196542 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26febc-aff3-40f8-890b-38c21e122e20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:27.197655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26febc-aff3-40f8-890b-38c21e122e20 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:27.197949 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26febc-aff3-40f8-890b-38c21e122e20 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:27.198222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26febc-aff3-40f8-890b-38c21e122e20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:27.205698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8349c4-69bc-483e-b0c9-57081db9bfc1 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:27.217491 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d204b-184a-416c-8974-ba993e4585c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:27.218134 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d204b-184a-416c-8974-ba993e4585c5 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:27.218415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d204b-184a-416c-8974-ba993e4585c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:27.218704 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d204b-184a-416c-8974-ba993e4585c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:27.222159 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d204b-184a-416c-8974-ba993e4585c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:27.223940 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26febc-aff3-40f8-890b-38c21e122e20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:27.226194 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26febc-aff3-40f8-890b-38c21e122e20 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:27.226533 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d204b-184a-416c-8974-ba993e4585c5 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:27.255375 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 860/1704] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:57:27.271776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 845/1705] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:27.275115 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26febc-aff3-40f8-890b-38c21e122e20 service cinder] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:27.291430 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26febc-aff3-40f8-890b-38c21e122e20 service cinder] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:27.298374 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4df68-8bd2-4045-a644-6316b1541c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:27.299208 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4df68-8bd2-4045-a644-6316b1541c9e admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:27.299498 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4df68-8bd2-4045-a644-6316b1541c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:27.299780 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4df68-8bd2-4045-a644-6316b1541c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:27.300709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4df68-8bd2-4045-a644-6316b1541c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:27.303004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4df68-8bd2-4045-a644-6316b1541c9e admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:27.326872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d204b-184a-416c-8974-ba993e4585c5 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:27.333934 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 861/1706] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:27.338365 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d204b-184a-416c-8974-ba993e4585c5 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:27.352967 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:27.353888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a0a0e-5da7-46bd-88ca-243bf0ec8351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:27.355150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a0a0e-5da7-46bd-88ca-243bf0ec8351 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:27.355526 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a0a0e-5da7-46bd-88ca-243bf0ec8351 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:27.355714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a0a0e-5da7-46bd-88ca-243bf0ec8351 admin admin] PATH_INFO: `/v3/projects/d735e0a4cb0149828d89062f16079536/users/69fa143281db459ebaab619cc5629ccd/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:27.396702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4df68-8bd2-4045-a644-6316b1541c9e admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:27.401357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a0a0e-5da7-46bd-88ca-243bf0ec8351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d735e0a4cb0149828d89062f16079536, user_id=69fa143281db459ebaab619cc5629ccd, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:27.409573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-81a4df68-8bd2-4045-a644-6316b1541c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:27.413244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a0a0e-5da7-46bd-88ca-243bf0ec8351 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:27.428108 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4df68-8bd2-4045-a644-6316b1541c9e admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:27.438131 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:27.442357 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491f257-b446-4606-b9cc-1444663dff73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:27.446283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491f257-b446-4606-b9cc-1444663dff73 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:27.446627 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491f257-b446-4606-b9cc-1444663dff73 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:27.447054 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491f257-b446-4606-b9cc-1444663dff73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:27.472218 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7491f257-b446-4606-b9cc-1444663dff73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:27.533467 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 846/1707] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:27 2022] PUT /identity/v3/projects/d735e0a4cb0149828d89062f16079536/users/69fa143281db459ebaab619cc5629ccd/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:27.545812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1389a-872b-451d-9857-50ed771aa183 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:27.546100 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1389a-872b-451d-9857-50ed771aa183 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:27.546360 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1389a-872b-451d-9857-50ed771aa183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:27.607940 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491f257-b446-4606-b9cc-1444663dff73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:27.611646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491f257-b446-4606-b9cc-1444663dff73 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:27.631632 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 862/1708] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:27.666023 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-35f1389a-872b-451d-9857-50ed771aa183 None None] MFA Rules not processed for user `69fa143281db459ebaab619cc5629ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:27.673251 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-35f1389a-872b-451d-9857-50ed771aa183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:27.923351 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 847/1709] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:27.927356 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491f257-b446-4606-b9cc-1444663dff73 service cinder] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:27.941480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491f257-b446-4606-b9cc-1444663dff73 service cinder] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:28.105779 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ab3b8-8a72-42c9-bb29-a837c6305863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:28.106414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ab3b8-8a72-42c9-bb29-a837c6305863 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:28.106693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ab3b8-8a72-42c9-bb29-a837c6305863 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:28.107164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ab3b8-8a72-42c9-bb29-a837c6305863 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:28.107853 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ab3b8-8a72-42c9-bb29-a837c6305863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:28.110008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ab3b8-8a72-42c9-bb29-a837c6305863 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:28.295121 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 863/1710] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:27 2022] POST /identity/v3/projects => generated 363 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:28.296886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1389a-872b-451d-9857-50ed771aa183 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:28.317990 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1389a-872b-451d-9857-50ed771aa183 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:28.485919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ab3b8-8a72-42c9-bb29-a837c6305863 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:28.487829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-337ab3b8-8a72-42c9-bb29-a837c6305863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:28.500958 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e655f-b3d9-4c1f-92e0-a07259a19e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:28.503081 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e655f-b3d9-4c1f-92e0-a07259a19e95 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:28.503433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e655f-b3d9-4c1f-92e0-a07259a19e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:28.504271 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e655f-b3d9-4c1f-92e0-a07259a19e95 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:28.513279 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e655f-b3d9-4c1f-92e0-a07259a19e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:28.518841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e655f-b3d9-4c1f-92e0-a07259a19e95 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:28.715876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 848/1711] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:28 2022] POST /identity/v3/users => generated 288 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:28.721427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e655f-b3d9-4c1f-92e0-a07259a19e95 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:28.769238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e655f-b3d9-4c1f-92e0-a07259a19e95 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:28.777685 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ab3b8-8a72-42c9-bb29-a837c6305863 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:28.791518 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146815b-ec70-4a95-8506-ceeff10ed264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:28.792854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146815b-ec70-4a95-8506-ceeff10ed264 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:28.793145 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146815b-ec70-4a95-8506-ceeff10ed264 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:28.793422 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146815b-ec70-4a95-8506-ceeff10ed264 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:28.794153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146815b-ec70-4a95-8506-ceeff10ed264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:28.796339 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146815b-ec70-4a95-8506-ceeff10ed264 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:28.808144 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535aa5c-c009-4220-b4bf-d8744e9ec168 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bd5bbbf65461990c9bb2747dbe5e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:28.812380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535aa5c-c009-4220-b4bf-d8744e9ec168 service placement] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:28.812832 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535aa5c-c009-4220-b4bf-d8744e9ec168 service placement] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:28.813248 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535aa5c-c009-4220-b4bf-d8744e9ec168 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:28.826982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3535aa5c-c009-4220-b4bf-d8744e9ec168 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:28.840686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 849/1712] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:57:28.845746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09bc5c-fca1-49a4-90b8-a85416783fa0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:28.846218 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09bc5c-fca1-49a4-90b8-a85416783fa0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:28.846652 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09bc5c-fca1-49a4-90b8-a85416783fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:28.866272 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535aa5c-c009-4220-b4bf-d8744e9ec168 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:28.866272 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535aa5c-c009-4220-b4bf-d8744e9ec168 service placement] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:28.892111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 864/1713] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:57:28.892985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535aa5c-c009-4220-b4bf-d8744e9ec168 service placement] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:28.914362 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-6f09bc5c-fca1-49a4-90b8-a85416783fa0 None None] MFA Rules not processed for user `5655757c28a446ed8f7468a4146aa09c`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:28.915814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6f09bc5c-fca1-49a4-90b8-a85416783fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:28.942456 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535aa5c-c009-4220-b4bf-d8744e9ec168 service placement] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:28.973115 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e10269-3535-41bb-810a-138e0201d0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:28.973845 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e10269-3535-41bb-810a-138e0201d0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:28.974125 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e10269-3535-41bb-810a-138e0201d0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:28.974441 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e10269-3535-41bb-810a-138e0201d0bd admin admin] PATH_INFO: `/v3/projects/4530498ce7b34ebd8834f5c9932e254d/users/c22e8916521c48d39ca36711b963f1d1/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:28.998729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:29.049322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:29.073818 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e10269-3535-41bb-810a-138e0201d0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4530498ce7b34ebd8834f5c9932e254d, user_id=c22e8916521c48d39ca36711b963f1d1, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:29.078543 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e10269-3535-41bb-810a-138e0201d0bd admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:29.181854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 850/1714] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:29.181854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7727860-adb9-4fb4-8464-8180e2ff05e4 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:29.181854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7727860-adb9-4fb4-8464-8180e2ff05e4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:29.181854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7727860-adb9-4fb4-8464-8180e2ff05e4 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:29.181854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 851/1715] 10.222.0.30 () {54 vars in 962 bytes} [Tue Sep 6 22:57:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:57:29.195593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efaca0-842c-4627-85eb-4a70ce5cedef None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:29.196298 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efaca0-842c-4627-85eb-4a70ce5cedef None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:29.197738 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efaca0-842c-4627-85eb-4a70ce5cedef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:29.207933 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 865/1716] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:28 2022] PUT /identity/v3/projects/4530498ce7b34ebd8834f5c9932e254d/users/c22e8916521c48d39ca36711b963f1d1/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:29.212077 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e10269-3535-41bb-810a-138e0201d0bd admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:29.212077 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c7e10269-3535-41bb-810a-138e0201d0bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:29.240729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e8efaca0-842c-4627-85eb-4a70ce5cedef None None] MFA Rules not processed for user `b18fd296138349408613004929144e70`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:29.251529 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e8efaca0-842c-4627-85eb-4a70ce5cedef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:29.436353 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 852/1717] 10.222.0.30 () {58 vars in 1059 bytes} [Tue Sep 6 22:57:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:29.437949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efaca0-842c-4627-85eb-4a70ce5cedef None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:29.532504 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efaca0-842c-4627-85eb-4a70ce5cedef None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:29.539020 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02a5d9-f8d7-40ff-b93a-1b4f67d24aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:29.540034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02a5d9-f8d7-40ff-b93a-1b4f67d24aea admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:29.540410 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02a5d9-f8d7-40ff-b93a-1b4f67d24aea admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:29.540806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02a5d9-f8d7-40ff-b93a-1b4f67d24aea admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:29.541982 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02a5d9-f8d7-40ff-b93a-1b4f67d24aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:29.543849 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02a5d9-f8d7-40ff-b93a-1b4f67d24aea admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:29.563999 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 853/1718] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:29.565844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aa786-7491-42b5-9574-1aee4102e9bc None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:29.566271 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aa786-7491-42b5-9574-1aee4102e9bc None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:29.568565 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aa786-7491-42b5-9574-1aee4102e9bc None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:29.570765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 854/1719] 10.222.0.30 () {54 vars in 912 bytes} [Tue Sep 6 22:57:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:57:29.571705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2aa786-7491-42b5-9574-1aee4102e9bc None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:29.577656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e10269-3535-41bb-810a-138e0201d0bd admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:29.592082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34c46d-76d8-4a3f-8139-908b31f591cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:29.592758 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34c46d-76d8-4a3f-8139-908b31f591cb service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:29.593045 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34c46d-76d8-4a3f-8139-908b31f591cb service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:29.593329 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34c46d-76d8-4a3f-8139-908b31f591cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:29.600050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2aa786-7491-42b5-9574-1aee4102e9bc None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:29.605753 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7736b-7a18-4a4e-9274-e34c2b3d322b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:29.606431 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7736b-7a18-4a4e-9274-e34c2b3d322b admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:29.606758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7736b-7a18-4a4e-9274-e34c2b3d322b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:29.607041 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7736b-7a18-4a4e-9274-e34c2b3d322b admin admin] PATH_INFO: `/v3/projects/4530498ce7b34ebd8834f5c9932e254d/users/c22e8916521c48d39ca36711b963f1d1/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:29.609104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7736b-7a18-4a4e-9274-e34c2b3d322b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4530498ce7b34ebd8834f5c9932e254d, user_id=c22e8916521c48d39ca36711b963f1d1, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:29.611909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7736b-7a18-4a4e-9274-e34c2b3d322b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:29.634590 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 855/1720] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:29 2022] PUT /identity/v3/projects/4530498ce7b34ebd8834f5c9932e254d/users/c22e8916521c48d39ca36711b963f1d1/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:29.635728 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5485d-38d2-45fc-ace3-432b56e6804e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:29.636014 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5485d-38d2-45fc-ace3-432b56e6804e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:29.636285 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5485d-38d2-45fc-ace3-432b56e6804e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:29.666845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-eac5485d-38d2-45fc-ace3-432b56e6804e None None] MFA Rules not processed for user `b18fd296138349408613004929144e70`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:29.672046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-eac5485d-38d2-45fc-ace3-432b56e6804e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:29.756008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34c46d-76d8-4a3f-8139-908b31f591cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:29.759408 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34c46d-76d8-4a3f-8139-908b31f591cb service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:29.781828 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 866/1721] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:29.783170 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f979c66-b557-4586-b810-9a68e18ba1f0 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:29.783460 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f979c66-b557-4586-b810-9a68e18ba1f0 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:29.783741 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f979c66-b557-4586-b810-9a68e18ba1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:29.822310 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 856/1722] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Sep 6 22:57:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:29.823849 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5485d-38d2-45fc-ace3-432b56e6804e None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:29.826103 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-eac5485d-38d2-45fc-ace3-432b56e6804e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:29.860368 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-0f979c66-b557-4586-b810-9a68e18ba1f0 None None] MFA Rules not processed for user `c22e8916521c48d39ca36711b963f1d1`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:29.861668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0f979c66-b557-4586-b810-9a68e18ba1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:29.972488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5485d-38d2-45fc-ace3-432b56e6804e None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:29.982214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6955ff-7dac-4e5a-a7ae-f166362ed60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:29.983214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6955ff-7dac-4e5a-a7ae-f166362ed60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:29.983725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6955ff-7dac-4e5a-a7ae-f166362ed60f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:29.984299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6955ff-7dac-4e5a-a7ae-f166362ed60f admin admin] PATH_INFO: `/v3/projects/e26992d8853f48b58beaafc72b2ccc80` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:29.986786 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6955ff-7dac-4e5a-a7ae-f166362ed60f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26992d8853f48b58beaafc72b2ccc80)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:29.990475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6955ff-7dac-4e5a-a7ae-f166362ed60f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:30.010791 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 867/1723] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:30.016553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f979c66-b557-4586-b810-9a68e18ba1f0 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:30.176698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6a6955ff-7dac-4e5a-a7ae-f166362ed60f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26992d8853f48b58beaafc72b2ccc80', 'request_id': 'req-6a6955ff-7dac-4e5a-a7ae-f166362ed60f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:30.185752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f979c66-b557-4586-b810-9a68e18ba1f0 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:30.192178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6a6955ff-7dac-4e5a-a7ae-f166362ed60f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26992d8853f48b58beaafc72b2ccc80', 'request_id': 'req-6a6955ff-7dac-4e5a-a7ae-f166362ed60f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:30.308388 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0aa2b6-d751-48a6-b93f-02a32875d977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:30.313740 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6a6955ff-7dac-4e5a-a7ae-f166362ed60f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26992d8853f48b58beaafc72b2ccc80', 'request_id': 'req-6a6955ff-7dac-4e5a-a7ae-f166362ed60f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:30.333266 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0aa2b6-d751-48a6-b93f-02a32875d977 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:30.333751 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0aa2b6-d751-48a6-b93f-02a32875d977 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:30.335661 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0aa2b6-d751-48a6-b93f-02a32875d977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:30.345852 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6a6955ff-7dac-4e5a-a7ae-f166362ed60f admin admin] The token cache is being invalidate because project e26992d8853f48b58beaafc72b2ccc80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:57:30.346950 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6a6955ff-7dac-4e5a-a7ae-f166362ed60f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:30.350429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6a6955ff-7dac-4e5a-a7ae-f166362ed60f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:30.353846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 857/1724] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:57:29 2022] DELETE /identity/v3/projects/e26992d8853f48b58beaafc72b2ccc80 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:30.354937 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6955ff-7dac-4e5a-a7ae-f166362ed60f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:30.357451 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6a6955ff-7dac-4e5a-a7ae-f166362ed60f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:30.459943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6955ff-7dac-4e5a-a7ae-f166362ed60f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:30.463964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657581f-bf92-459b-80b5-9ffaac8902ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:30.465132 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657581f-bf92-459b-80b5-9ffaac8902ee service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:30.465590 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657581f-bf92-459b-80b5-9ffaac8902ee service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:30.466144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657581f-bf92-459b-80b5-9ffaac8902ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:30.468866 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4657581f-bf92-459b-80b5-9ffaac8902ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:30.551010 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0aa2b6-d751-48a6-b93f-02a32875d977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:30.556125 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0aa2b6-d751-48a6-b93f-02a32875d977 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:30.590576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 868/1725] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:30.596291 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d80b8-c8d4-495f-bd33-41edb310b5d6 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:30.599702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d80b8-c8d4-495f-bd33-41edb310b5d6 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:30.600210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d80b8-c8d4-495f-bd33-41edb310b5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:30.638534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-ed5d80b8-c8d4-495f-bd33-41edb310b5d6 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:30.640228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657581f-bf92-459b-80b5-9ffaac8902ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:30.640714 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ed5d80b8-c8d4-495f-bd33-41edb310b5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:30.645342 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657581f-bf92-459b-80b5-9ffaac8902ee service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:30.671849 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 858/1726] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:30.769879 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 869/1727] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:30.780367 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f241c59-45ff-412b-bfc2-a29bc46d0c89 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:30.780741 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f241c59-45ff-412b-bfc2-a29bc46d0c89 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:30.781026 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f241c59-45ff-412b-bfc2-a29bc46d0c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:30.812300 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7f241c59-45ff-412b-bfc2-a29bc46d0c89 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:30.813808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7f241c59-45ff-412b-bfc2-a29bc46d0c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:30.865484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d80b8-c8d4-495f-bd33-41edb310b5d6 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:30.883927 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 859/1728] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:30.889927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d80b8-c8d4-495f-bd33-41edb310b5d6 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:30.903321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949e5df-1d23-4c8a-b586-2f9b1f14503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:30.904227 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949e5df-1d23-4c8a-b586-2f9b1f14503a admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:30.905036 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949e5df-1d23-4c8a-b586-2f9b1f14503a admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:30.907243 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949e5df-1d23-4c8a-b586-2f9b1f14503a admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:30.908866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949e5df-1d23-4c8a-b586-2f9b1f14503a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:57:30.909393 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949e5df-1d23-4c8a-b586-2f9b1f14503a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:30.912294 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949e5df-1d23-4c8a-b586-2f9b1f14503a admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:30.985918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 870/1729] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:57:30.990631 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f241c59-45ff-412b-bfc2-a29bc46d0c89 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:31.002078 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f241c59-45ff-412b-bfc2-a29bc46d0c89 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:31.012330 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26db602-fdbe-4491-b14a-96dff6e73932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:31.014421 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26db602-fdbe-4491-b14a-96dff6e73932 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:31.014421 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26db602-fdbe-4491-b14a-96dff6e73932 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:31.014421 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26db602-fdbe-4491-b14a-96dff6e73932 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:31.015662 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26db602-fdbe-4491-b14a-96dff6e73932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:31.017735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26db602-fdbe-4491-b14a-96dff6e73932 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:31.109915 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949e5df-1d23-4c8a-b586-2f9b1f14503a admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:31.115156 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1949e5df-1d23-4c8a-b586-2f9b1f14503a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:31.132332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949e5df-1d23-4c8a-b586-2f9b1f14503a admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:31.143835 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949a875-781d-49b2-98af-328f929e576b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:31.144837 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949a875-781d-49b2-98af-328f929e576b service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:31.145743 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949a875-781d-49b2-98af-328f929e576b service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:31.146222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949a875-781d-49b2-98af-328f929e576b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:31.150018 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4949a875-781d-49b2-98af-328f929e576b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:31.155565 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 860/1730] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:30 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:31.158955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4468ce-acb1-4d9d-acfb-9cdd075a6a0e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:31.159416 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4468ce-acb1-4d9d-acfb-9cdd075a6a0e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:31.159834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4468ce-acb1-4d9d-acfb-9cdd075a6a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:31.228184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949a875-781d-49b2-98af-328f929e576b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:31.230632 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949a875-781d-49b2-98af-328f929e576b service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:31.232867 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-5c4468ce-acb1-4d9d-acfb-9cdd075a6a0e None None] MFA Rules not processed for user `07a7969f07564904bc69fe0d026c6fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:31.234405 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5c4468ce-acb1-4d9d-acfb-9cdd075a6a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:31.242570 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 871/1731] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:57:31.243601 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949a875-781d-49b2-98af-328f929e576b service cinder] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:31.256188 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949a875-781d-49b2-98af-328f929e576b service cinder] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:31.358941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 861/1732] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:31.360362 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a6fcf-e0ae-4251-b9f0-c89b5ebe5dd8 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:31.360786 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a6fcf-e0ae-4251-b9f0-c89b5ebe5dd8 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:31.361611 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a6fcf-e0ae-4251-b9f0-c89b5ebe5dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:31.387044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb68d8-4eb0-488e-a6ba-cbe48cbcc369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:31.388307 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb68d8-4eb0-488e-a6ba-cbe48cbcc369 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:31.388768 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb68d8-4eb0-488e-a6ba-cbe48cbcc369 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:31.389148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb68d8-4eb0-488e-a6ba-cbe48cbcc369 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:31.390281 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb68d8-4eb0-488e-a6ba-cbe48cbcc369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:31.395246 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb68d8-4eb0-488e-a6ba-cbe48cbcc369 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:31.404348 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-663a6fcf-e0ae-4251-b9f0-c89b5ebe5dd8 None None] MFA Rules not processed for user `06d2f860bd3c4f5b955ff1671f7ce517`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:31.405840 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-663a6fcf-e0ae-4251-b9f0-c89b5ebe5dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:31.484397 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 872/1733] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:31 2022] POST /identity/v3/users => generated 287 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:31.485919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb68d8-4eb0-488e-a6ba-cbe48cbcc369 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:31.489075 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-77eb68d8-4eb0-488e-a6ba-cbe48cbcc369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:31.512533 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 862/1734] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:31.520495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a6fcf-e0ae-4251-b9f0-c89b5ebe5dd8 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:31.534996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a6fcf-e0ae-4251-b9f0-c89b5ebe5dd8 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:31.540984 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5264e9-cea7-4589-9f00-672fbd102e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:31.541664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5264e9-cea7-4589-9f00-672fbd102e7f admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:31.542257 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5264e9-cea7-4589-9f00-672fbd102e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:31.542380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5264e9-cea7-4589-9f00-672fbd102e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:31.543051 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5264e9-cea7-4589-9f00-672fbd102e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:31.544884 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5264e9-cea7-4589-9f00-672fbd102e7f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:31.568060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 863/1735] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:31.569709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef025-6fb9-4cfd-b9a1-c7666da8cd1f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:31.570003 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef025-6fb9-4cfd-b9a1-c7666da8cd1f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:31.570341 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef025-6fb9-4cfd-b9a1-c7666da8cd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:31.615579 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:31.629794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb68d8-4eb0-488e-a6ba-cbe48cbcc369 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:31.635225 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d26ef025-6fb9-4cfd-b9a1-c7666da8cd1f None None] MFA Rules not processed for user `06d2f860bd3c4f5b955ff1671f7ce517`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:31.638308 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d26ef025-6fb9-4cfd-b9a1-c7666da8cd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:31.638422 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3753e-4d6f-4508-a7ba-03e2dd2fa72b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:31.640731 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3753e-4d6f-4508-a7ba-03e2dd2fa72b service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:31.641075 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3753e-4d6f-4508-a7ba-03e2dd2fa72b service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:31.641354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3753e-4d6f-4508-a7ba-03e2dd2fa72b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:31.649280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 864/1736] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:31.650814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ef025-6fb9-4cfd-b9a1-c7666da8cd1f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:31.652038 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3753e-4d6f-4508-a7ba-03e2dd2fa72b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:31.654637 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3753e-4d6f-4508-a7ba-03e2dd2fa72b service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:31.670219 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 873/1737] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:31.671494 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3753e-4d6f-4508-a7ba-03e2dd2fa72b service nova] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:31.673227 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-75d3753e-4d6f-4508-a7ba-03e2dd2fa72b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:31.681924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ef025-6fb9-4cfd-b9a1-c7666da8cd1f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:31.687905 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a04916-6b50-4c0f-b8fc-2cf39644671e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:31.688572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a04916-6b50-4c0f-b8fc-2cf39644671e admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:31.688850 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a04916-6b50-4c0f-b8fc-2cf39644671e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:31.689127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a04916-6b50-4c0f-b8fc-2cf39644671e admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:31.689782 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a04916-6b50-4c0f-b8fc-2cf39644671e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:31.692404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a04916-6b50-4c0f-b8fc-2cf39644671e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:31.718248 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:31.720875 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 865/1738] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:31.729297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a04916-6b50-4c0f-b8fc-2cf39644671e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:31.749923 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3753e-4d6f-4508-a7ba-03e2dd2fa72b service nova] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:31.753691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a04916-6b50-4c0f-b8fc-2cf39644671e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:31.758484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaac7f8-ac95-4875-b8ab-59fa15fce70e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:31.759019 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaac7f8-ac95-4875-b8ab-59fa15fce70e service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:31.762524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaac7f8-ac95-4875-b8ab-59fa15fce70e service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:31.762524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaac7f8-ac95-4875-b8ab-59fa15fce70e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:31.762724 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e040774-dbe3-4610-8098-fc289e1dff77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:31.762724 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040774-dbe3-4610-8098-fc289e1dff77 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:31.762983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040774-dbe3-4610-8098-fc289e1dff77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:31.763273 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040774-dbe3-4610-8098-fc289e1dff77 admin admin] PATH_INFO: `/v3/projects/dec13933101b4d0b9c60dfb404a874c6/users/f8043ea90ff84d3eac21fa643cb8dc6f/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:31.772777 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaac7f8-ac95-4875-b8ab-59fa15fce70e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:31.775032 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaac7f8-ac95-4875-b8ab-59fa15fce70e service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:31.793501 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 874/1739] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:31 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:31.840414 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e040774-dbe3-4610-8098-fc289e1dff77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec13933101b4d0b9c60dfb404a874c6, user_id=f8043ea90ff84d3eac21fa643cb8dc6f, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:31.844038 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e040774-dbe3-4610-8098-fc289e1dff77 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:31.987210 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 866/1740] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:31 2022] PUT /identity/v3/projects/dec13933101b4d0b9c60dfb404a874c6/users/f8043ea90ff84d3eac21fa643cb8dc6f/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:32.004477 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1a6fa-07ce-4be0-b3d2-d0deb38baa1e None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:32.005020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1a6fa-07ce-4be0-b3d2-d0deb38baa1e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:32.005463 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1a6fa-07ce-4be0-b3d2-d0deb38baa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:32.047911 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-9dc1a6fa-07ce-4be0-b3d2-d0deb38baa1e None None] MFA Rules not processed for user `f8043ea90ff84d3eac21fa643cb8dc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:32.049487 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9dc1a6fa-07ce-4be0-b3d2-d0deb38baa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:32.221039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 875/1741] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:32.225968 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e040774-dbe3-4610-8098-fc289e1dff77 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:32.398416 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e040774-dbe3-4610-8098-fc289e1dff77 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:32.417894 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41fcd5-ef77-4f4f-84ee-1baf154ca894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:32.423973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41fcd5-ef77-4f4f-84ee-1baf154ca894 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:32.424259 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41fcd5-ef77-4f4f-84ee-1baf154ca894 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:32.425539 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41fcd5-ef77-4f4f-84ee-1baf154ca894 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:32.426523 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41fcd5-ef77-4f4f-84ee-1baf154ca894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:32.444120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41fcd5-ef77-4f4f-84ee-1baf154ca894 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:32.555465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 867/1742] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:32 2022] POST /identity/v3/projects => generated 373 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:32.559467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1a6fa-07ce-4be0-b3d2-d0deb38baa1e None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:32.578103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1a6fa-07ce-4be0-b3d2-d0deb38baa1e None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:32.677695 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173dd8a-dc9e-48b0-9b54-fdcec9551e75 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:32.680112 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173dd8a-dc9e-48b0-9b54-fdcec9551e75 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:32.680112 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173dd8a-dc9e-48b0-9b54-fdcec9551e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:32.683787 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40c0c0-482c-45ec-8594-d9841c15beec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:32.685520 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40c0c0-482c-45ec-8594-d9841c15beec admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:32.686064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40c0c0-482c-45ec-8594-d9841c15beec admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:32.686474 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40c0c0-482c-45ec-8594-d9841c15beec admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:32.688206 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40c0c0-482c-45ec-8594-d9841c15beec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:32.691126 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40c0c0-482c-45ec-8594-d9841c15beec admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:32.733438 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9173dd8a-dc9e-48b0-9b54-fdcec9551e75 None None] MFA Rules not processed for user `314bb14d5fa1414a832efb6d37c0446d`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:32.734649 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9173dd8a-dc9e-48b0-9b54-fdcec9551e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:32.794273 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:32.824587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 868/1743] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Sep 6 22:57:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:57:32.839876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173dd8a-dc9e-48b0-9b54-fdcec9551e75 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:32.842377 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9173dd8a-dc9e-48b0-9b54-fdcec9551e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:32.860652 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 876/1744] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:32 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:32.866645 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40c0c0-482c-45ec-8594-d9841c15beec admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:32.867644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173dd8a-dc9e-48b0-9b54-fdcec9551e75 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:32.873844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd0716-4865-4ede-ae62-f8e850599ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:32.874598 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd0716-4865-4ede-ae62-f8e850599ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:32.874946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd0716-4865-4ede-ae62-f8e850599ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:32.875915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd0716-4865-4ede-ae62-f8e850599ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:32.887430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd0716-4865-4ede-ae62-f8e850599ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:32.887617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:32.890158 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd0716-4865-4ede-ae62-f8e850599ab0 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:32.895199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40c0c0-482c-45ec-8594-d9841c15beec admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:32.914030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 869/1745] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:32.918129 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2f4bf-6c03-4e43-b689-cdfb4ace8aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:32.921033 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2f4bf-6c03-4e43-b689-cdfb4ace8aaa admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:32.921930 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2f4bf-6c03-4e43-b689-cdfb4ace8aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:32.921930 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2f4bf-6c03-4e43-b689-cdfb4ace8aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:32.923210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2f4bf-6c03-4e43-b689-cdfb4ace8aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:32.926331 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2f4bf-6c03-4e43-b689-cdfb4ace8aaa admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:32.969434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 877/1746] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:57:32.970744 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd0716-4865-4ede-ae62-f8e850599ab0 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:32.999718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd0716-4865-4ede-ae62-f8e850599ab0 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:33.020842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3822c1a-7122-4f66-b743-ae90afc0014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:33.021705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3822c1a-7122-4f66-b743-ae90afc0014b admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:33.021989 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3822c1a-7122-4f66-b743-ae90afc0014b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:33.022265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3822c1a-7122-4f66-b743-ae90afc0014b admin admin] PATH_INFO: `/v3/projects/ae94f4407dd84cd39d1c8688e5a22a84/users/c43ecb2db5c8431eb2a16000fd434596/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:33.071142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3822c1a-7122-4f66-b743-ae90afc0014b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae94f4407dd84cd39d1c8688e5a22a84, user_id=c43ecb2db5c8431eb2a16000fd434596, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:33.076163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3822c1a-7122-4f66-b743-ae90afc0014b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:33.261611 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2f4bf-6c03-4e43-b689-cdfb4ace8aaa admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:33.262776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 870/1747] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:32 2022] PUT /identity/v3/projects/ae94f4407dd84cd39d1c8688e5a22a84/users/c43ecb2db5c8431eb2a16000fd434596/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:57:33.274811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2f4bf-6c03-4e43-b689-cdfb4ace8aaa admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:33.470999 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a07a7-075e-4326-b9c7-eb4f32e060e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:33.478789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a07a7-075e-4326-b9c7-eb4f32e060e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:33.486186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a07a7-075e-4326-b9c7-eb4f32e060e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:33.486186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a07a7-075e-4326-b9c7-eb4f32e060e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:33.486186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a07a7-075e-4326-b9c7-eb4f32e060e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:33.489991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a07a7-075e-4326-b9c7-eb4f32e060e4 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:33.571203 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 878/1748] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:33.576346 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3822c1a-7122-4f66-b743-ae90afc0014b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:33.604834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3822c1a-7122-4f66-b743-ae90afc0014b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:33.612941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfff06b-5ec2-464e-bac2-bdb1c0d63c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:33.613892 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfff06b-5ec2-464e-bac2-bdb1c0d63c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:33.614320 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfff06b-5ec2-464e-bac2-bdb1c0d63c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:33.614747 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfff06b-5ec2-464e-bac2-bdb1c0d63c4c admin admin] PATH_INFO: `/v3/projects/ae94f4407dd84cd39d1c8688e5a22a84/users/c43ecb2db5c8431eb2a16000fd434596/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:33.617124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfff06b-5ec2-464e-bac2-bdb1c0d63c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae94f4407dd84cd39d1c8688e5a22a84, user_id=c43ecb2db5c8431eb2a16000fd434596, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:33.621204 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfff06b-5ec2-464e-bac2-bdb1c0d63c4c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:33.676542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 871/1749] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:33 2022] PUT /identity/v3/projects/ae94f4407dd84cd39d1c8688e5a22a84/users/c43ecb2db5c8431eb2a16000fd434596/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:33.701562 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de43a9-f38a-4a44-927e-0c54ab5ac8a7 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:33.701857 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de43a9-f38a-4a44-927e-0c54ab5ac8a7 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:33.706293 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de43a9-f38a-4a44-927e-0c54ab5ac8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:33.820611 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-42de43a9-f38a-4a44-927e-0c54ab5ac8a7 None None] MFA Rules not processed for user `c43ecb2db5c8431eb2a16000fd434596`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:33.820611 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-42de43a9-f38a-4a44-927e-0c54ab5ac8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:33.988468 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 879/1750] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:34.159331 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfff06b-5ec2-464e-bac2-bdb1c0d63c4c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:34.252932 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c4eb8-5d64-4e66-924a-9f0b0147435b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:34.253231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c4eb8-5d64-4e66-924a-9f0b0147435b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:34.253527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c4eb8-5d64-4e66-924a-9f0b0147435b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:34.313022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfff06b-5ec2-464e-bac2-bdb1c0d63c4c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:34.324196 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b6eda-fb5c-4db4-a122-feb8fe9b956c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:34.325812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b6eda-fb5c-4db4-a122-feb8fe9b956c service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:34.326301 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b6eda-fb5c-4db4-a122-feb8fe9b956c service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:34.328857 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b6eda-fb5c-4db4-a122-feb8fe9b956c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:34.353797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-aa6c4eb8-5d64-4e66-924a-9f0b0147435b None None] MFA Rules not processed for user `06d2f860bd3c4f5b955ff1671f7ce517`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:34.357587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-aa6c4eb8-5d64-4e66-924a-9f0b0147435b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:34.390487 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:34.501981 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b6eda-fb5c-4db4-a122-feb8fe9b956c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:34.505893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b6eda-fb5c-4db4-a122-feb8fe9b956c service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:34.558491 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 880/1751] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:34.559114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 872/1752] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:34.565542 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ca747-a0a5-48ed-addf-03367e396949 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:34.565909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ca747-a0a5-48ed-addf-03367e396949 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:34.566765 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ca747-a0a5-48ed-addf-03367e396949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:34.633411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:34.842012 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-c46ca747-a0a5-48ed-addf-03367e396949 None None] MFA Rules not processed for user `642d4bef7e9c459a8d2dde636094b528`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:34.850646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c46ca747-a0a5-48ed-addf-03367e396949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:35.137035 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 881/1753] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Sep 6 22:57:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 573 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:35.569296 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b20bd-1333-4787-a075-3ac5c775b85f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:35.569865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b20bd-1333-4787-a075-3ac5c775b85f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:35.570482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b20bd-1333-4787-a075-3ac5c775b85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:35.628609 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-1e0b20bd-1333-4787-a075-3ac5c775b85f None None] MFA Rules not processed for user `5655757c28a446ed8f7468a4146aa09c`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:35.643807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1e0b20bd-1333-4787-a075-3ac5c775b85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:35.644188 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ca747-a0a5-48ed-addf-03367e396949 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:35.645932 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c46ca747-a0a5-48ed-addf-03367e396949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:35.877881 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 873/1754] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:35.927764 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ca747-a0a5-48ed-addf-03367e396949 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:35.961827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04cc2c-3807-472b-8f1c-d118e72f874b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660248a90f524a43b143bae127e0eaa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:35.964758 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04cc2c-3807-472b-8f1c-d118e72f874b service swift] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:35.965905 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04cc2c-3807-472b-8f1c-d118e72f874b service swift] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:35.966403 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04cc2c-3807-472b-8f1c-d118e72f874b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:36.006616 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04cc2c-3807-472b-8f1c-d118e72f874b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:36.015554 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04cc2c-3807-472b-8f1c-d118e72f874b service swift] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:36.037638 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 882/1755] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Sep 6 22:57:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 22:57:36.934673 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:37.211566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4ad1b-5708-401d-a184-97d945652cc2 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:37.212218 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4ad1b-5708-401d-a184-97d945652cc2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:37.212861 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4ad1b-5708-401d-a184-97d945652cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:37.282132 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-49a4ad1b-5708-401d-a184-97d945652cc2 None None] MFA Rules not processed for user `314bb14d5fa1414a832efb6d37c0446d`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:37.284889 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-49a4ad1b-5708-401d-a184-97d945652cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:37.592978 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:37.680224 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 874/1756] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Sep 6 22:57:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:37.833970 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04cc2c-3807-472b-8f1c-d118e72f874b service swift] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:37.886403 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04cc2c-3807-472b-8f1c-d118e72f874b service swift] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:37.939171 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123c3eb-7f34-44ec-94dd-886d7f438834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:37.941669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123c3eb-7f34-44ec-94dd-886d7f438834 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:37.948466 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123c3eb-7f34-44ec-94dd-886d7f438834 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:37.948466 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123c3eb-7f34-44ec-94dd-886d7f438834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:37.949697 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4ad1b-5708-401d-a184-97d945652cc2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:37.951636 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-49a4ad1b-5708-401d-a184-97d945652cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:38.003193 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123c3eb-7f34-44ec-94dd-886d7f438834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:38.004942 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123c3eb-7f34-44ec-94dd-886d7f438834 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:38.052957 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 883/1757] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:38.216640 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4ad1b-5708-401d-a184-97d945652cc2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:38.227425 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640763b-21e8-4707-b2c4-bff8e0337219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:38.228352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640763b-21e8-4707-b2c4-bff8e0337219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:38.229185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640763b-21e8-4707-b2c4-bff8e0337219 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:38.229605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640763b-21e8-4707-b2c4-bff8e0337219 admin admin] PATH_INFO: `/v3/users/374a55993be849209bee3030e0953c16` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:38.231346 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640763b-21e8-4707-b2c4-bff8e0337219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=374a55993be849209bee3030e0953c16)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:38.233592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640763b-21e8-4707-b2c4-bff8e0337219 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:38.374572 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:38.540094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6640763b-21e8-4707-b2c4-bff8e0337219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '374a55993be849209bee3030e0953c16'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:38.633695 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6640763b-21e8-4707-b2c4-bff8e0337219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '374a55993be849209bee3030e0953c16'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:38.640800 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6640763b-21e8-4707-b2c4-bff8e0337219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '374a55993be849209bee3030e0953c16'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:38.640800 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6640763b-21e8-4707-b2c4-bff8e0337219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '374a55993be849209bee3030e0953c16'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:38.663553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6640763b-21e8-4707-b2c4-bff8e0337219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '374a55993be849209bee3030e0953c16'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:38.789705 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03a016-1e24-468a-80b1-a1ddfcb6c35b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:38.790236 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03a016-1e24-468a-80b1-a1ddfcb6c35b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:38.790333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03a016-1e24-468a-80b1-a1ddfcb6c35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:38.803566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 875/1758] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:57:37 2022] DELETE /identity/v3/users/374a55993be849209bee3030e0953c16 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:38.808195 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b8523-3e66-400b-97a1-8f73addf045d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:38.808613 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b8523-3e66-400b-97a1-8f73addf045d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:38.808896 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b8523-3e66-400b-97a1-8f73addf045d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:38.891441 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-7e03a016-1e24-468a-80b1-a1ddfcb6c35b None None] MFA Rules not processed for user `07a7969f07564904bc69fe0d026c6fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:38.892745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7e03a016-1e24-468a-80b1-a1ddfcb6c35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:39.006509 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a53b8523-3e66-400b-97a1-8f73addf045d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:39.014535 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a53b8523-3e66-400b-97a1-8f73addf045d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:39.224902 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 876/1759] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:57:39.236766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b8523-3e66-400b-97a1-8f73addf045d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:39.238736 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a53b8523-3e66-400b-97a1-8f73addf045d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:39.252532 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 884/1760] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:39.423001 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b8523-3e66-400b-97a1-8f73addf045d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:39.428075 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91289b3a-85c6-4b3a-895e-669310023308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:39.428838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91289b3a-85c6-4b3a-895e-669310023308 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:39.429185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91289b3a-85c6-4b3a-895e-669310023308 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:39.429652 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91289b3a-85c6-4b3a-895e-669310023308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:39.473341 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91289b3a-85c6-4b3a-895e-669310023308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:39.480973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91289b3a-85c6-4b3a-895e-669310023308 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:39.502010 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 877/1761] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:39.940077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:40.306476 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:40.456151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03a016-1e24-468a-80b1-a1ddfcb6c35b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:40.458882 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7e03a016-1e24-468a-80b1-a1ddfcb6c35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:40.504269 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03a016-1e24-468a-80b1-a1ddfcb6c35b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:40.518408 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4fdfb-5f72-4448-967a-0aeed5f88b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:40.519447 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4fdfb-5f72-4448-967a-0aeed5f88b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:40.519996 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4fdfb-5f72-4448-967a-0aeed5f88b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:40.520517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4fdfb-5f72-4448-967a-0aeed5f88b16 admin admin] PATH_INFO: `/v3/users/f8043ea90ff84d3eac21fa643cb8dc6f` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:40.521937 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4fdfb-5f72-4448-967a-0aeed5f88b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8043ea90ff84d3eac21fa643cb8dc6f)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:40.529203 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4fdfb-5f72-4448-967a-0aeed5f88b16 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:40.897210 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91289b3a-85c6-4b3a-895e-669310023308 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:40.899588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-91289b3a-85c6-4b3a-895e-669310023308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:40.913926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d0f4fdfb-5f72-4448-967a-0aeed5f88b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8043ea90ff84d3eac21fa643cb8dc6f'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:40.943535 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91289b3a-85c6-4b3a-895e-669310023308 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:40.996960 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4c317-d3cb-4a9d-92c4-5929d72a822b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:40.998546 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4c317-d3cb-4a9d-92c4-5929d72a822b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:40.999528 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4c317-d3cb-4a9d-92c4-5929d72a822b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:41.000920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4c317-d3cb-4a9d-92c4-5929d72a822b admin admin] PATH_INFO: `/v3/projects/848d8cbfbecc45bc8d5f3304d1d8745e` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:41.004120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4c317-d3cb-4a9d-92c4-5929d72a822b admin admin] RBAC: Authorizing `identity:delete_project(project_id=848d8cbfbecc45bc8d5f3304d1d8745e)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:41.008023 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4c317-d3cb-4a9d-92c4-5929d72a822b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:41.037596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d0f4fdfb-5f72-4448-967a-0aeed5f88b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8043ea90ff84d3eac21fa643cb8dc6f'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:41.038503 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d0f4fdfb-5f72-4448-967a-0aeed5f88b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8043ea90ff84d3eac21fa643cb8dc6f'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:41.098319 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d0f4fdfb-5f72-4448-967a-0aeed5f88b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8043ea90ff84d3eac21fa643cb8dc6f'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:41.100667 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d0f4fdfb-5f72-4448-967a-0aeed5f88b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8043ea90ff84d3eac21fa643cb8dc6f'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:41.158878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 885/1762] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:57:40 2022] DELETE /identity/v3/users/f8043ea90ff84d3eac21fa643cb8dc6f => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:41.163344 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c901bec-edb7-4373-a4f2-ddf9d161d4c5 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:41.163845 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c901bec-edb7-4373-a4f2-ddf9d161d4c5 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:41.164656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c901bec-edb7-4373-a4f2-ddf9d161d4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:41.220857 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e6a4c317-d3cb-4a9d-92c4-5929d72a822b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '848d8cbfbecc45bc8d5f3304d1d8745e', 'request_id': 'req-e6a4c317-d3cb-4a9d-92c4-5929d72a822b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:41.223342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-9c901bec-edb7-4373-a4f2-ddf9d161d4c5 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:41.225329 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9c901bec-edb7-4373-a4f2-ddf9d161d4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:41.243621 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e6a4c317-d3cb-4a9d-92c4-5929d72a822b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '848d8cbfbecc45bc8d5f3304d1d8745e', 'request_id': 'req-e6a4c317-d3cb-4a9d-92c4-5929d72a822b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:41.350354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 886/1763] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:41.371970 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c901bec-edb7-4373-a4f2-ddf9d161d4c5 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:41.380459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e6a4c317-d3cb-4a9d-92c4-5929d72a822b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '848d8cbfbecc45bc8d5f3304d1d8745e', 'request_id': 'req-e6a4c317-d3cb-4a9d-92c4-5929d72a822b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:41.381259 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9c901bec-edb7-4373-a4f2-ddf9d161d4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:41.400823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e6a4c317-d3cb-4a9d-92c4-5929d72a822b admin admin] The token cache is being invalidate because project 848d8cbfbecc45bc8d5f3304d1d8745e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:57:41.400823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e6a4c317-d3cb-4a9d-92c4-5929d72a822b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:41.406257 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e6a4c317-d3cb-4a9d-92c4-5929d72a822b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:41.411546 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 878/1764] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:57:40 2022] DELETE /identity/v3/projects/848d8cbfbecc45bc8d5f3304d1d8745e => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:41.412960 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4c317-d3cb-4a9d-92c4-5929d72a822b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:41.417436 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e6a4c317-d3cb-4a9d-92c4-5929d72a822b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:41.439278 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4c317-d3cb-4a9d-92c4-5929d72a822b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:41.455472 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e2377-3521-44b3-92ce-8cac639343dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:41.456160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e2377-3521-44b3-92ce-8cac639343dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:41.456772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e2377-3521-44b3-92ce-8cac639343dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:41.457407 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e2377-3521-44b3-92ce-8cac639343dd admin admin] PATH_INFO: `/v3/users/bfa97d7948f943ed806fae4e5fc53745` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:41.459567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e2377-3521-44b3-92ce-8cac639343dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfa97d7948f943ed806fae4e5fc53745)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:41.461922 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e2377-3521-44b3-92ce-8cac639343dd admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:41.593688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c901bec-edb7-4373-a4f2-ddf9d161d4c5 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:41.604557 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bc07f-0d8a-421f-a6fc-ff373f1992f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:41.605468 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bc07f-0d8a-421f-a6fc-ff373f1992f1 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:41.605980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bc07f-0d8a-421f-a6fc-ff373f1992f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:41.606407 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bc07f-0d8a-421f-a6fc-ff373f1992f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:41.609874 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9e7bc07f-0d8a-421f-a6fc-ff373f1992f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:41.653596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7bc07f-0d8a-421f-a6fc-ff373f1992f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:41.655653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7bc07f-0d8a-421f-a6fc-ff373f1992f1 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:41.672016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 887/1765] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:41.727548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-884e2377-3521-44b3-92ce-8cac639343dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfa97d7948f943ed806fae4e5fc53745'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:41.843090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-884e2377-3521-44b3-92ce-8cac639343dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfa97d7948f943ed806fae4e5fc53745'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:41.843917 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-884e2377-3521-44b3-92ce-8cac639343dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfa97d7948f943ed806fae4e5fc53745'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:41.844815 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-884e2377-3521-44b3-92ce-8cac639343dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfa97d7948f943ed806fae4e5fc53745'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:41.866225 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:41.875855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-884e2377-3521-44b3-92ce-8cac639343dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfa97d7948f943ed806fae4e5fc53745'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:41.922153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 879/1766] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:57:41 2022] DELETE /identity/v3/users/bfa97d7948f943ed806fae4e5fc53745 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:57:42.105862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:42.631507 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bd58b-fc84-47c5-8ead-459ac424fc5c None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:42.632225 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bd58b-fc84-47c5-8ead-459ac424fc5c None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:42.632800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bd58b-fc84-47c5-8ead-459ac424fc5c None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:42.635042 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 888/1767] 10.222.0.30 () {54 vars in 921 bytes} [Tue Sep 6 22:57:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:57:42.702269 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c796273-ea61-40d4-8054-17b9bb378a9c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:42.702803 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c796273-ea61-40d4-8054-17b9bb378a9c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:42.703316 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c796273-ea61-40d4-8054-17b9bb378a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:42.734480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:42.784100 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3c796273-ea61-40d4-8054-17b9bb378a9c None None] MFA Rules not processed for user `b18fd296138349408613004929144e70`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:42.789979 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3c796273-ea61-40d4-8054-17b9bb378a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:42.991540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 880/1768] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Sep 6 22:57:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:57:43.267331 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:43.353510 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:43.361746 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bd58b-fc84-47c5-8ead-459ac424fc5c None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:43.363578 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c73bd58b-fc84-47c5-8ead-459ac424fc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:43.538421 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c796273-ea61-40d4-8054-17b9bb378a9c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:43.544139 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3c796273-ea61-40d4-8054-17b9bb378a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:43.550684 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bd58b-fc84-47c5-8ead-459ac424fc5c None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:43.562215 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411981d-dcd6-418d-8fd9-0ee038369bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:43.564560 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411981d-dcd6-418d-8fd9-0ee038369bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:43.565027 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411981d-dcd6-418d-8fd9-0ee038369bda admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:43.569518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411981d-dcd6-418d-8fd9-0ee038369bda admin admin] PATH_INFO: `/v3/projects/dec13933101b4d0b9c60dfb404a874c6` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:43.569518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411981d-dcd6-418d-8fd9-0ee038369bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec13933101b4d0b9c60dfb404a874c6)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:43.576688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411981d-dcd6-418d-8fd9-0ee038369bda admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:43.615786 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c796273-ea61-40d4-8054-17b9bb378a9c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:43.646059 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbea7f6-6eed-4878-b8ed-792a2db52cba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:43.646858 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbea7f6-6eed-4878-b8ed-792a2db52cba service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:43.647053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbea7f6-6eed-4878-b8ed-792a2db52cba service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:43.647390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbea7f6-6eed-4878-b8ed-792a2db52cba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:43.671235 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbea7f6-6eed-4878-b8ed-792a2db52cba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:43.673984 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbea7f6-6eed-4878-b8ed-792a2db52cba service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:43.733839 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 881/1769] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:57:43.794809 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d411981d-dcd6-418d-8fd9-0ee038369bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec13933101b4d0b9c60dfb404a874c6', 'request_id': 'req-d411981d-dcd6-418d-8fd9-0ee038369bda'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:43.807078 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d411981d-dcd6-418d-8fd9-0ee038369bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec13933101b4d0b9c60dfb404a874c6', 'request_id': 'req-d411981d-dcd6-418d-8fd9-0ee038369bda'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:43.870974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d411981d-dcd6-418d-8fd9-0ee038369bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec13933101b4d0b9c60dfb404a874c6', 'request_id': 'req-d411981d-dcd6-418d-8fd9-0ee038369bda'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:43.872317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:43.919511 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d411981d-dcd6-418d-8fd9-0ee038369bda admin admin] The token cache is being invalidate because project dec13933101b4d0b9c60dfb404a874c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:57:43.919879 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d411981d-dcd6-418d-8fd9-0ee038369bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:43.923144 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d411981d-dcd6-418d-8fd9-0ee038369bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:43.929516 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 889/1770] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:57:43 2022] DELETE /identity/v3/projects/dec13933101b4d0b9c60dfb404a874c6 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:43.930801 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbea7f6-6eed-4878-b8ed-792a2db52cba service nova] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:43.948690 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbea7f6-6eed-4878-b8ed-792a2db52cba service nova] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:44.291890 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222aa98f-d725-49e9-a904-54bdbe7ca54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:44.297560 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aa98f-d725-49e9-a904-54bdbe7ca54f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:44.297560 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aa98f-d725-49e9-a904-54bdbe7ca54f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:44.298022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222aa98f-d725-49e9-a904-54bdbe7ca54f admin admin] PATH_INFO: `/v3/users/c43ecb2db5c8431eb2a16000fd434596` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:44.307191 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222aa98f-d725-49e9-a904-54bdbe7ca54f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c43ecb2db5c8431eb2a16000fd434596)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:44.317921 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222aa98f-d725-49e9-a904-54bdbe7ca54f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:44.326518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411981d-dcd6-418d-8fd9-0ee038369bda admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:44.328234 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d411981d-dcd6-418d-8fd9-0ee038369bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:44.404534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411981d-dcd6-418d-8fd9-0ee038369bda admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:44.421834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021c0f2-09a4-4565-bb5a-2a7904791fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:44.422887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021c0f2-09a4-4565-bb5a-2a7904791fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:44.426352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021c0f2-09a4-4565-bb5a-2a7904791fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:44.426848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021c0f2-09a4-4565-bb5a-2a7904791fc7 admin admin] PATH_INFO: `/v3/projects/8eab87d942c647afb10136ff5bd74861` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:44.431628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021c0f2-09a4-4565-bb5a-2a7904791fc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eab87d942c647afb10136ff5bd74861)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:44.440759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021c0f2-09a4-4565-bb5a-2a7904791fc7 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:44.685933 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9021c0f2-09a4-4565-bb5a-2a7904791fc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eab87d942c647afb10136ff5bd74861', 'request_id': 'req-9021c0f2-09a4-4565-bb5a-2a7904791fc7'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:44.701559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9021c0f2-09a4-4565-bb5a-2a7904791fc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eab87d942c647afb10136ff5bd74861', 'request_id': 'req-9021c0f2-09a4-4565-bb5a-2a7904791fc7'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:44.709884 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-222aa98f-d725-49e9-a904-54bdbe7ca54f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c43ecb2db5c8431eb2a16000fd434596'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:44.813842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-222aa98f-d725-49e9-a904-54bdbe7ca54f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c43ecb2db5c8431eb2a16000fd434596'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:44.814836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-222aa98f-d725-49e9-a904-54bdbe7ca54f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c43ecb2db5c8431eb2a16000fd434596'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:44.815759 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-222aa98f-d725-49e9-a904-54bdbe7ca54f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c43ecb2db5c8431eb2a16000fd434596'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:44.829801 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-222aa98f-d725-49e9-a904-54bdbe7ca54f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c43ecb2db5c8431eb2a16000fd434596'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:44.867586 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 882/1771] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:57:43 2022] DELETE /identity/v3/users/c43ecb2db5c8431eb2a16000fd434596 => generated 0 bytes in 934 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:44.868071 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222aa98f-d725-49e9-a904-54bdbe7ca54f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:44.873694 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-222aa98f-d725-49e9-a904-54bdbe7ca54f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:44.876597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9021c0f2-09a4-4565-bb5a-2a7904791fc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eab87d942c647afb10136ff5bd74861', 'request_id': 'req-9021c0f2-09a4-4565-bb5a-2a7904791fc7'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:44.905321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9021c0f2-09a4-4565-bb5a-2a7904791fc7 admin admin] The token cache is being invalidate because project 8eab87d942c647afb10136ff5bd74861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:57:44.905321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9021c0f2-09a4-4565-bb5a-2a7904791fc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:44.908710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9021c0f2-09a4-4565-bb5a-2a7904791fc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:44.915957 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 890/1772] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:57:44 2022] DELETE /identity/v3/projects/8eab87d942c647afb10136ff5bd74861 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:57:44.924257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df9302-a03d-4dd9-b317-129818e98e7d None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:44.925796 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df9302-a03d-4dd9-b317-129818e98e7d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:44.926220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df9302-a03d-4dd9-b317-129818e98e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:44.952707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-d6df9302-a03d-4dd9-b317-129818e98e7d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:44.954393 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d6df9302-a03d-4dd9-b317-129818e98e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:44.981393 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:45.056014 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222aa98f-d725-49e9-a904-54bdbe7ca54f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:45.067428 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5898a5-feb3-4aa4-900c-e72ac48c0b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:45.069745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5898a5-feb3-4aa4-900c-e72ac48c0b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:45.070322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5898a5-feb3-4aa4-900c-e72ac48c0b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:45.071408 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5898a5-feb3-4aa4-900c-e72ac48c0b8d admin admin] PATH_INFO: `/v3/users/69fa143281db459ebaab619cc5629ccd` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:45.074734 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5898a5-feb3-4aa4-900c-e72ac48c0b8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=69fa143281db459ebaab619cc5629ccd)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:45.077109 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5898a5-feb3-4aa4-900c-e72ac48c0b8d admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:45.087512 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 891/1773] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:45.089270 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dedd6-099b-4983-bff2-b183ba535809 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:45.091603 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dedd6-099b-4983-bff2-b183ba535809 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:45.092056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dedd6-099b-4983-bff2-b183ba535809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:45.127981 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-d48dedd6-099b-4983-bff2-b183ba535809 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:45.129751 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d48dedd6-099b-4983-bff2-b183ba535809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:45.143677 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 892/1774] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:45.150988 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dedd6-099b-4983-bff2-b183ba535809 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:45.164775 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dedd6-099b-4983-bff2-b183ba535809 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:45.195927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d86b16-1eae-4ad6-9f3a-009799965b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:45.196618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86b16-1eae-4ad6-9f3a-009799965b7f admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:45.199900 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86b16-1eae-4ad6-9f3a-009799965b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:45.199900 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86b16-1eae-4ad6-9f3a-009799965b7f admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:45.199900 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d86b16-1eae-4ad6-9f3a-009799965b7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:57:45.199900 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d86b16-1eae-4ad6-9f3a-009799965b7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:45.209470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d86b16-1eae-4ad6-9f3a-009799965b7f admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:45.231768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:45.254916 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 893/1775] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:57:45.260654 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d86b16-1eae-4ad6-9f3a-009799965b7f admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:45.290695 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d86b16-1eae-4ad6-9f3a-009799965b7f admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:45.290695 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54fe0f-f0cd-40a8-8914-05f695ec5b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:45.290695 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54fe0f-f0cd-40a8-8914-05f695ec5b1c admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:45.290695 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54fe0f-f0cd-40a8-8914-05f695ec5b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:45.290961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54fe0f-f0cd-40a8-8914-05f695ec5b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:45.290961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54fe0f-f0cd-40a8-8914-05f695ec5b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:45.292729 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54fe0f-f0cd-40a8-8914-05f695ec5b1c admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:45.354412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ee5898a5-feb3-4aa4-900c-e72ac48c0b8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69fa143281db459ebaab619cc5629ccd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:45.426621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 894/1776] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:45 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:57:45.437196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54fe0f-f0cd-40a8-8914-05f695ec5b1c admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:45.482569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ee5898a5-feb3-4aa4-900c-e72ac48c0b8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69fa143281db459ebaab619cc5629ccd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:45.483218 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ee5898a5-feb3-4aa4-900c-e72ac48c0b8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69fa143281db459ebaab619cc5629ccd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:45.483921 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ee5898a5-feb3-4aa4-900c-e72ac48c0b8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69fa143281db459ebaab619cc5629ccd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:45.496587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ee5898a5-feb3-4aa4-900c-e72ac48c0b8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69fa143281db459ebaab619cc5629ccd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:45.559236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 883/1777] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:57:44 2022] DELETE /identity/v3/users/69fa143281db459ebaab619cc5629ccd => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:45.563758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d675e-5857-44c1-bb12-4c0d9cd07e3e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:45.564322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d675e-5857-44c1-bb12-4c0d9cd07e3e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:45.565012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d675e-5857-44c1-bb12-4c0d9cd07e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:45.613270 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54fe0f-f0cd-40a8-8914-05f695ec5b1c admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:45.632824 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b83d675e-5857-44c1-bb12-4c0d9cd07e3e None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:45.634144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b83d675e-5857-44c1-bb12-4c0d9cd07e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:45.812160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 884/1778] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:45.846444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e262f31-669c-470e-b9d7-cc3b130431ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:45.847800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e262f31-669c-470e-b9d7-cc3b130431ea admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:45.848357 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e262f31-669c-470e-b9d7-cc3b130431ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:45.848957 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e262f31-669c-470e-b9d7-cc3b130431ea admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:45.850071 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e262f31-669c-470e-b9d7-cc3b130431ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:45.852608 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e262f31-669c-470e-b9d7-cc3b130431ea admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:45.866261 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d675e-5857-44c1-bb12-4c0d9cd07e3e None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:45.867996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b83d675e-5857-44c1-bb12-4c0d9cd07e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:45.970172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 895/1779] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:45 2022] POST /identity/v3/users => generated 294 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:57:45.974637 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e262f31-669c-470e-b9d7-cc3b130431ea admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:45.983572 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4e262f31-669c-470e-b9d7-cc3b130431ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:46.002715 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e262f31-669c-470e-b9d7-cc3b130431ea admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:46.010862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f2d90-cc94-460c-b82a-0631eaa52897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:46.012906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f2d90-cc94-460c-b82a-0631eaa52897 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:46.013224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f2d90-cc94-460c-b82a-0631eaa52897 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:46.013503 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f2d90-cc94-460c-b82a-0631eaa52897 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:46.014184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f2d90-cc94-460c-b82a-0631eaa52897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:46.018567 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f2d90-cc94-460c-b82a-0631eaa52897 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:46.021393 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d675e-5857-44c1-bb12-4c0d9cd07e3e None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:46.037724 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40f702-dea0-482c-a0c5-698d84f6423a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:46.041096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40f702-dea0-482c-a0c5-698d84f6423a service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:46.042361 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40f702-dea0-482c-a0c5-698d84f6423a service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:46.043850 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40f702-dea0-482c-a0c5-698d84f6423a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:46.046317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 896/1780] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:46.050365 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f2d90-cc94-460c-b82a-0631eaa52897 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:46.061880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f2d90-cc94-460c-b82a-0631eaa52897 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:46.073897 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127bdff-5813-4294-aa00-9bd46ba3a0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:46.074830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127bdff-5813-4294-aa00-9bd46ba3a0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:46.075281 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127bdff-5813-4294-aa00-9bd46ba3a0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:46.075528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127bdff-5813-4294-aa00-9bd46ba3a0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:46.076022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40f702-dea0-482c-a0c5-698d84f6423a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:46.076324 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127bdff-5813-4294-aa00-9bd46ba3a0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:46.077541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40f702-dea0-482c-a0c5-698d84f6423a service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:46.078217 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127bdff-5813-4294-aa00-9bd46ba3a0c9 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:46.109488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 885/1781] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:46.109694 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 897/1782] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:57:46.109799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40f702-dea0-482c-a0c5-698d84f6423a service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:46.121623 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40f702-dea0-482c-a0c5-698d84f6423a service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:46.128901 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64dc793-b372-400c-96c1-1aec17c8a6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:46.130302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dc793-b372-400c-96c1-1aec17c8a6c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:46.131090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dc793-b372-400c-96c1-1aec17c8a6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:46.131823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dc793-b372-400c-96c1-1aec17c8a6c2 admin admin] PATH_INFO: `/v3/projects/32aa6a20e5794815839e7354a344a60b/users/d58652101c0949468dd2843c2e15e337/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:46.155728 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64dc793-b372-400c-96c1-1aec17c8a6c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32aa6a20e5794815839e7354a344a60b, user_id=d58652101c0949468dd2843c2e15e337, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:46.159049 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64dc793-b372-400c-96c1-1aec17c8a6c2 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:46.163168 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:46.325764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 886/1783] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:46 2022] PUT /identity/v3/projects/32aa6a20e5794815839e7354a344a60b/users/d58652101c0949468dd2843c2e15e337/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:57:46.336533 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f0d86-ebf9-4f91-9dc6-53f9b5b1e27c None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:46.336826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f0d86-ebf9-4f91-9dc6-53f9b5b1e27c None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:46.337107 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f0d86-ebf9-4f91-9dc6-53f9b5b1e27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:46.403517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:46.410547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-3e2f0d86-ebf9-4f91-9dc6-53f9b5b1e27c None None] MFA Rules not processed for user `d58652101c0949468dd2843c2e15e337`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:46.414466 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3e2f0d86-ebf9-4f91-9dc6-53f9b5b1e27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:46.564502 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 898/1784] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:46.568194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64dc793-b372-400c-96c1-1aec17c8a6c2 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:46.773232 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64dc793-b372-400c-96c1-1aec17c8a6c2 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:46.790716 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a0bb3-76a7-46e4-b6dd-f9d39f8614c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:46.793669 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a0bb3-76a7-46e4-b6dd-f9d39f8614c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:46.795946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a0bb3-76a7-46e4-b6dd-f9d39f8614c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:46.797877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a0bb3-76a7-46e4-b6dd-f9d39f8614c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:46.799565 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a0bb3-76a7-46e4-b6dd-f9d39f8614c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:46.804259 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a0bb3-76a7-46e4-b6dd-f9d39f8614c0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:46.930987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 887/1785] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:46 2022] POST /identity/v3/projects => generated 385 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:46.932954 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f0d86-ebf9-4f91-9dc6-53f9b5b1e27c None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:46.947038 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f0d86-ebf9-4f91-9dc6-53f9b5b1e27c None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:47.044262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02202359-c8b3-489a-a911-984ad1afa7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:47.045321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02202359-c8b3-489a-a911-984ad1afa7fb admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:47.045461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02202359-c8b3-489a-a911-984ad1afa7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:47.045761 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02202359-c8b3-489a-a911-984ad1afa7fb admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:47.047269 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02202359-c8b3-489a-a911-984ad1afa7fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:47.051056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02202359-c8b3-489a-a911-984ad1afa7fb admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:47.215404 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 899/1786] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:46 2022] POST /identity/v3/users => generated 299 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:47.219108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a0bb3-76a7-46e4-b6dd-f9d39f8614c0 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:47.233969 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a0bb3-76a7-46e4-b6dd-f9d39f8614c0 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:47.241917 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef9ab6-a3ad-4167-86e2-f9df11766279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:47.242985 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef9ab6-a3ad-4167-86e2-f9df11766279 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:47.243470 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef9ab6-a3ad-4167-86e2-f9df11766279 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:47.244127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef9ab6-a3ad-4167-86e2-f9df11766279 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:47.245144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef9ab6-a3ad-4167-86e2-f9df11766279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:47.247787 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef9ab6-a3ad-4167-86e2-f9df11766279 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:47.263558 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 888/1787] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:47.267725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02202359-c8b3-489a-a911-984ad1afa7fb admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:47.307327 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02202359-c8b3-489a-a911-984ad1afa7fb admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:47.331751 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6fd8b-c8f8-43cf-9d05-b643b5e81cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:47.342628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6fd8b-c8f8-43cf-9d05-b643b5e81cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:47.342853 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6fd8b-c8f8-43cf-9d05-b643b5e81cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:47.343140 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6fd8b-c8f8-43cf-9d05-b643b5e81cc7 admin admin] PATH_INFO: `/v3/projects/644952babf204de9b83bbd322537dc6c/users/c21d0739714a4f70be1a3e421d7a74e5/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:47.404476 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6fd8b-c8f8-43cf-9d05-b643b5e81cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=644952babf204de9b83bbd322537dc6c, user_id=c21d0739714a4f70be1a3e421d7a74e5, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:47.409028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6fd8b-c8f8-43cf-9d05-b643b5e81cc7 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:47.492881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 900/1788] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:47 2022] PUT /identity/v3/projects/644952babf204de9b83bbd322537dc6c/users/c21d0739714a4f70be1a3e421d7a74e5/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:57:47.494431 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef9ab6-a3ad-4167-86e2-f9df11766279 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:47.512865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef9ab6-a3ad-4167-86e2-f9df11766279 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:47.606464 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036ecb7-d14e-4d45-9a0d-519c5e852729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:47.607499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036ecb7-d14e-4d45-9a0d-519c5e852729 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:47.607905 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036ecb7-d14e-4d45-9a0d-519c5e852729 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:47.608306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036ecb7-d14e-4d45-9a0d-519c5e852729 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:47.609235 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036ecb7-d14e-4d45-9a0d-519c5e852729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:47.611339 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036ecb7-d14e-4d45-9a0d-519c5e852729 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:47.646836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 889/1789] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:47.650398 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6fd8b-c8f8-43cf-9d05-b643b5e81cc7 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:47.666423 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6fd8b-c8f8-43cf-9d05-b643b5e81cc7 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:47.675009 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd6457-4187-454f-807b-5b7f6c7a38e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:47.676080 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd6457-4187-454f-807b-5b7f6c7a38e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:47.676628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd6457-4187-454f-807b-5b7f6c7a38e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:47.677109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd6457-4187-454f-807b-5b7f6c7a38e3 admin admin] PATH_INFO: `/v3/projects/644952babf204de9b83bbd322537dc6c/users/c21d0739714a4f70be1a3e421d7a74e5/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:47.679672 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd6457-4187-454f-807b-5b7f6c7a38e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=644952babf204de9b83bbd322537dc6c, user_id=c21d0739714a4f70be1a3e421d7a74e5, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:47.685359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd6457-4187-454f-807b-5b7f6c7a38e3 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:47.696256 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:47.703662 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 901/1790] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:47 2022] PUT /identity/v3/projects/644952babf204de9b83bbd322537dc6c/users/c21d0739714a4f70be1a3e421d7a74e5/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:47.717862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436b1b1-db0e-44d3-ab48-f7fdb507e5b2 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:47.718497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436b1b1-db0e-44d3-ab48-f7fdb507e5b2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:47.720697 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436b1b1-db0e-44d3-ab48-f7fdb507e5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:47.787822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-5436b1b1-db0e-44d3-ab48-f7fdb507e5b2 None None] MFA Rules not processed for user `c21d0739714a4f70be1a3e421d7a74e5`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:47.801381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5436b1b1-db0e-44d3-ab48-f7fdb507e5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:47.805416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd6457-4187-454f-807b-5b7f6c7a38e3 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:47.808175 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0fdd6457-4187-454f-807b-5b7f6c7a38e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:47.914878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:48.010757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 890/1791] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:48.010757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436b1b1-db0e-44d3-ab48-f7fdb507e5b2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:48.023365 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5436b1b1-db0e-44d3-ab48-f7fdb507e5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:48.023598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd6457-4187-454f-807b-5b7f6c7a38e3 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:48.051625 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4e7c2-7ba8-4097-9517-8d11c0ffc936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:48.052744 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4e7c2-7ba8-4097-9517-8d11c0ffc936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:48.057359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4e7c2-7ba8-4097-9517-8d11c0ffc936 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:48.057359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4e7c2-7ba8-4097-9517-8d11c0ffc936 admin admin] PATH_INFO: `/v3/projects/d735e0a4cb0149828d89062f16079536` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:48.070827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4e7c2-7ba8-4097-9517-8d11c0ffc936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d735e0a4cb0149828d89062f16079536)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:48.075830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4e7c2-7ba8-4097-9517-8d11c0ffc936 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:48.183187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436b1b1-db0e-44d3-ab48-f7fdb507e5b2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:48.192678 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9211282-08e1-499d-b0ab-899875cbfd8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:48.193681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9211282-08e1-499d-b0ab-899875cbfd8c service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:48.194026 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9211282-08e1-499d-b0ab-899875cbfd8c service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:48.194372 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9211282-08e1-499d-b0ab-899875cbfd8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:48.207316 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9211282-08e1-499d-b0ab-899875cbfd8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:48.208708 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9211282-08e1-499d-b0ab-899875cbfd8c service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:48.224340 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 891/1792] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:48.274683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9211282-08e1-499d-b0ab-899875cbfd8c service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:48.310842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9211282-08e1-499d-b0ab-899875cbfd8c service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:48.328699 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c9e82-653f-4332-9509-571fed35c1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:48.330363 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c9e82-653f-4332-9509-571fed35c1b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:48.331419 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c9e82-653f-4332-9509-571fed35c1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:48.332180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c9e82-653f-4332-9509-571fed35c1b1 admin admin] PATH_INFO: `/v3/users/d58652101c0949468dd2843c2e15e337` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:48.350200 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c9e82-653f-4332-9509-571fed35c1b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d58652101c0949468dd2843c2e15e337)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:48.359445 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c9e82-653f-4332-9509-571fed35c1b1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:49.482498 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-447c9e82-653f-4332-9509-571fed35c1b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd58652101c0949468dd2843c2e15e337'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:49.511713 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-bac4e7c2-7ba8-4097-9517-8d11c0ffc936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd735e0a4cb0149828d89062f16079536', 'request_id': 'req-bac4e7c2-7ba8-4097-9517-8d11c0ffc936'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:49.526059 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-bac4e7c2-7ba8-4097-9517-8d11c0ffc936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd735e0a4cb0149828d89062f16079536', 'request_id': 'req-bac4e7c2-7ba8-4097-9517-8d11c0ffc936'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:49.640344 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-447c9e82-653f-4332-9509-571fed35c1b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd58652101c0949468dd2843c2e15e337'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:49.642338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-447c9e82-653f-4332-9509-571fed35c1b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd58652101c0949468dd2843c2e15e337'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:49.642338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-447c9e82-653f-4332-9509-571fed35c1b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd58652101c0949468dd2843c2e15e337'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:49.651452 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-447c9e82-653f-4332-9509-571fed35c1b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd58652101c0949468dd2843c2e15e337'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:49.694495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 892/1793] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:57:48 2022] DELETE /identity/v3/users/d58652101c0949468dd2843c2e15e337 => generated 0 bytes in 1412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:49.695588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c9e82-653f-4332-9509-571fed35c1b1 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:49.698014 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-447c9e82-653f-4332-9509-571fed35c1b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:49.734760 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-bac4e7c2-7ba8-4097-9517-8d11c0ffc936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd735e0a4cb0149828d89062f16079536', 'request_id': 'req-bac4e7c2-7ba8-4097-9517-8d11c0ffc936'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:49.750993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-bac4e7c2-7ba8-4097-9517-8d11c0ffc936 admin admin] The token cache is being invalidate because project d735e0a4cb0149828d89062f16079536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:57:49.754916 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-bac4e7c2-7ba8-4097-9517-8d11c0ffc936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:49.754916 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-bac4e7c2-7ba8-4097-9517-8d11c0ffc936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:49.755352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 902/1794] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:57:47 2022] DELETE /identity/v3/projects/d735e0a4cb0149828d89062f16079536 => generated 0 bytes in 1949 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:57:49.759983 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4210ecf-2823-4605-aac1-ff25ad704117 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:49.760583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4210ecf-2823-4605-aac1-ff25ad704117 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:49.761082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4210ecf-2823-4605-aac1-ff25ad704117 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:49.765848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 903/1795] 10.222.0.30 () {54 vars in 921 bytes} [Tue Sep 6 22:57:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:57:49.768805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58b922-f402-4c5a-8102-c1a43ae59ce3 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:49.769085 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58b922-f402-4c5a-8102-c1a43ae59ce3 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:49.769358 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58b922-f402-4c5a-8102-c1a43ae59ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:49.820231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-cc58b922-f402-4c5a-8102-c1a43ae59ce3 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:49.825341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-cc58b922-f402-4c5a-8102-c1a43ae59ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:49.899185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c9e82-653f-4332-9509-571fed35c1b1 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:49.918994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84709fb-cf59-491d-a81e-bd43e0f613f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:49.922007 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84709fb-cf59-491d-a81e-bd43e0f613f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:49.922007 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84709fb-cf59-491d-a81e-bd43e0f613f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:49.922007 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84709fb-cf59-491d-a81e-bd43e0f613f1 admin admin] PATH_INFO: `/v3/projects/ae94f4407dd84cd39d1c8688e5a22a84` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:49.931945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84709fb-cf59-491d-a81e-bd43e0f613f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae94f4407dd84cd39d1c8688e5a22a84)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:49.931945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84709fb-cf59-491d-a81e-bd43e0f613f1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:49.996926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 904/1796] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:49.998796 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58b922-f402-4c5a-8102-c1a43ae59ce3 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:50.001621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-cc58b922-f402-4c5a-8102-c1a43ae59ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:50.030618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58b922-f402-4c5a-8102-c1a43ae59ce3 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:50.030618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d0979-8cb7-4684-9bbb-e641c2ca3782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:50.030618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d0979-8cb7-4684-9bbb-e641c2ca3782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:50.030618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d0979-8cb7-4684-9bbb-e641c2ca3782 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:50.030979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d0979-8cb7-4684-9bbb-e641c2ca3782 admin admin] PATH_INFO: `/v3/users/c22e8916521c48d39ca36711b963f1d1` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:50.030979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d0979-8cb7-4684-9bbb-e641c2ca3782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c22e8916521c48d39ca36711b963f1d1)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:50.030979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d0979-8cb7-4684-9bbb-e641c2ca3782 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:50.153568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f84709fb-cf59-491d-a81e-bd43e0f613f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae94f4407dd84cd39d1c8688e5a22a84', 'request_id': 'req-f84709fb-cf59-491d-a81e-bd43e0f613f1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:50.165078 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f84709fb-cf59-491d-a81e-bd43e0f613f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae94f4407dd84cd39d1c8688e5a22a84', 'request_id': 'req-f84709fb-cf59-491d-a81e-bd43e0f613f1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:50.216816 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-525d0979-8cb7-4684-9bbb-e641c2ca3782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c22e8916521c48d39ca36711b963f1d1'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:50.220737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f84709fb-cf59-491d-a81e-bd43e0f613f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae94f4407dd84cd39d1c8688e5a22a84', 'request_id': 'req-f84709fb-cf59-491d-a81e-bd43e0f613f1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:50.283979 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f84709fb-cf59-491d-a81e-bd43e0f613f1 admin admin] The token cache is being invalidate because project ae94f4407dd84cd39d1c8688e5a22a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:57:50.285386 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f84709fb-cf59-491d-a81e-bd43e0f613f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:50.290523 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:50.293042 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f84709fb-cf59-491d-a81e-bd43e0f613f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:50.299288 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 893/1797] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:57:49 2022] DELETE /identity/v3/projects/ae94f4407dd84cd39d1c8688e5a22a84 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:50.300266 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcd71d-5b19-4481-99d9-1af05006ced9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:50.301981 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcd71d-5b19-4481-99d9-1af05006ced9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:50.302547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcd71d-5b19-4481-99d9-1af05006ced9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:50.353505 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d9dcd71d-5b19-4481-99d9-1af05006ced9 None None] MFA Rules not processed for user `b18fd296138349408613004929144e70`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:50.355862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d9dcd71d-5b19-4481-99d9-1af05006ced9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:50.364721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-525d0979-8cb7-4684-9bbb-e641c2ca3782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c22e8916521c48d39ca36711b963f1d1'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:50.365995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-525d0979-8cb7-4684-9bbb-e641c2ca3782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c22e8916521c48d39ca36711b963f1d1'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:50.368337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:50.391912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-525d0979-8cb7-4684-9bbb-e641c2ca3782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c22e8916521c48d39ca36711b963f1d1'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:50.407339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-525d0979-8cb7-4684-9bbb-e641c2ca3782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c22e8916521c48d39ca36711b963f1d1'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:50.459152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 905/1798] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:57:49 2022] DELETE /identity/v3/users/c22e8916521c48d39ca36711b963f1d1 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:50.464251 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d0979-8cb7-4684-9bbb-e641c2ca3782 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:50.483270 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-525d0979-8cb7-4684-9bbb-e641c2ca3782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:50.523949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 894/1799] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Sep 6 22:57:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:50.526037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0622ed-0ee8-4937-91d2-ea94525fb5b7 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:50.531956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0622ed-0ee8-4937-91d2-ea94525fb5b7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:50.531956 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0622ed-0ee8-4937-91d2-ea94525fb5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:50.548707 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3e0622ed-0ee8-4937-91d2-ea94525fb5b7 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:50.554990 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3e0622ed-0ee8-4937-91d2-ea94525fb5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:50.631907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 895/1800] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:50.640157 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc738860-edb8-42ae-992f-394a1debf93a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:50.640697 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc738860-edb8-42ae-992f-394a1debf93a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:50.641143 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc738860-edb8-42ae-992f-394a1debf93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:50.655629 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d0979-8cb7-4684-9bbb-e641c2ca3782 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:50.660402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6796120-1a8c-462b-82d3-40bcb4e47e3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:50.662703 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6796120-1a8c-462b-82d3-40bcb4e47e3c service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:50.663094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6796120-1a8c-462b-82d3-40bcb4e47e3c service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:50.663732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6796120-1a8c-462b-82d3-40bcb4e47e3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:50.667598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e6796120-1a8c-462b-82d3-40bcb4e47e3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:50.688717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6796120-1a8c-462b-82d3-40bcb4e47e3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:50.691994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-fc738860-edb8-42ae-992f-394a1debf93a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:50.692157 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fc738860-edb8-42ae-992f-394a1debf93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:50.695243 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6796120-1a8c-462b-82d3-40bcb4e47e3c service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:50.704048 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 896/1801] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:50.708081 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc738860-edb8-42ae-992f-394a1debf93a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:50.710411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 906/1802] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:50.730112 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc738860-edb8-42ae-992f-394a1debf93a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:50.806473 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09764afd-7004-4426-8fde-2d024f60e214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:50.807704 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09764afd-7004-4426-8fde-2d024f60e214 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:50.807704 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09764afd-7004-4426-8fde-2d024f60e214 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:50.807704 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09764afd-7004-4426-8fde-2d024f60e214 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:50.809018 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09764afd-7004-4426-8fde-2d024f60e214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:57:50.809391 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09764afd-7004-4426-8fde-2d024f60e214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:50.837034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09764afd-7004-4426-8fde-2d024f60e214 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:50.865737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 897/1803] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:57:50.867428 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6796120-1a8c-462b-82d3-40bcb4e47e3c service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:50.885938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6796120-1a8c-462b-82d3-40bcb4e47e3c service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:50.912489 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e00d9-f34a-4124-87bb-c95294497a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:50.915927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e00d9-f34a-4124-87bb-c95294497a60 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:50.919158 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e00d9-f34a-4124-87bb-c95294497a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:50.919158 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e00d9-f34a-4124-87bb-c95294497a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:50.919158 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e00d9-f34a-4124-87bb-c95294497a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:50.923845 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e00d9-f34a-4124-87bb-c95294497a60 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:51.060936 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 907/1804] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:50 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:51.066699 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09764afd-7004-4426-8fde-2d024f60e214 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:51.085690 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09764afd-7004-4426-8fde-2d024f60e214 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:51.162776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ee640-4af9-4fa0-bec5-fe91d942f85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:51.163941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ee640-4af9-4fa0-bec5-fe91d942f85b admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:51.164375 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ee640-4af9-4fa0-bec5-fe91d942f85b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:51.164871 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ee640-4af9-4fa0-bec5-fe91d942f85b admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:51.165670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ee640-4af9-4fa0-bec5-fe91d942f85b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:51.168442 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ee640-4af9-4fa0-bec5-fe91d942f85b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:51.285701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e00d9-f34a-4124-87bb-c95294497a60 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:51.288124 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-182e00d9-f34a-4124-87bb-c95294497a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:51.304815 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:51.307063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 898/1805] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:51 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:51.311413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ee640-4af9-4fa0-bec5-fe91d942f85b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:51.331332 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ee640-4af9-4fa0-bec5-fe91d942f85b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:51.337096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b90498-f478-4154-970b-67450c13ae68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:51.338148 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b90498-f478-4154-970b-67450c13ae68 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:51.338629 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b90498-f478-4154-970b-67450c13ae68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:51.340345 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b90498-f478-4154-970b-67450c13ae68 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:51.341225 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b90498-f478-4154-970b-67450c13ae68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:51.343353 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b90498-f478-4154-970b-67450c13ae68 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:51.357894 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 899/1806] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:51.361881 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b90498-f478-4154-970b-67450c13ae68 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:51.374989 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b90498-f478-4154-970b-67450c13ae68 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:51.383256 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390eaef-a3fe-4560-b005-78026c62482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:51.383256 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390eaef-a3fe-4560-b005-78026c62482f admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:51.383256 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390eaef-a3fe-4560-b005-78026c62482f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:51.383544 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390eaef-a3fe-4560-b005-78026c62482f admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:51.384055 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390eaef-a3fe-4560-b005-78026c62482f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:51.386718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390eaef-a3fe-4560-b005-78026c62482f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:51.402460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 900/1807] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:57:51.407206 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390eaef-a3fe-4560-b005-78026c62482f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:51.425954 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390eaef-a3fe-4560-b005-78026c62482f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:51.434112 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f8d94-9bc8-4a87-b225-ce2b11f49325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:51.435370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f8d94-9bc8-4a87-b225-ce2b11f49325 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:51.435805 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f8d94-9bc8-4a87-b225-ce2b11f49325 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:51.436218 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f8d94-9bc8-4a87-b225-ce2b11f49325 admin admin] PATH_INFO: `/v3/projects/9e56716e81044be5ab8524a8339524ea/users/6b6439b7d70a447ea23f5ab575360414/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:51.461133 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f8d94-9bc8-4a87-b225-ce2b11f49325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e56716e81044be5ab8524a8339524ea, user_id=6b6439b7d70a447ea23f5ab575360414, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:51.468959 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f8d94-9bc8-4a87-b225-ce2b11f49325 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:51.485400 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e00d9-f34a-4124-87bb-c95294497a60 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:51.496771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7a05b-0cac-41b6-9069-b49b8e33088d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:51.496771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7a05b-0cac-41b6-9069-b49b8e33088d service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:51.496771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7a05b-0cac-41b6-9069-b49b8e33088d service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:51.496771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7a05b-0cac-41b6-9069-b49b8e33088d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:51.509634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7a05b-0cac-41b6-9069-b49b8e33088d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:51.513475 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7a05b-0cac-41b6-9069-b49b8e33088d service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:51.531760 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 908/1808] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:57:51.578625 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 901/1809] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:51 2022] PUT /identity/v3/projects/9e56716e81044be5ab8524a8339524ea/users/6b6439b7d70a447ea23f5ab575360414/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:51.589242 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf2507-75ae-4b37-a581-5cd7debbaf72 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:51.596140 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf2507-75ae-4b37-a581-5cd7debbaf72 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:51.596140 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf2507-75ae-4b37-a581-5cd7debbaf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:51.643472 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-7aaf2507-75ae-4b37-a581-5cd7debbaf72 None None] MFA Rules not processed for user `6b6439b7d70a447ea23f5ab575360414`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:51.645403 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7aaf2507-75ae-4b37-a581-5cd7debbaf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:51.706271 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f8d94-9bc8-4a87-b225-ce2b11f49325 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:51.706271 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c23f8d94-9bc8-4a87-b225-ce2b11f49325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:51.719083 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 909/1810] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:51.724222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf2507-75ae-4b37-a581-5cd7debbaf72 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:51.794887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f8d94-9bc8-4a87-b225-ce2b11f49325 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:51.800643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15eb43d-6036-49fd-b566-4f6386e95c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:51.802505 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15eb43d-6036-49fd-b566-4f6386e95c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:51.802896 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15eb43d-6036-49fd-b566-4f6386e95c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:51.803279 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15eb43d-6036-49fd-b566-4f6386e95c11 admin admin] PATH_INFO: `/v3/projects/4530498ce7b34ebd8834f5c9932e254d` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:51.804624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15eb43d-6036-49fd-b566-4f6386e95c11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4530498ce7b34ebd8834f5c9932e254d)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:51.806929 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15eb43d-6036-49fd-b566-4f6386e95c11 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:51.808882 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf2507-75ae-4b37-a581-5cd7debbaf72 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:51.813621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d5d32-1d25-4c9b-80e6-6577db010fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:51.814252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d5d32-1d25-4c9b-80e6-6577db010fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:51.814520 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d5d32-1d25-4c9b-80e6-6577db010fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:51.814792 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d5d32-1d25-4c9b-80e6-6577db010fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:51.816453 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d5d32-1d25-4c9b-80e6-6577db010fd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:51.817376 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d5d32-1d25-4c9b-80e6-6577db010fd3 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:51.910570 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 910/1811] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:51 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:57:51.910570 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d5d32-1d25-4c9b-80e6-6577db010fd3 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:51.914128 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-cd2d5d32-1d25-4c9b-80e6-6577db010fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:51.960048 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f15eb43d-6036-49fd-b566-4f6386e95c11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4530498ce7b34ebd8834f5c9932e254d', 'request_id': 'req-f15eb43d-6036-49fd-b566-4f6386e95c11'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:51.970604 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f15eb43d-6036-49fd-b566-4f6386e95c11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4530498ce7b34ebd8834f5c9932e254d', 'request_id': 'req-f15eb43d-6036-49fd-b566-4f6386e95c11'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:51.998292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d5d32-1d25-4c9b-80e6-6577db010fd3 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:52.024885 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f15eb43d-6036-49fd-b566-4f6386e95c11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4530498ce7b34ebd8834f5c9932e254d', 'request_id': 'req-f15eb43d-6036-49fd-b566-4f6386e95c11'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:52.037727 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f15eb43d-6036-49fd-b566-4f6386e95c11 admin admin] The token cache is being invalidate because project 4530498ce7b34ebd8834f5c9932e254d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:57:52.038098 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f15eb43d-6036-49fd-b566-4f6386e95c11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:52.038846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f15eb43d-6036-49fd-b566-4f6386e95c11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:52.040719 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 902/1812] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:57:51 2022] DELETE /identity/v3/projects/4530498ce7b34ebd8834f5c9932e254d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:57:52.041372 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15eb43d-6036-49fd-b566-4f6386e95c11 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:52.042759 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f15eb43d-6036-49fd-b566-4f6386e95c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:52.071562 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185a30f-2b0d-4724-8da8-ddfd05b84655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:52.072248 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185a30f-2b0d-4724-8da8-ddfd05b84655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:52.072866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185a30f-2b0d-4724-8da8-ddfd05b84655 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:52.072866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185a30f-2b0d-4724-8da8-ddfd05b84655 admin admin] PATH_INFO: `/v3/projects/32aa6a20e5794815839e7354a344a60b` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:52.075009 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185a30f-2b0d-4724-8da8-ddfd05b84655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32aa6a20e5794815839e7354a344a60b)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:52.077116 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185a30f-2b0d-4724-8da8-ddfd05b84655 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:52.112812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15eb43d-6036-49fd-b566-4f6386e95c11 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:52.117642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2821c-096e-4320-9a2d-9fb76c82c63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:52.118254 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2821c-096e-4320-9a2d-9fb76c82c63d admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:52.118534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2821c-096e-4320-9a2d-9fb76c82c63d admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:52.118807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2821c-096e-4320-9a2d-9fb76c82c63d admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:52.119494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2821c-096e-4320-9a2d-9fb76c82c63d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:52.122006 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2821c-096e-4320-9a2d-9fb76c82c63d admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:52.186601 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0185a30f-2b0d-4724-8da8-ddfd05b84655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32aa6a20e5794815839e7354a344a60b', 'request_id': 'req-0185a30f-2b0d-4724-8da8-ddfd05b84655'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:52.192799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0185a30f-2b0d-4724-8da8-ddfd05b84655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32aa6a20e5794815839e7354a344a60b', 'request_id': 'req-0185a30f-2b0d-4724-8da8-ddfd05b84655'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:52.237878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 903/1813] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:52 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:52.243051 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f63f2-1044-4410-8c9e-c184ec51a43f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:52.243398 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f63f2-1044-4410-8c9e-c184ec51a43f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:52.243680 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f63f2-1044-4410-8c9e-c184ec51a43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:52.271179 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c98f63f2-1044-4410-8c9e-c184ec51a43f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:52.272393 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c98f63f2-1044-4410-8c9e-c184ec51a43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:52.277294 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:52.322950 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0185a30f-2b0d-4724-8da8-ddfd05b84655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32aa6a20e5794815839e7354a344a60b', 'request_id': 'req-0185a30f-2b0d-4724-8da8-ddfd05b84655'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:52.340246 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0185a30f-2b0d-4724-8da8-ddfd05b84655 admin admin] The token cache is being invalidate because project 32aa6a20e5794815839e7354a344a60b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:57:52.340581 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0185a30f-2b0d-4724-8da8-ddfd05b84655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:52.341595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0185a30f-2b0d-4724-8da8-ddfd05b84655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:52.344463 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 911/1814] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:57:51 2022] DELETE /identity/v3/projects/32aa6a20e5794815839e7354a344a60b => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:52.345484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185a30f-2b0d-4724-8da8-ddfd05b84655 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:52.350391 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0185a30f-2b0d-4724-8da8-ddfd05b84655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:52.360466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 904/1815] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:52.361616 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f63f2-1044-4410-8c9e-c184ec51a43f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:52.363096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c98f63f2-1044-4410-8c9e-c184ec51a43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:52.374323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185a30f-2b0d-4724-8da8-ddfd05b84655 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:52.376935 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f63f2-1044-4410-8c9e-c184ec51a43f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:52.382427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf30dfa-3c53-438f-963e-81298c65f57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:52.383327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf30dfa-3c53-438f-963e-81298c65f57e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:52.383745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf30dfa-3c53-438f-963e-81298c65f57e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:52.384230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf30dfa-3c53-438f-963e-81298c65f57e admin admin] PATH_INFO: `/v3/users/c21d0739714a4f70be1a3e421d7a74e5` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:52.385589 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf30dfa-3c53-438f-963e-81298c65f57e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21d0739714a4f70be1a3e421d7a74e5)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:52.388081 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf30dfa-3c53-438f-963e-81298c65f57e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:52.397795 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b11a1-7cfd-4e95-bf53-5b56fbde1f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:52.406351 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b11a1-7cfd-4e95-bf53-5b56fbde1f74 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:52.406351 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b11a1-7cfd-4e95-bf53-5b56fbde1f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:52.406351 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b11a1-7cfd-4e95-bf53-5b56fbde1f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:52.406351 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b11a1-7cfd-4e95-bf53-5b56fbde1f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:52.406351 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b11a1-7cfd-4e95-bf53-5b56fbde1f74 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:52.413697 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 912/1816] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:52.419427 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac60cef-8df5-4a27-9573-91b2b1c6f824 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:52.419897 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac60cef-8df5-4a27-9573-91b2b1c6f824 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:52.420322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac60cef-8df5-4a27-9573-91b2b1c6f824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:52.442900 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-6ac60cef-8df5-4a27-9573-91b2b1c6f824 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:52.443831 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-6ac60cef-8df5-4a27-9573-91b2b1c6f824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:52.453505 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 913/1817] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:52.454815 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac60cef-8df5-4a27-9573-91b2b1c6f824 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:52.470513 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac60cef-8df5-4a27-9573-91b2b1c6f824 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:52.476286 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50745e-8e5f-4ab5-8bbe-458fca593601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:52.477047 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50745e-8e5f-4ab5-8bbe-458fca593601 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:52.477394 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50745e-8e5f-4ab5-8bbe-458fca593601 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:52.477740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50745e-8e5f-4ab5-8bbe-458fca593601 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:52.478475 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50745e-8e5f-4ab5-8bbe-458fca593601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:52.480685 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50745e-8e5f-4ab5-8bbe-458fca593601 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:52.492700 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 914/1818] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:52.493567 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50745e-8e5f-4ab5-8bbe-458fca593601 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:52.506516 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50745e-8e5f-4ab5-8bbe-458fca593601 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:52.511570 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0adf6-1330-4968-84a3-ab14008747f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:52.512216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0adf6-1330-4968-84a3-ab14008747f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:52.512696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0adf6-1330-4968-84a3-ab14008747f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:52.512969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0adf6-1330-4968-84a3-ab14008747f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:52.513764 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0adf6-1330-4968-84a3-ab14008747f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:57:52.514064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0adf6-1330-4968-84a3-ab14008747f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:52.516112 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0adf6-1330-4968-84a3-ab14008747f2 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:52.530027 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 915/1819] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:57:52.531075 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0adf6-1330-4968-84a3-ab14008747f2 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:52.543654 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0adf6-1330-4968-84a3-ab14008747f2 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:52.556062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e347c-a93a-4164-aa1f-4bfaee4ddcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:52.556062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e347c-a93a-4164-aa1f-4bfaee4ddcbe admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:52.556062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e347c-a93a-4164-aa1f-4bfaee4ddcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:52.556062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e347c-a93a-4164-aa1f-4bfaee4ddcbe admin admin] PATH_INFO: `/v3/projects/2e028afc3aff488cb993e0a4b53da2a7/users/ba63d207ad1041e7b0b4988e70eb2948/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:52.565411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e347c-a93a-4164-aa1f-4bfaee4ddcbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e028afc3aff488cb993e0a4b53da2a7, user_id=ba63d207ad1041e7b0b4988e70eb2948, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:52.568139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e347c-a93a-4164-aa1f-4bfaee4ddcbe admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:52.651113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-eaf30dfa-3c53-438f-963e-81298c65f57e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21d0739714a4f70be1a3e421d7a74e5'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:52.681982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 916/1820] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:52 2022] PUT /identity/v3/projects/2e028afc3aff488cb993e0a4b53da2a7/users/ba63d207ad1041e7b0b4988e70eb2948/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:52.682950 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e347c-a93a-4164-aa1f-4bfaee4ddcbe admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:52.695216 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-eaf30dfa-3c53-438f-963e-81298c65f57e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21d0739714a4f70be1a3e421d7a74e5'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:52.695940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-eaf30dfa-3c53-438f-963e-81298c65f57e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21d0739714a4f70be1a3e421d7a74e5'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:52.696634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-eaf30dfa-3c53-438f-963e-81298c65f57e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21d0739714a4f70be1a3e421d7a74e5'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:52.704728 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-eaf30dfa-3c53-438f-963e-81298c65f57e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21d0739714a4f70be1a3e421d7a74e5'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:52.726169 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 905/1821] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:57:52 2022] DELETE /identity/v3/users/c21d0739714a4f70be1a3e421d7a74e5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:52.731449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe851bb-2bea-477b-8476-d647630b7dbf None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:52.731950 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe851bb-2bea-477b-8476-d647630b7dbf None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:52.732071 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe851bb-2bea-477b-8476-d647630b7dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:52.781201 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ffe851bb-2bea-477b-8476-d647630b7dbf None None] MFA Rules not processed for user `ba63d207ad1041e7b0b4988e70eb2948`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:52.783052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ffe851bb-2bea-477b-8476-d647630b7dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:52.801072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e347c-a93a-4164-aa1f-4bfaee4ddcbe admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:52.866337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a131191-b29f-4cb2-9d3d-662223ae0d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:52.869144 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a131191-b29f-4cb2-9d3d-662223ae0d9b admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:52.869144 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a131191-b29f-4cb2-9d3d-662223ae0d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:52.869144 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a131191-b29f-4cb2-9d3d-662223ae0d9b admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:52.869144 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a131191-b29f-4cb2-9d3d-662223ae0d9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:52.871846 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a131191-b29f-4cb2-9d3d-662223ae0d9b admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:52.887887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 906/1822] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:52.889125 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe851bb-2bea-477b-8476-d647630b7dbf None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:52.890582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ffe851bb-2bea-477b-8476-d647630b7dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:52.908538 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe851bb-2bea-477b-8476-d647630b7dbf None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:52.913489 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0098a8-87e3-4eee-8500-cc3bddfb424b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:52.914108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0098a8-87e3-4eee-8500-cc3bddfb424b admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:52.914389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0098a8-87e3-4eee-8500-cc3bddfb424b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:52.914662 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0098a8-87e3-4eee-8500-cc3bddfb424b admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:52.915303 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0098a8-87e3-4eee-8500-cc3bddfb424b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:52.917266 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0098a8-87e3-4eee-8500-cc3bddfb424b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:53.028351 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 917/1823] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:52 2022] POST /identity/v3/projects => generated 383 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:53.034398 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a131191-b29f-4cb2-9d3d-662223ae0d9b admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:53.038956 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4a131191-b29f-4cb2-9d3d-662223ae0d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:53.052329 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 907/1824] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:52 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:53.054891 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0098a8-87e3-4eee-8500-cc3bddfb424b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:53.171714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0098a8-87e3-4eee-8500-cc3bddfb424b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:53.180089 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78dee4-2e23-4c37-89fe-10b81163dd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:53.180590 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78dee4-2e23-4c37-89fe-10b81163dd62 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:53.181030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78dee4-2e23-4c37-89fe-10b81163dd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:53.181313 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78dee4-2e23-4c37-89fe-10b81163dd62 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:53.182201 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d78dee4-2e23-4c37-89fe-10b81163dd62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:53.185957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d78dee4-2e23-4c37-89fe-10b81163dd62 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:53.200566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:53.203343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a131191-b29f-4cb2-9d3d-662223ae0d9b admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:53.213974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da63a2-55a2-4098-a885-fcecfeae96ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:53.215571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da63a2-55a2-4098-a885-fcecfeae96ac admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:53.217920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da63a2-55a2-4098-a885-fcecfeae96ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:53.217920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da63a2-55a2-4098-a885-fcecfeae96ac admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:53.217920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da63a2-55a2-4098-a885-fcecfeae96ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:53.220858 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da63a2-55a2-4098-a885-fcecfeae96ac admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:53.292140 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 908/1825] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:53 2022] POST /identity/v3/users => generated 295 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:53.293812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78dee4-2e23-4c37-89fe-10b81163dd62 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:53.304215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78dee4-2e23-4c37-89fe-10b81163dd62 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:53.310002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812a1b0-cd9e-49f8-b3f0-45f66e2f4fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:53.310736 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812a1b0-cd9e-49f8-b3f0-45f66e2f4fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:53.311022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812a1b0-cd9e-49f8-b3f0-45f66e2f4fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:53.311292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812a1b0-cd9e-49f8-b3f0-45f66e2f4fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:53.311944 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812a1b0-cd9e-49f8-b3f0-45f66e2f4fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:53.313888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812a1b0-cd9e-49f8-b3f0-45f66e2f4fa9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:53.321841 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 918/1826] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:53 2022] POST /identity/v3/users => generated 292 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:53.322867 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da63a2-55a2-4098-a885-fcecfeae96ac admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:53.329243 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 909/1827] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:53.330341 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812a1b0-cd9e-49f8-b3f0-45f66e2f4fa9 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:53.334643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da63a2-55a2-4098-a885-fcecfeae96ac admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:53.340581 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a31950-1e5f-46e1-8ba2-2729810f711e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:53.341530 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a31950-1e5f-46e1-8ba2-2729810f711e admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:53.342137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a31950-1e5f-46e1-8ba2-2729810f711e admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:53.342633 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a31950-1e5f-46e1-8ba2-2729810f711e admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:53.343225 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812a1b0-cd9e-49f8-b3f0-45f66e2f4fa9 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:53.343771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a31950-1e5f-46e1-8ba2-2729810f711e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:53.345720 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a31950-1e5f-46e1-8ba2-2729810f711e admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:53.349801 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ac07a-4ef7-4bf4-a372-5637a195c56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:53.351120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ac07a-4ef7-4bf4-a372-5637a195c56e admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:53.351631 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ac07a-4ef7-4bf4-a372-5637a195c56e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:53.351912 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ac07a-4ef7-4bf4-a372-5637a195c56e admin admin] PATH_INFO: `/v3/projects/467e86e2ca6d4a8888e95f87c334c6f6/users/f7423603f31d49fba159670cff190afc/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:53.364964 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 919/1828] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:53.366045 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a31950-1e5f-46e1-8ba2-2729810f711e admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:53.378395 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ac07a-4ef7-4bf4-a372-5637a195c56e admin admin] RBAC: Authorizing `identity:create_grant(project_id=467e86e2ca6d4a8888e95f87c334c6f6, user_id=f7423603f31d49fba159670cff190afc, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:53.379917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a31950-1e5f-46e1-8ba2-2729810f711e admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:53.382480 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ac07a-4ef7-4bf4-a372-5637a195c56e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:53.385723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2447912-ac77-4e8d-9ea8-a3886ae53cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:53.386563 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2447912-ac77-4e8d-9ea8-a3886ae53cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:53.386988 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2447912-ac77-4e8d-9ea8-a3886ae53cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:53.387605 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2447912-ac77-4e8d-9ea8-a3886ae53cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:53.388444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2447912-ac77-4e8d-9ea8-a3886ae53cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:53.390439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2447912-ac77-4e8d-9ea8-a3886ae53cc4 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:53.404582 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 920/1829] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:53.407903 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2447912-ac77-4e8d-9ea8-a3886ae53cc4 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:53.421287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2447912-ac77-4e8d-9ea8-a3886ae53cc4 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:53.427081 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa3022-58e7-4fd3-83e2-534775fac953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:53.427942 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa3022-58e7-4fd3-83e2-534775fac953 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:53.428565 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa3022-58e7-4fd3-83e2-534775fac953 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:53.428917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa3022-58e7-4fd3-83e2-534775fac953 admin admin] PATH_INFO: `/v3/projects/32685569fb0d459888cabc5eebdb4b5b/users/2b8783afce0a44d1872953cbd4bb1642/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:53.446430 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa3022-58e7-4fd3-83e2-534775fac953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32685569fb0d459888cabc5eebdb4b5b, user_id=2b8783afce0a44d1872953cbd4bb1642, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:53.449321 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 910/1830] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:53 2022] PUT /identity/v3/projects/467e86e2ca6d4a8888e95f87c334c6f6/users/f7423603f31d49fba159670cff190afc/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:53.452077 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa3022-58e7-4fd3-83e2-534775fac953 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:53.453519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ac07a-4ef7-4bf4-a372-5637a195c56e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:53.522721 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ac07a-4ef7-4bf4-a372-5637a195c56e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:53.529009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d269be1-6ed8-4f36-8c01-9e446b3bf89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:53.530145 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d269be1-6ed8-4f36-8c01-9e446b3bf89a admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:53.530428 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d269be1-6ed8-4f36-8c01-9e446b3bf89a admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:53.530699 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d269be1-6ed8-4f36-8c01-9e446b3bf89a admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:53.531345 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d269be1-6ed8-4f36-8c01-9e446b3bf89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:53.533391 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d269be1-6ed8-4f36-8c01-9e446b3bf89a admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:53.541650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 921/1831] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:53 2022] PUT /identity/v3/projects/32685569fb0d459888cabc5eebdb4b5b/users/2b8783afce0a44d1872953cbd4bb1642/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:53.548176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 911/1832] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:57:53.551962 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa3022-58e7-4fd3-83e2-534775fac953 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:53.552718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c159267-ff84-4e86-9530-dc0b3c571809 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:53.553071 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c159267-ff84-4e86-9530-dc0b3c571809 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:53.553439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c159267-ff84-4e86-9530-dc0b3c571809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:53.588489 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4c159267-ff84-4e86-9530-dc0b3c571809 None None] MFA Rules not processed for user `2b8783afce0a44d1872953cbd4bb1642`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:53.590776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4c159267-ff84-4e86-9530-dc0b3c571809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:53.624577 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:53.722031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa3022-58e7-4fd3-83e2-534775fac953 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:53.728524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e7ab6-a8a5-464c-b0c2-18be283ae0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:53.732026 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e7ab6-a8a5-464c-b0c2-18be283ae0cb admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:53.732554 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e7ab6-a8a5-464c-b0c2-18be283ae0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:53.736802 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e7ab6-a8a5-464c-b0c2-18be283ae0cb admin admin] PATH_INFO: `/v3/projects/467e86e2ca6d4a8888e95f87c334c6f6/users/f7423603f31d49fba159670cff190afc/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:53.736802 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e7ab6-a8a5-464c-b0c2-18be283ae0cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=467e86e2ca6d4a8888e95f87c334c6f6, user_id=f7423603f31d49fba159670cff190afc, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:53.739827 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 912/1833] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:57:53.740804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c159267-ff84-4e86-9530-dc0b3c571809 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:53.744019 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4c159267-ff84-4e86-9530-dc0b3c571809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:53.744287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e7ab6-a8a5-464c-b0c2-18be283ae0cb admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:53.761984 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c159267-ff84-4e86-9530-dc0b3c571809 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:53.765979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 922/1834] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:53 2022] PUT /identity/v3/projects/467e86e2ca6d4a8888e95f87c334c6f6/users/f7423603f31d49fba159670cff190afc/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:53.767505 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e7ab6-a8a5-464c-b0c2-18be283ae0cb admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:53.845366 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368abb4-a262-4085-bcf9-a554a7295149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:53.846358 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368abb4-a262-4085-bcf9-a554a7295149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:53.846813 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368abb4-a262-4085-bcf9-a554a7295149 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:53.851635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368abb4-a262-4085-bcf9-a554a7295149 admin admin] PATH_INFO: `/v3/projects/644952babf204de9b83bbd322537dc6c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:53.851635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368abb4-a262-4085-bcf9-a554a7295149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=644952babf204de9b83bbd322537dc6c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:53.851635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368abb4-a262-4085-bcf9-a554a7295149 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:53.862366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e7ab6-a8a5-464c-b0c2-18be283ae0cb admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:53.867564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4fe7d-af03-464d-941d-59123cb6a408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:53.868183 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4fe7d-af03-464d-941d-59123cb6a408 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:53.868490 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4fe7d-af03-464d-941d-59123cb6a408 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:53.869131 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4fe7d-af03-464d-941d-59123cb6a408 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:53.869928 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4fe7d-af03-464d-941d-59123cb6a408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:53.874708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4fe7d-af03-464d-941d-59123cb6a408 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:53.973118 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0368abb4-a262-4085-bcf9-a554a7295149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '644952babf204de9b83bbd322537dc6c', 'request_id': 'req-0368abb4-a262-4085-bcf9-a554a7295149'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:53.980888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0368abb4-a262-4085-bcf9-a554a7295149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '644952babf204de9b83bbd322537dc6c', 'request_id': 'req-0368abb4-a262-4085-bcf9-a554a7295149'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:53.996574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 923/1835] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:53 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:53.996574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b36093-0a2d-419b-a21e-76a2e49303c2 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:53.996574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b36093-0a2d-419b-a21e-76a2e49303c2 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:53.996574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b36093-0a2d-419b-a21e-76a2e49303c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:54.025487 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-27b36093-0a2d-419b-a21e-76a2e49303c2 None None] MFA Rules not processed for user `f7423603f31d49fba159670cff190afc`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:54.026815 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-27b36093-0a2d-419b-a21e-76a2e49303c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:54.082294 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0368abb4-a262-4085-bcf9-a554a7295149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '644952babf204de9b83bbd322537dc6c', 'request_id': 'req-0368abb4-a262-4085-bcf9-a554a7295149'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:54.109016 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0368abb4-a262-4085-bcf9-a554a7295149 admin admin] The token cache is being invalidate because project 644952babf204de9b83bbd322537dc6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:57:54.109226 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0368abb4-a262-4085-bcf9-a554a7295149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:54.110129 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-0368abb4-a262-4085-bcf9-a554a7295149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:54.111860 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 913/1836] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:57:53 2022] DELETE /identity/v3/projects/644952babf204de9b83bbd322537dc6c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:54.115323 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368abb4-a262-4085-bcf9-a554a7295149 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:54.115323 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0368abb4-a262-4085-bcf9-a554a7295149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:54.126982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 924/1837] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:54.129536 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cd355-d4be-4091-a13a-e92f4c117c5b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:54.129948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cd355-d4be-4091-a13a-e92f4c117c5b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:54.130242 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cd355-d4be-4091-a13a-e92f4c117c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:54.155646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-8f6cd355-d4be-4091-a13a-e92f4c117c5b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:54.157037 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-8f6cd355-d4be-4091-a13a-e92f4c117c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:54.198183 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368abb4-a262-4085-bcf9-a554a7295149 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:54.224320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 925/1838] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:54.225322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cd355-d4be-4091-a13a-e92f4c117c5b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:54.226688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-8f6cd355-d4be-4091-a13a-e92f4c117c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:54.261348 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e10565-518d-427a-8502-65b7c97ee774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:54.261983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e10565-518d-427a-8502-65b7c97ee774 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:54.262268 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e10565-518d-427a-8502-65b7c97ee774 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:54.262546 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e10565-518d-427a-8502-65b7c97ee774 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:54.263187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e10565-518d-427a-8502-65b7c97ee774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:54.265289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e10565-518d-427a-8502-65b7c97ee774 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:54.293317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cd355-d4be-4091-a13a-e92f4c117c5b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:54.298258 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f070aa1-9ea5-49cb-a14b-325c000a9b9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:54.298886 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f070aa1-9ea5-49cb-a14b-325c000a9b9e service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:54.299161 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f070aa1-9ea5-49cb-a14b-325c000a9b9e service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:54.299429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f070aa1-9ea5-49cb-a14b-325c000a9b9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:54.301166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-8f070aa1-9ea5-49cb-a14b-325c000a9b9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:54.349319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 914/1839] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:54 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:54.349319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3b9c5-d827-4a71-9f72-59d7cb0c3264 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:54.349319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3b9c5-d827-4a71-9f72-59d7cb0c3264 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:54.349319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3b9c5-d827-4a71-9f72-59d7cb0c3264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:54.372825 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b5f3b9c5-d827-4a71-9f72-59d7cb0c3264 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:54.374052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b5f3b9c5-d827-4a71-9f72-59d7cb0c3264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:54.375178 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f070aa1-9ea5-49cb-a14b-325c000a9b9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:54.376971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f070aa1-9ea5-49cb-a14b-325c000a9b9e service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:54.383588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 915/1840] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:54.384389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3b9c5-d827-4a71-9f72-59d7cb0c3264 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:54.391658 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 926/1841] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:54.392452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f070aa1-9ea5-49cb-a14b-325c000a9b9e service cinder] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:54.394790 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3b9c5-d827-4a71-9f72-59d7cb0c3264 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:54.400234 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d020d8-0fe5-4c8b-a86c-e484491b8556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:54.401400 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d020d8-0fe5-4c8b-a86c-e484491b8556 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:54.401578 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d020d8-0fe5-4c8b-a86c-e484491b8556 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:54.419795 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d020d8-0fe5-4c8b-a86c-e484491b8556 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:54.419795 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d020d8-0fe5-4c8b-a86c-e484491b8556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:54.419795 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d020d8-0fe5-4c8b-a86c-e484491b8556 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:54.420710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f070aa1-9ea5-49cb-a14b-325c000a9b9e service cinder] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:54.420710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48970068-8d57-44e4-ac35-4b7f9228e708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:54.420710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48970068-8d57-44e4-ac35-4b7f9228e708 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:54.420710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48970068-8d57-44e4-ac35-4b7f9228e708 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:54.421127 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48970068-8d57-44e4-ac35-4b7f9228e708 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:54.421127 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48970068-8d57-44e4-ac35-4b7f9228e708 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:57:54.421127 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48970068-8d57-44e4-ac35-4b7f9228e708 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:54.421127 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48970068-8d57-44e4-ac35-4b7f9228e708 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:54.421374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 916/1842] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:54.422627 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d020d8-0fe5-4c8b-a86c-e484491b8556 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:54.431489 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:54.432149 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 927/1843] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:57:54.436142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d020d8-0fe5-4c8b-a86c-e484491b8556 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:54.437655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48970068-8d57-44e4-ac35-4b7f9228e708 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:54.445180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace89862-59d8-41b3-9a06-a2faf138c8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:54.446014 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace89862-59d8-41b3-9a06-a2faf138c8b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:54.446378 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace89862-59d8-41b3-9a06-a2faf138c8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:54.448531 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace89862-59d8-41b3-9a06-a2faf138c8b6 admin admin] PATH_INFO: `/v3/projects/ccb8ae7ebd244b9eb5032f7d5256e62d/users/e38a7357eb8f47159bed5940e3362004/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:54.451570 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48970068-8d57-44e4-ac35-4b7f9228e708 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:54.456799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3987fc3-f0dd-494a-8b61-28518d0b7dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:54.457494 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3987fc3-f0dd-494a-8b61-28518d0b7dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:54.457961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3987fc3-f0dd-494a-8b61-28518d0b7dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:54.458152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3987fc3-f0dd-494a-8b61-28518d0b7dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:54.458879 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3987fc3-f0dd-494a-8b61-28518d0b7dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:54.461000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3987fc3-f0dd-494a-8b61-28518d0b7dd3 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:54.463765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace89862-59d8-41b3-9a06-a2faf138c8b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb8ae7ebd244b9eb5032f7d5256e62d, user_id=e38a7357eb8f47159bed5940e3362004, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:54.467236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace89862-59d8-41b3-9a06-a2faf138c8b6 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:54.477079 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:54.522094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 917/1844] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:54 2022] PUT /identity/v3/projects/ccb8ae7ebd244b9eb5032f7d5256e62d/users/e38a7357eb8f47159bed5940e3362004/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:57:54.526170 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace89862-59d8-41b3-9a06-a2faf138c8b6 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:54.566956 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 928/1845] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:54 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:54.568598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3987fc3-f0dd-494a-8b61-28518d0b7dd3 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:54.589141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace89862-59d8-41b3-9a06-a2faf138c8b6 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:54.630644 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3987fc3-f0dd-494a-8b61-28518d0b7dd3 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:54.635448 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cd8d7-e6bf-4f38-b206-58de3ee7b652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:54.636751 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cd8d7-e6bf-4f38-b206-58de3ee7b652 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:54.637034 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cd8d7-e6bf-4f38-b206-58de3ee7b652 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:54.637306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cd8d7-e6bf-4f38-b206-58de3ee7b652 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:54.637941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cd8d7-e6bf-4f38-b206-58de3ee7b652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:54.639913 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cd8d7-e6bf-4f38-b206-58de3ee7b652 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:54.647202 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8686d14-e4ee-4a80-85b8-b4ec4bd9de18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:54.647846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8686d14-e4ee-4a80-85b8-b4ec4bd9de18 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:54.648161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8686d14-e4ee-4a80-85b8-b4ec4bd9de18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:54.648461 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8686d14-e4ee-4a80-85b8-b4ec4bd9de18 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:54.649102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8686d14-e4ee-4a80-85b8-b4ec4bd9de18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:54.650685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8686d14-e4ee-4a80-85b8-b4ec4bd9de18 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:54.661306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 918/1846] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:57:54.665558 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8686d14-e4ee-4a80-85b8-b4ec4bd9de18 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:54.674952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8686d14-e4ee-4a80-85b8-b4ec4bd9de18 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:54.679489 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d764c3-addc-4694-8171-4ed8f9aab144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:54.680158 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d764c3-addc-4694-8171-4ed8f9aab144 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:54.680448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d764c3-addc-4694-8171-4ed8f9aab144 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:54.680735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d764c3-addc-4694-8171-4ed8f9aab144 admin admin] PATH_INFO: `/v3/projects/ccb8ae7ebd244b9eb5032f7d5256e62d/users/e38a7357eb8f47159bed5940e3362004/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:54.682618 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d764c3-addc-4694-8171-4ed8f9aab144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb8ae7ebd244b9eb5032f7d5256e62d, user_id=e38a7357eb8f47159bed5940e3362004, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:54.685367 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d764c3-addc-4694-8171-4ed8f9aab144 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:54.695673 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 919/1847] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:54 2022] PUT /identity/v3/projects/ccb8ae7ebd244b9eb5032f7d5256e62d/users/e38a7357eb8f47159bed5940e3362004/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:57:54.710141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b8d5b-96be-4dc8-97d5-6e05cad01f20 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:54.710351 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b8d5b-96be-4dc8-97d5-6e05cad01f20 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:54.710627 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b8d5b-96be-4dc8-97d5-6e05cad01f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:54.740102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a24b8d5b-96be-4dc8-97d5-6e05cad01f20 None None] MFA Rules not processed for user `e38a7357eb8f47159bed5940e3362004`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:54.741327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a24b8d5b-96be-4dc8-97d5-6e05cad01f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:54.753189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 929/1848] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:54 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:57:54.757055 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cd8d7-e6bf-4f38-b206-58de3ee7b652 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:54.767740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cd8d7-e6bf-4f38-b206-58de3ee7b652 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:54.824856 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 920/1849] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:54.835989 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213f715-b54b-49dc-90aa-2d2919419fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:54.836474 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b8d5b-96be-4dc8-97d5-6e05cad01f20 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:54.836652 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213f715-b54b-49dc-90aa-2d2919419fdf admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:54.836936 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213f715-b54b-49dc-90aa-2d2919419fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:54.837212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213f715-b54b-49dc-90aa-2d2919419fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:54.837871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213f715-b54b-49dc-90aa-2d2919419fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:54.838073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a24b8d5b-96be-4dc8-97d5-6e05cad01f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:54.840173 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213f715-b54b-49dc-90aa-2d2919419fdf admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:54.851766 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 930/1850] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:54.855773 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213f715-b54b-49dc-90aa-2d2919419fdf admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:54.865870 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213f715-b54b-49dc-90aa-2d2919419fdf admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:54.870830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4b97c-b9ee-4404-b5c8-3ec769239dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:54.876076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4b97c-b9ee-4404-b5c8-3ec769239dcb admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:54.876076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4b97c-b9ee-4404-b5c8-3ec769239dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:54.876076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4b97c-b9ee-4404-b5c8-3ec769239dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:54.876076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4b97c-b9ee-4404-b5c8-3ec769239dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:54.876076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4b97c-b9ee-4404-b5c8-3ec769239dcb admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:54.886446 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 931/1851] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:57:54.890448 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4b97c-b9ee-4404-b5c8-3ec769239dcb admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:54.896960 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b8d5b-96be-4dc8-97d5-6e05cad01f20 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:54.900337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4b97c-b9ee-4404-b5c8-3ec769239dcb admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:54.901088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1e5d0-463c-4166-9065-aab87d705371 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:54.902329 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1e5d0-463c-4166-9065-aab87d705371 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:54.904787 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1e5d0-463c-4166-9065-aab87d705371 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:54.904787 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1e5d0-463c-4166-9065-aab87d705371 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:54.910501 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8042f-9383-4e46-bdc0-fa1e39add38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:54.911634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8042f-9383-4e46-bdc0-fa1e39add38f admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:54.911906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8042f-9383-4e46-bdc0-fa1e39add38f admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:54.912179 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8042f-9383-4e46-bdc0-fa1e39add38f admin admin] PATH_INFO: `/v3/projects/a1773bdc785b4c57a82147795a51fb4c/users/0304cb712371467e83c3a5adcc8d9616/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:54.912287 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1e5d0-463c-4166-9065-aab87d705371 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:54.913719 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1e5d0-463c-4166-9065-aab87d705371 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:54.924030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 921/1852] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:54.937709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8042f-9383-4e46-bdc0-fa1e39add38f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1773bdc785b4c57a82147795a51fb4c, user_id=0304cb712371467e83c3a5adcc8d9616, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:54.940490 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8042f-9383-4e46-bdc0-fa1e39add38f admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:55.014634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 932/1853] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:54 2022] PUT /identity/v3/projects/a1773bdc785b4c57a82147795a51fb4c/users/0304cb712371467e83c3a5adcc8d9616/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:57:55.027696 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb2b54-571e-4055-87e1-887ddcb64f4e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:55.028152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb2b54-571e-4055-87e1-887ddcb64f4e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:55.028564 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb2b54-571e-4055-87e1-887ddcb64f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:55.048141 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8042f-9383-4e46-bdc0-fa1e39add38f admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:55.065945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9edb2b54-571e-4055-87e1-887ddcb64f4e None None] MFA Rules not processed for user `0304cb712371467e83c3a5adcc8d9616`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:55.065945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9edb2b54-571e-4055-87e1-887ddcb64f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:55.151417 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 922/1854] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:55.156447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb2b54-571e-4055-87e1-887ddcb64f4e None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:55.194898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8042f-9383-4e46-bdc0-fa1e39add38f admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:55.205321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898c906-709b-40d5-ad34-90b71fc97229 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:55.206205 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898c906-709b-40d5-ad34-90b71fc97229 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:55.206403 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898c906-709b-40d5-ad34-90b71fc97229 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:55.206681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898c906-709b-40d5-ad34-90b71fc97229 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:55.220985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1898c906-709b-40d5-ad34-90b71fc97229 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:55.250426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb2b54-571e-4055-87e1-887ddcb64f4e None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:55.255949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69783932-f83d-4583-83de-f6b3868f7332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:55.259881 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69783932-f83d-4583-83de-f6b3868f7332 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:55.259881 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69783932-f83d-4583-83de-f6b3868f7332 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:55.259881 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69783932-f83d-4583-83de-f6b3868f7332 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:55.259881 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69783932-f83d-4583-83de-f6b3868f7332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:55.261995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69783932-f83d-4583-83de-f6b3868f7332 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:55.294369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898c906-709b-40d5-ad34-90b71fc97229 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:55.295934 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898c906-709b-40d5-ad34-90b71fc97229 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:55.307259 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 933/1855] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:55.360170 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 923/1856] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:57:55 2022] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:57:55.364068 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898c906-709b-40d5-ad34-90b71fc97229 service cinder] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:55.378469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898c906-709b-40d5-ad34-90b71fc97229 service cinder] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:55.441294 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fe70a-d472-4d9b-8ccf-1a87c666915a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:55.441914 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fe70a-d472-4d9b-8ccf-1a87c666915a admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:55.442193 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fe70a-d472-4d9b-8ccf-1a87c666915a admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:55.442463 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fe70a-d472-4d9b-8ccf-1a87c666915a admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:55.443111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fe70a-d472-4d9b-8ccf-1a87c666915a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:55.445423 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fe70a-d472-4d9b-8ccf-1a87c666915a admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:55.493571 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:55.528008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 934/1857] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:57:55 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:57:55.531629 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69783932-f83d-4583-83de-f6b3868f7332 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:55.533778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:55.543632 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69783932-f83d-4583-83de-f6b3868f7332 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:55.548386 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e942f26-4ee1-49ef-b085-8f4fd0344866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:55.549033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e942f26-4ee1-49ef-b085-8f4fd0344866 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:55.549429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e942f26-4ee1-49ef-b085-8f4fd0344866 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:55.549735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e942f26-4ee1-49ef-b085-8f4fd0344866 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:55.550385 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e942f26-4ee1-49ef-b085-8f4fd0344866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:55.552227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e942f26-4ee1-49ef-b085-8f4fd0344866 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:55.563902 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 924/1858] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:55.568448 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fe70a-d472-4d9b-8ccf-1a87c666915a admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:55.579458 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fe70a-d472-4d9b-8ccf-1a87c666915a admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:55.584133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fbe2f-f273-4cca-b001-4a82863d5998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:55.584830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fbe2f-f273-4cca-b001-4a82863d5998 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:55.585110 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fbe2f-f273-4cca-b001-4a82863d5998 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:55.585383 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fbe2f-f273-4cca-b001-4a82863d5998 admin admin] PATH_INFO: `/v3/projects/ba1165739ca04066afd77f848fb8b2b4/users/528504d7d3a0467ab76e2e5f0c1b3e16/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:55.600583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fbe2f-f273-4cca-b001-4a82863d5998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1165739ca04066afd77f848fb8b2b4, user_id=528504d7d3a0467ab76e2e5f0c1b3e16, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:55.603274 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fbe2f-f273-4cca-b001-4a82863d5998 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:55.710735 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 935/1859] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:55 2022] PUT /identity/v3/projects/ba1165739ca04066afd77f848fb8b2b4/users/528504d7d3a0467ab76e2e5f0c1b3e16/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:55.715402 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e942f26-4ee1-49ef-b085-8f4fd0344866 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:55.725513 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e942f26-4ee1-49ef-b085-8f4fd0344866 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:55.783440 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8ae0d-6b7d-43bb-bddc-2e08c352f96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:55.784196 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8ae0d-6b7d-43bb-bddc-2e08c352f96a admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:55.784300 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8ae0d-6b7d-43bb-bddc-2e08c352f96a admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:55.784607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8ae0d-6b7d-43bb-bddc-2e08c352f96a admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:55.785246 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8ae0d-6b7d-43bb-bddc-2e08c352f96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:55.786889 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8ae0d-6b7d-43bb-bddc-2e08c352f96a admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:55.797180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 925/1860] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:57:55.801474 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fbe2f-f273-4cca-b001-4a82863d5998 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:55.812366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fbe2f-f273-4cca-b001-4a82863d5998 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:55.817045 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134d1e6-eb68-4a35-825b-67876e0317dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:55.817700 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134d1e6-eb68-4a35-825b-67876e0317dc admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:55.817984 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134d1e6-eb68-4a35-825b-67876e0317dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:55.818525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134d1e6-eb68-4a35-825b-67876e0317dc admin admin] PATH_INFO: `/v3/projects/ba1165739ca04066afd77f848fb8b2b4/users/528504d7d3a0467ab76e2e5f0c1b3e16/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:55.820459 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134d1e6-eb68-4a35-825b-67876e0317dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1165739ca04066afd77f848fb8b2b4, user_id=528504d7d3a0467ab76e2e5f0c1b3e16, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:55.823163 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134d1e6-eb68-4a35-825b-67876e0317dc admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:55.833541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 936/1861] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:57:55 2022] PUT /identity/v3/projects/ba1165739ca04066afd77f848fb8b2b4/users/528504d7d3a0467ab76e2e5f0c1b3e16/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:57:55.845246 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b8280-0a7a-4333-b267-30f752535752 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:55.845564 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b8280-0a7a-4333-b267-30f752535752 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:55.845897 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b8280-0a7a-4333-b267-30f752535752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:55.874559 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-629b8280-0a7a-4333-b267-30f752535752 None None] MFA Rules not processed for user `528504d7d3a0467ab76e2e5f0c1b3e16`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:55.875773 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-629b8280-0a7a-4333-b267-30f752535752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:55.951791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 926/1862] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:55.963724 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134d1e6-eb68-4a35-825b-67876e0317dc admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:56.048096 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134d1e6-eb68-4a35-825b-67876e0317dc admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:56.053685 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32e36c-f39b-4092-917d-5bf220cb4230 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:56.054755 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32e36c-f39b-4092-917d-5bf220cb4230 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:56.054755 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32e36c-f39b-4092-917d-5bf220cb4230 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:56.054942 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32e36c-f39b-4092-917d-5bf220cb4230 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:56.068574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32e36c-f39b-4092-917d-5bf220cb4230 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:56.072316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32e36c-f39b-4092-917d-5bf220cb4230 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:56.091585 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 937/1863] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:56.219472 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:56.305171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b8280-0a7a-4333-b267-30f752535752 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:56.314776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b8280-0a7a-4333-b267-30f752535752 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:56.318651 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962ba56-4780-42b3-8210-608409487cf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:56.319569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962ba56-4780-42b3-8210-608409487cf8 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:56.319890 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962ba56-4780-42b3-8210-608409487cf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:56.320254 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962ba56-4780-42b3-8210-608409487cf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:56.378587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962ba56-4780-42b3-8210-608409487cf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:56.380030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962ba56-4780-42b3-8210-608409487cf8 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:56.391973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 927/1864] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:56.738104 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32e36c-f39b-4092-917d-5bf220cb4230 service cinder] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:56.747485 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32e36c-f39b-4092-917d-5bf220cb4230 service cinder] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:56.752091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdbf64-3993-4ce6-9dee-8a53897b77c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:56.754559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdbf64-3993-4ce6-9dee-8a53897b77c0 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:56.754559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdbf64-3993-4ce6-9dee-8a53897b77c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:56.754559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdbf64-3993-4ce6-9dee-8a53897b77c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:56.755326 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0acdbf64-3993-4ce6-9dee-8a53897b77c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:56.808374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:56.822318 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdbf64-3993-4ce6-9dee-8a53897b77c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:56.824218 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdbf64-3993-4ce6-9dee-8a53897b77c0 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:56.836105 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 938/1865] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:57.206065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962ba56-4780-42b3-8210-608409487cf8 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:57.267732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962ba56-4780-42b3-8210-608409487cf8 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:57.272377 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5601-3ee3-4bc0-be78-0b4e620b52c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:57.273096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5601-3ee3-4bc0-be78-0b4e620b52c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:57.273377 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5601-3ee3-4bc0-be78-0b4e620b52c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:57.273677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5601-3ee3-4bc0-be78-0b4e620b52c9 admin admin] PATH_INFO: `/v3/users/0304cb712371467e83c3a5adcc8d9616` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:57.274828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac5601-3ee3-4bc0-be78-0b4e620b52c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0304cb712371467e83c3a5adcc8d9616)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:57.277321 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac5601-3ee3-4bc0-be78-0b4e620b52c9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:57.543102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-32ac5601-3ee3-4bc0-be78-0b4e620b52c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0304cb712371467e83c3a5adcc8d9616'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:57.636458 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-32ac5601-3ee3-4bc0-be78-0b4e620b52c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0304cb712371467e83c3a5adcc8d9616'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:57.637403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-32ac5601-3ee3-4bc0-be78-0b4e620b52c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0304cb712371467e83c3a5adcc8d9616'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:57.638128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-32ac5601-3ee3-4bc0-be78-0b4e620b52c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0304cb712371467e83c3a5adcc8d9616'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:57.659006 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-32ac5601-3ee3-4bc0-be78-0b4e620b52c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0304cb712371467e83c3a5adcc8d9616'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:57.695901 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 928/1866] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:57:57 2022] DELETE /identity/v3/users/0304cb712371467e83c3a5adcc8d9616 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:57.700756 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54978769-5bb0-4b7e-b50f-55896dbf4615 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:57.701236 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54978769-5bb0-4b7e-b50f-55896dbf4615 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:57.701356 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54978769-5bb0-4b7e-b50f-55896dbf4615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:57.731084 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-54978769-5bb0-4b7e-b50f-55896dbf4615 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:57.738483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-54978769-5bb0-4b7e-b50f-55896dbf4615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:57.776072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:57.852106 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 939/1867] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:57:57.863469 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5601-3ee3-4bc0-be78-0b4e620b52c9 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:57.865235 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-32ac5601-3ee3-4bc0-be78-0b4e620b52c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:57.956479 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5601-3ee3-4bc0-be78-0b4e620b52c9 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:57.961932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e7668-fbe4-4a53-b72e-c415c0cb0bde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:57.962695 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e7668-fbe4-4a53-b72e-c415c0cb0bde service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:57.963215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e7668-fbe4-4a53-b72e-c415c0cb0bde service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:57.963587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e7668-fbe4-4a53-b72e-c415c0cb0bde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:57.976716 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e7668-fbe4-4a53-b72e-c415c0cb0bde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:57.978618 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e7668-fbe4-4a53-b72e-c415c0cb0bde service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:57.997091 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 929/1868] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:58.581411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54978769-5bb0-4b7e-b50f-55896dbf4615 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:58.583380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-54978769-5bb0-4b7e-b50f-55896dbf4615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:58.606626 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54978769-5bb0-4b7e-b50f-55896dbf4615 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:58.617528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368454b-a1d7-4a7f-93f0-4452b5cbcce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:58.618292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368454b-a1d7-4a7f-93f0-4452b5cbcce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:58.618991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368454b-a1d7-4a7f-93f0-4452b5cbcce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:58.619416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368454b-a1d7-4a7f-93f0-4452b5cbcce3 admin admin] PATH_INFO: `/v3/projects/a1773bdc785b4c57a82147795a51fb4c` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:58.621388 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368454b-a1d7-4a7f-93f0-4452b5cbcce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1773bdc785b4c57a82147795a51fb4c)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:58.623404 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368454b-a1d7-4a7f-93f0-4452b5cbcce3 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:58.626543 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e7668-fbe4-4a53-b72e-c415c0cb0bde service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:58.627961 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ac5e7668-fbe4-4a53-b72e-c415c0cb0bde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:58.686146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e7668-fbe4-4a53-b72e-c415c0cb0bde service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:58.689986 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5b82f-034a-420e-9a76-714428de654b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:58.690604 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5b82f-034a-420e-9a76-714428de654b service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:58.690883 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5b82f-034a-420e-9a76-714428de654b service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:58.691154 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5b82f-034a-420e-9a76-714428de654b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:58.692961 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fae5b82f-034a-420e-9a76-714428de654b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:58.734668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f368454b-a1d7-4a7f-93f0-4452b5cbcce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1773bdc785b4c57a82147795a51fb4c', 'request_id': 'req-f368454b-a1d7-4a7f-93f0-4452b5cbcce3'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:58.741664 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f368454b-a1d7-4a7f-93f0-4452b5cbcce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1773bdc785b4c57a82147795a51fb4c', 'request_id': 'req-f368454b-a1d7-4a7f-93f0-4452b5cbcce3'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:58.764965 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5b82f-034a-420e-9a76-714428de654b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:58.778605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5b82f-034a-420e-9a76-714428de654b service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:58.800846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 930/1869] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:57:58.865092 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f368454b-a1d7-4a7f-93f0-4452b5cbcce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1773bdc785b4c57a82147795a51fb4c', 'request_id': 'req-f368454b-a1d7-4a7f-93f0-4452b5cbcce3'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:58.879347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f368454b-a1d7-4a7f-93f0-4452b5cbcce3 admin admin] The token cache is being invalidate because project a1773bdc785b4c57a82147795a51fb4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:57:58.879807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f368454b-a1d7-4a7f-93f0-4452b5cbcce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:58.881109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f368454b-a1d7-4a7f-93f0-4452b5cbcce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:58.882899 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 940/1870] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:57:58 2022] DELETE /identity/v3/projects/a1773bdc785b4c57a82147795a51fb4c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:58.886976 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5b82f-034a-420e-9a76-714428de654b service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:58.899000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5b82f-034a-420e-9a76-714428de654b service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:58.963583 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5ceec-26fd-4ae2-aa0d-c5d82dff0178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:58.965305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5ceec-26fd-4ae2-aa0d-c5d82dff0178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:58.965305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5ceec-26fd-4ae2-aa0d-c5d82dff0178 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:58.965508 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5ceec-26fd-4ae2-aa0d-c5d82dff0178 admin admin] PATH_INFO: `/v3/users/528504d7d3a0467ab76e2e5f0c1b3e16` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:58.966950 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5ceec-26fd-4ae2-aa0d-c5d82dff0178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=528504d7d3a0467ab76e2e5f0c1b3e16)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:58.968944 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5ceec-26fd-4ae2-aa0d-c5d82dff0178 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:59.181043 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55866bc-562f-4471-99c3-6a558940ed1d None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:59.181847 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55866bc-562f-4471-99c3-6a558940ed1d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:59.182273 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55866bc-562f-4471-99c3-6a558940ed1d None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:59.183930 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 941/1871] 10.222.0.30 () {54 vars in 921 bytes} [Tue Sep 6 22:57:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 22:57:59.195977 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1bbfd-34d8-48ca-a763-52f48dd7dce2 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:59.196193 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1bbfd-34d8-48ca-a763-52f48dd7dce2 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:59.196607 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1bbfd-34d8-48ca-a763-52f48dd7dce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:59.218710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-1cc1bbfd-34d8-48ca-a763-52f48dd7dce2 None None] MFA Rules not processed for user `b18fd296138349408613004929144e70`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:57:59.219944 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1cc1bbfd-34d8-48ca-a763-52f48dd7dce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:59.245515 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b4b5ceec-26fd-4ae2-aa0d-c5d82dff0178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '528504d7d3a0467ab76e2e5f0c1b3e16'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:59.302371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 942/1872] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Sep 6 22:57:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:57:59.338677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b4b5ceec-26fd-4ae2-aa0d-c5d82dff0178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '528504d7d3a0467ab76e2e5f0c1b3e16'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:59.340333 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b4b5ceec-26fd-4ae2-aa0d-c5d82dff0178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '528504d7d3a0467ab76e2e5f0c1b3e16'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:59.341041 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b4b5ceec-26fd-4ae2-aa0d-c5d82dff0178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '528504d7d3a0467ab76e2e5f0c1b3e16'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:59.350581 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b4b5ceec-26fd-4ae2-aa0d-c5d82dff0178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '528504d7d3a0467ab76e2e5f0c1b3e16'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:59.367507 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1bbfd-34d8-48ca-a763-52f48dd7dce2 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:59.369185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1cc1bbfd-34d8-48ca-a763-52f48dd7dce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:59.372332 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 931/1873] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:57:58 2022] DELETE /identity/v3/users/528504d7d3a0467ab76e2e5f0c1b3e16 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:57:59.386240 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1bbfd-34d8-48ca-a763-52f48dd7dce2 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:59.453139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cf5e2-a860-4213-b481-5a968f1025f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:59.453826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cf5e2-a860-4213-b481-5a968f1025f1 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:59.454742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cf5e2-a860-4213-b481-5a968f1025f1 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:59.455025 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cf5e2-a860-4213-b481-5a968f1025f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:59.456871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d32cf5e2-a860-4213-b481-5a968f1025f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:59.469537 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cf5e2-a860-4213-b481-5a968f1025f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:59.471454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cf5e2-a860-4213-b481-5a968f1025f1 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:59.482616 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 943/1874] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:57:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:57:59.550422 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:59.681963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:59.752395 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5ceec-26fd-4ae2-aa0d-c5d82dff0178 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:57:59.753894 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b4b5ceec-26fd-4ae2-aa0d-c5d82dff0178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:57:59.821233 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5ceec-26fd-4ae2-aa0d-c5d82dff0178 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:57:59.826558 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32103e96-8314-4b9d-9b27-fe1857e7bee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:57:59.827186 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32103e96-8314-4b9d-9b27-fe1857e7bee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:57:59.827462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32103e96-8314-4b9d-9b27-fe1857e7bee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:57:59.827733 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32103e96-8314-4b9d-9b27-fe1857e7bee5 admin admin] PATH_INFO: `/v3/projects/ba1165739ca04066afd77f848fb8b2b4` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:57:59.828872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32103e96-8314-4b9d-9b27-fe1857e7bee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba1165739ca04066afd77f848fb8b2b4)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:57:59.830819 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32103e96-8314-4b9d-9b27-fe1857e7bee5 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:57:59.951651 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-32103e96-8314-4b9d-9b27-fe1857e7bee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba1165739ca04066afd77f848fb8b2b4', 'request_id': 'req-32103e96-8314-4b9d-9b27-fe1857e7bee5'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:57:59.957923 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-32103e96-8314-4b9d-9b27-fe1857e7bee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba1165739ca04066afd77f848fb8b2b4', 'request_id': 'req-32103e96-8314-4b9d-9b27-fe1857e7bee5'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:00.052946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-32103e96-8314-4b9d-9b27-fe1857e7bee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba1165739ca04066afd77f848fb8b2b4', 'request_id': 'req-32103e96-8314-4b9d-9b27-fe1857e7bee5'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:00.064515 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-32103e96-8314-4b9d-9b27-fe1857e7bee5 admin admin] The token cache is being invalidate because project ba1165739ca04066afd77f848fb8b2b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:00.064807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-32103e96-8314-4b9d-9b27-fe1857e7bee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:00.065456 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-32103e96-8314-4b9d-9b27-fe1857e7bee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:00.066952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 932/1875] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:57:59 2022] DELETE /identity/v3/projects/ba1165739ca04066afd77f848fb8b2b4 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:00.072172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e8ab2-55b7-4717-8e9e-4b031e6c41ab None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:00.072688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e8ab2-55b7-4717-8e9e-4b031e6c41ab None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:00.072906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e8ab2-55b7-4717-8e9e-4b031e6c41ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:00.093465 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-9a5e8ab2-55b7-4717-8e9e-4b031e6c41ab None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:00.094767 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9a5e8ab2-55b7-4717-8e9e-4b031e6c41ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:00.174979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 944/1876] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:00.187752 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32103e96-8314-4b9d-9b27-fe1857e7bee5 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:00.189280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-32103e96-8314-4b9d-9b27-fe1857e7bee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:00.201178 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59975-e197-4ab7-8429-579b129ca27e None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:00.201178 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59975-e197-4ab7-8429-579b129ca27e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:00.203422 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59975-e197-4ab7-8429-579b129ca27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:00.214451 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32103e96-8314-4b9d-9b27-fe1857e7bee5 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:00.219041 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b60c0-3c82-45fc-9474-964c226442a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:00.219701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b60c0-3c82-45fc-9474-964c226442a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:00.219982 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b60c0-3c82-45fc-9474-964c226442a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:00.220254 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b60c0-3c82-45fc-9474-964c226442a8 admin admin] PATH_INFO: `/v3/users/2b8783afce0a44d1872953cbd4bb1642` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:00.221430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b60c0-3c82-45fc-9474-964c226442a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8783afce0a44d1872953cbd4bb1642)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:00.223663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b60c0-3c82-45fc-9474-964c226442a8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:00.259508 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-d7a59975-e197-4ab7-8429-579b129ca27e None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:00.261023 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d7a59975-e197-4ab7-8429-579b129ca27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:00.270857 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 945/1877] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:00.275189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a59975-e197-4ab7-8429-579b129ca27e None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:00.284931 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a59975-e197-4ab7-8429-579b129ca27e None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:00.289595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3439b-8778-44b2-9682-652fa608ff91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:00.290200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3439b-8778-44b2-9682-652fa608ff91 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:00.290481 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3439b-8778-44b2-9682-652fa608ff91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:00.292411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3439b-8778-44b2-9682-652fa608ff91 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:00.292411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3439b-8778-44b2-9682-652fa608ff91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:58:00.292411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3439b-8778-44b2-9682-652fa608ff91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:00.294098 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3439b-8778-44b2-9682-652fa608ff91 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:00.308886 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 946/1878] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:58:00.310067 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3439b-8778-44b2-9682-652fa608ff91 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:00.319883 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3439b-8778-44b2-9682-652fa608ff91 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:00.326317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c412e-b66a-4c22-8218-d47df76d54dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:00.326317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c412e-b66a-4c22-8218-d47df76d54dc admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:00.326317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c412e-b66a-4c22-8218-d47df76d54dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:00.326317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c412e-b66a-4c22-8218-d47df76d54dc admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:00.326690 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c412e-b66a-4c22-8218-d47df76d54dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:00.328635 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c412e-b66a-4c22-8218-d47df76d54dc admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:00.386872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-694b60c0-3c82-45fc-9474-964c226442a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8783afce0a44d1872953cbd4bb1642'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:00.423902 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 947/1879] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:00 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:00.429030 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c412e-b66a-4c22-8218-d47df76d54dc admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:00.440636 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-694b60c0-3c82-45fc-9474-964c226442a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8783afce0a44d1872953cbd4bb1642'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:00.442034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-694b60c0-3c82-45fc-9474-964c226442a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8783afce0a44d1872953cbd4bb1642'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:00.444506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-694b60c0-3c82-45fc-9474-964c226442a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8783afce0a44d1872953cbd4bb1642'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:00.462136 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-694b60c0-3c82-45fc-9474-964c226442a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8783afce0a44d1872953cbd4bb1642'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:00.486149 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 933/1880] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:00 2022] DELETE /identity/v3/users/2b8783afce0a44d1872953cbd4bb1642 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:00.491819 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bf7bf-fb44-4d68-bf07-b936306bd9b7 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:00.492099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bf7bf-fb44-4d68-bf07-b936306bd9b7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:00.492374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bf7bf-fb44-4d68-bf07-b936306bd9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:00.514808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-cc5bf7bf-fb44-4d68-bf07-b936306bd9b7 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:00.516044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cc5bf7bf-fb44-4d68-bf07-b936306bd9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:00.522761 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c412e-b66a-4c22-8218-d47df76d54dc admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:00.574210 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:00.581874 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 934/1881] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:00.600219 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bf7bf-fb44-4d68-bf07-b936306bd9b7 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:00.602304 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cc5bf7bf-fb44-4d68-bf07-b936306bd9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:00.619509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9bc27-e192-4ea5-bf6c-93bce20afd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:00.620172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9bc27-e192-4ea5-bf6c-93bce20afd09 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:00.620476 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9bc27-e192-4ea5-bf6c-93bce20afd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:00.620767 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9bc27-e192-4ea5-bf6c-93bce20afd09 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:00.621405 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9bc27-e192-4ea5-bf6c-93bce20afd09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:00.624462 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9bc27-e192-4ea5-bf6c-93bce20afd09 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:00.673919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bf7bf-fb44-4d68-bf07-b936306bd9b7 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:00.677593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df44eba-4268-40b9-b0c9-c44e3d2fd640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:00.678203 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df44eba-4268-40b9-b0c9-c44e3d2fd640 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:00.678480 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df44eba-4268-40b9-b0c9-c44e3d2fd640 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:00.678751 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df44eba-4268-40b9-b0c9-c44e3d2fd640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:00.691278 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df44eba-4268-40b9-b0c9-c44e3d2fd640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:00.693308 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df44eba-4268-40b9-b0c9-c44e3d2fd640 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:00.704840 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 935/1882] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:58:00.719674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 948/1883] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:00 2022] POST /identity/v3/users => generated 286 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:00.723906 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df44eba-4268-40b9-b0c9-c44e3d2fd640 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:00.725567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4df44eba-4268-40b9-b0c9-c44e3d2fd640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:00.739712 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df44eba-4268-40b9-b0c9-c44e3d2fd640 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:00.744776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104fea7-6648-4f9c-8acf-cafbf34b2591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:00.745426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104fea7-6648-4f9c-8acf-cafbf34b2591 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:00.745813 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104fea7-6648-4f9c-8acf-cafbf34b2591 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:00.746105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104fea7-6648-4f9c-8acf-cafbf34b2591 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:00.746761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104fea7-6648-4f9c-8acf-cafbf34b2591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:00.748446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104fea7-6648-4f9c-8acf-cafbf34b2591 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:00.758666 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 936/1884] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:58:00.765619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9bc27-e192-4ea5-bf6c-93bce20afd09 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:00.778749 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9bc27-e192-4ea5-bf6c-93bce20afd09 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:00.784387 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ab5a5-b0c7-4b31-8ead-0f0ad39b4a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:00.785221 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ab5a5-b0c7-4b31-8ead-0f0ad39b4a8d admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:00.785570 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ab5a5-b0c7-4b31-8ead-0f0ad39b4a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:00.785963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ab5a5-b0c7-4b31-8ead-0f0ad39b4a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:00.786828 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ab5a5-b0c7-4b31-8ead-0f0ad39b4a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:00.798986 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:00.798986 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ab5a5-b0c7-4b31-8ead-0f0ad39b4a8d admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:00.825382 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 949/1885] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:00.831090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104fea7-6648-4f9c-8acf-cafbf34b2591 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:00.843602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104fea7-6648-4f9c-8acf-cafbf34b2591 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:00.848698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c65e18-c5b5-48a0-a75c-547a17e4b460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:00.849443 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c65e18-c5b5-48a0-a75c-547a17e4b460 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:00.849800 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c65e18-c5b5-48a0-a75c-547a17e4b460 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:00.850151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c65e18-c5b5-48a0-a75c-547a17e4b460 admin admin] PATH_INFO: `/v3/projects/e4df36f92fd247378ec851aa4f498046/users/bf84bc608ceb4a9eb7d0f5e9568407f9/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:00.867314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c65e18-c5b5-48a0-a75c-547a17e4b460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4df36f92fd247378ec851aa4f498046, user_id=bf84bc608ceb4a9eb7d0f5e9568407f9, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:00.870391 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c65e18-c5b5-48a0-a75c-547a17e4b460 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:00.986095 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 937/1886] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:00 2022] PUT /identity/v3/projects/e4df36f92fd247378ec851aa4f498046/users/bf84bc608ceb4a9eb7d0f5e9568407f9/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:00.998125 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9a645-0b8c-4863-93c2-9d249f24fbc0 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:00.998557 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9a645-0b8c-4863-93c2-9d249f24fbc0 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:00.998929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9a645-0b8c-4863-93c2-9d249f24fbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:01.046975 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-b7d9a645-0b8c-4863-93c2-9d249f24fbc0 None None] MFA Rules not processed for user `bf84bc608ceb4a9eb7d0f5e9568407f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:01.048175 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b7d9a645-0b8c-4863-93c2-9d249f24fbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:01.120719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 950/1887] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:01.130711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c65e18-c5b5-48a0-a75c-547a17e4b460 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:01.132509 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-26c65e18-c5b5-48a0-a75c-547a17e4b460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:01.191700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c65e18-c5b5-48a0-a75c-547a17e4b460 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:01.195665 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5b647-baab-4ad5-b11b-499ef4791c73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:01.196273 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5b647-baab-4ad5-b11b-499ef4791c73 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:01.196664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5b647-baab-4ad5-b11b-499ef4791c73 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:01.196930 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5b647-baab-4ad5-b11b-499ef4791c73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:01.205970 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5b647-baab-4ad5-b11b-499ef4791c73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:01.207457 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5b647-baab-4ad5-b11b-499ef4791c73 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:01.217050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 938/1888] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:01.240249 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9a645-0b8c-4863-93c2-9d249f24fbc0 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:01.241823 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b7d9a645-0b8c-4863-93c2-9d249f24fbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:01.246300 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5b647-baab-4ad5-b11b-499ef4791c73 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:01.336662 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5b647-baab-4ad5-b11b-499ef4791c73 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:01.337856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9a645-0b8c-4863-93c2-9d249f24fbc0 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:01.343445 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595913b-e83a-4954-91bf-cd7111b320e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:01.344027 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595913b-e83a-4954-91bf-cd7111b320e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:01.344302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595913b-e83a-4954-91bf-cd7111b320e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:01.344614 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595913b-e83a-4954-91bf-cd7111b320e6 admin admin] PATH_INFO: `/v3/users/bf84bc608ceb4a9eb7d0f5e9568407f9` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:01.345662 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c23d3-45a6-44f7-bb24-8f6ea8fc8bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:01.345816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595913b-e83a-4954-91bf-cd7111b320e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf84bc608ceb4a9eb7d0f5e9568407f9)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:01.346622 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c23d3-45a6-44f7-bb24-8f6ea8fc8bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:01.347128 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c23d3-45a6-44f7-bb24-8f6ea8fc8bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:01.347586 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c23d3-45a6-44f7-bb24-8f6ea8fc8bdd admin admin] PATH_INFO: `/v3/projects/32685569fb0d459888cabc5eebdb4b5b` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:01.347749 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595913b-e83a-4954-91bf-cd7111b320e6 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:01.349133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c23d3-45a6-44f7-bb24-8f6ea8fc8bdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=32685569fb0d459888cabc5eebdb4b5b)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:01.351284 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c23d3-45a6-44f7-bb24-8f6ea8fc8bdd admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:01.638525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-da1c23d3-45a6-44f7-bb24-8f6ea8fc8bdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32685569fb0d459888cabc5eebdb4b5b', 'request_id': 'req-da1c23d3-45a6-44f7-bb24-8f6ea8fc8bdd'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:01.638709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6595913b-e83a-4954-91bf-cd7111b320e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf84bc608ceb4a9eb7d0f5e9568407f9'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:01.644709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-da1c23d3-45a6-44f7-bb24-8f6ea8fc8bdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32685569fb0d459888cabc5eebdb4b5b', 'request_id': 'req-da1c23d3-45a6-44f7-bb24-8f6ea8fc8bdd'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:01.698406 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6595913b-e83a-4954-91bf-cd7111b320e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf84bc608ceb4a9eb7d0f5e9568407f9'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:01.699156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6595913b-e83a-4954-91bf-cd7111b320e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf84bc608ceb4a9eb7d0f5e9568407f9'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:01.699885 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6595913b-e83a-4954-91bf-cd7111b320e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf84bc608ceb4a9eb7d0f5e9568407f9'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:01.707855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6595913b-e83a-4954-91bf-cd7111b320e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf84bc608ceb4a9eb7d0f5e9568407f9'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:01.728673 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 939/1889] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:01 2022] DELETE /identity/v3/users/bf84bc608ceb4a9eb7d0f5e9568407f9 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:01.731838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a518cc3-3de7-4517-99cd-c0828a8a1429 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:01.732135 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a518cc3-3de7-4517-99cd-c0828a8a1429 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:01.732488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a518cc3-3de7-4517-99cd-c0828a8a1429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:01.754220 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9a518cc3-3de7-4517-99cd-c0828a8a1429 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:01.755445 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9a518cc3-3de7-4517-99cd-c0828a8a1429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:01.801504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-da1c23d3-45a6-44f7-bb24-8f6ea8fc8bdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32685569fb0d459888cabc5eebdb4b5b', 'request_id': 'req-da1c23d3-45a6-44f7-bb24-8f6ea8fc8bdd'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:01.814642 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-da1c23d3-45a6-44f7-bb24-8f6ea8fc8bdd admin admin] The token cache is being invalidate because project 32685569fb0d459888cabc5eebdb4b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:01.814941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-da1c23d3-45a6-44f7-bb24-8f6ea8fc8bdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:01.815734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-da1c23d3-45a6-44f7-bb24-8f6ea8fc8bdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:01.817718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 951/1890] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:01 2022] DELETE /identity/v3/projects/32685569fb0d459888cabc5eebdb4b5b => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:01.824343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c23d3-45a6-44f7-bb24-8f6ea8fc8bdd admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:01.827337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-da1c23d3-45a6-44f7-bb24-8f6ea8fc8bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:01.831569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 940/1891] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:01.847044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a518cc3-3de7-4517-99cd-c0828a8a1429 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:01.849432 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9a518cc3-3de7-4517-99cd-c0828a8a1429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:01.892661 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:01.952299 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c23d3-45a6-44f7-bb24-8f6ea8fc8bdd admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:01.965008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089d694-167d-46c4-a1c5-f9c9727b626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:01.965713 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089d694-167d-46c4-a1c5-f9c9727b626a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:01.965998 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089d694-167d-46c4-a1c5-f9c9727b626a admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:01.966277 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089d694-167d-46c4-a1c5-f9c9727b626a admin admin] PATH_INFO: `/v3/users/e38a7357eb8f47159bed5940e3362004` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:01.969619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089d694-167d-46c4-a1c5-f9c9727b626a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e38a7357eb8f47159bed5940e3362004)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:01.973433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a518cc3-3de7-4517-99cd-c0828a8a1429 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:01.974619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089d694-167d-46c4-a1c5-f9c9727b626a admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:01.983215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e828a9-426f-4676-acf6-aa5887e6d71f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:01.983870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e828a9-426f-4676-acf6-aa5887e6d71f service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:01.984675 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e828a9-426f-4676-acf6-aa5887e6d71f service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:01.984958 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e828a9-426f-4676-acf6-aa5887e6d71f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:01.995833 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e828a9-426f-4676-acf6-aa5887e6d71f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:02.004570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e828a9-426f-4676-acf6-aa5887e6d71f service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:02.025830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 941/1892] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:02.169148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c089d694-167d-46c4-a1c5-f9c9727b626a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e38a7357eb8f47159bed5940e3362004'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:02.218549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c089d694-167d-46c4-a1c5-f9c9727b626a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e38a7357eb8f47159bed5940e3362004'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:02.219472 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c089d694-167d-46c4-a1c5-f9c9727b626a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e38a7357eb8f47159bed5940e3362004'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:02.252193 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c089d694-167d-46c4-a1c5-f9c9727b626a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e38a7357eb8f47159bed5940e3362004'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:02.253172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c089d694-167d-46c4-a1c5-f9c9727b626a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e38a7357eb8f47159bed5940e3362004'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:02.273795 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 952/1893] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:01 2022] DELETE /identity/v3/users/e38a7357eb8f47159bed5940e3362004 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:02.398185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:02.488380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e828a9-426f-4676-acf6-aa5887e6d71f service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:02.489943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c4e828a9-426f-4676-acf6-aa5887e6d71f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:02.503175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e828a9-426f-4676-acf6-aa5887e6d71f service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:02.602092 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91304697-4105-4ffe-a6db-5c467cf02a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:02.602742 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91304697-4105-4ffe-a6db-5c467cf02a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:02.603023 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91304697-4105-4ffe-a6db-5c467cf02a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:02.603300 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91304697-4105-4ffe-a6db-5c467cf02a62 admin admin] PATH_INFO: `/v3/projects/e4df36f92fd247378ec851aa4f498046` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:02.605092 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91304697-4105-4ffe-a6db-5c467cf02a62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4df36f92fd247378ec851aa4f498046)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:02.607218 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91304697-4105-4ffe-a6db-5c467cf02a62 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:02.756001 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-91304697-4105-4ffe-a6db-5c467cf02a62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4df36f92fd247378ec851aa4f498046', 'request_id': 'req-91304697-4105-4ffe-a6db-5c467cf02a62'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:02.762306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-91304697-4105-4ffe-a6db-5c467cf02a62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4df36f92fd247378ec851aa4f498046', 'request_id': 'req-91304697-4105-4ffe-a6db-5c467cf02a62'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:02.847206 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-91304697-4105-4ffe-a6db-5c467cf02a62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4df36f92fd247378ec851aa4f498046', 'request_id': 'req-91304697-4105-4ffe-a6db-5c467cf02a62'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:02.858991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-91304697-4105-4ffe-a6db-5c467cf02a62 admin admin] The token cache is being invalidate because project e4df36f92fd247378ec851aa4f498046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:02.859573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-91304697-4105-4ffe-a6db-5c467cf02a62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:02.863354 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-91304697-4105-4ffe-a6db-5c467cf02a62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:02.867475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 942/1894] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:02 2022] DELETE /identity/v3/projects/e4df36f92fd247378ec851aa4f498046 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:02.872613 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c31734-816c-424f-9957-469fa9a4b1cc None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:02.872904 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c31734-816c-424f-9957-469fa9a4b1cc None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:02.873192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c31734-816c-424f-9957-469fa9a4b1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:02.894800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-61c31734-816c-424f-9957-469fa9a4b1cc None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:02.896012 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-61c31734-816c-424f-9957-469fa9a4b1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:02.950532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91304697-4105-4ffe-a6db-5c467cf02a62 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:02.951858 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-91304697-4105-4ffe-a6db-5c467cf02a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:03.000972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 953/1895] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:03.003277 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3688878-3f9a-4e18-ba40-b1083e38cedd None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:03.003705 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3688878-3f9a-4e18-ba40-b1083e38cedd None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:03.004082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3688878-3f9a-4e18-ba40-b1083e38cedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:03.046151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-b3688878-3f9a-4e18-ba40-b1083e38cedd None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:03.047666 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b3688878-3f9a-4e18-ba40-b1083e38cedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:03.065312 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 954/1896] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:03.070075 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3688878-3f9a-4e18-ba40-b1083e38cedd None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:03.084342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3688878-3f9a-4e18-ba40-b1083e38cedd None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:03.095228 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fb261-2b25-4e67-abe2-d4c131408692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:03.097300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fb261-2b25-4e67-abe2-d4c131408692 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:03.098074 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fb261-2b25-4e67-abe2-d4c131408692 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:03.098994 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fb261-2b25-4e67-abe2-d4c131408692 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:03.100151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924fb261-2b25-4e67-abe2-d4c131408692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:58:03.100686 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924fb261-2b25-4e67-abe2-d4c131408692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:03.102677 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924fb261-2b25-4e67-abe2-d4c131408692 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:03.112852 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91304697-4105-4ffe-a6db-5c467cf02a62 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:03.118380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e1ea4-30ee-408a-90bf-5ac9177bdb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:03.119307 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e1ea4-30ee-408a-90bf-5ac9177bdb07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:03.119599 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e1ea4-30ee-408a-90bf-5ac9177bdb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:03.119900 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e1ea4-30ee-408a-90bf-5ac9177bdb07 admin admin] PATH_INFO: `/v3/projects/ccb8ae7ebd244b9eb5032f7d5256e62d` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:03.120791 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 955/1897] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:58:03.125540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e1ea4-30ee-408a-90bf-5ac9177bdb07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb8ae7ebd244b9eb5032f7d5256e62d)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:03.125540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e1ea4-30ee-408a-90bf-5ac9177bdb07 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:03.126304 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fb261-2b25-4e67-abe2-d4c131408692 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:03.145233 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fb261-2b25-4e67-abe2-d4c131408692 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:03.161349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d276b-d0c8-481b-8aaf-a4f46704de21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:03.162770 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d276b-d0c8-481b-8aaf-a4f46704de21 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:03.164082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d276b-d0c8-481b-8aaf-a4f46704de21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:03.164760 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d276b-d0c8-481b-8aaf-a4f46704de21 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:03.166625 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d276b-d0c8-481b-8aaf-a4f46704de21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:03.168779 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d276b-d0c8-481b-8aaf-a4f46704de21 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:03.283223 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 956/1898] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:03 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:03.288238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d276b-d0c8-481b-8aaf-a4f46704de21 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:03.300390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ce9e1ea4-30ee-408a-90bf-5ac9177bdb07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb8ae7ebd244b9eb5032f7d5256e62d', 'request_id': 'req-ce9e1ea4-30ee-408a-90bf-5ac9177bdb07'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:03.311838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ce9e1ea4-30ee-408a-90bf-5ac9177bdb07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb8ae7ebd244b9eb5032f7d5256e62d', 'request_id': 'req-ce9e1ea4-30ee-408a-90bf-5ac9177bdb07'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:03.374319 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d276b-d0c8-481b-8aaf-a4f46704de21 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:03.380080 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ce9e1ea4-30ee-408a-90bf-5ac9177bdb07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb8ae7ebd244b9eb5032f7d5256e62d', 'request_id': 'req-ce9e1ea4-30ee-408a-90bf-5ac9177bdb07'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:03.380687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf007b-2583-4cce-b4d4-f7b2326f3bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:03.381327 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf007b-2583-4cce-b4d4-f7b2326f3bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:03.381718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf007b-2583-4cce-b4d4-f7b2326f3bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:03.382167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf007b-2583-4cce-b4d4-f7b2326f3bf6 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:03.383038 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf007b-2583-4cce-b4d4-f7b2326f3bf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:03.386187 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf007b-2583-4cce-b4d4-f7b2326f3bf6 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:03.417224 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ce9e1ea4-30ee-408a-90bf-5ac9177bdb07 admin admin] The token cache is being invalidate because project ccb8ae7ebd244b9eb5032f7d5256e62d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:03.418303 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ce9e1ea4-30ee-408a-90bf-5ac9177bdb07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:03.421271 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ce9e1ea4-30ee-408a-90bf-5ac9177bdb07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:03.426059 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 943/1899] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:02 2022] DELETE /identity/v3/projects/ccb8ae7ebd244b9eb5032f7d5256e62d => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:03.431292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5935a15-9738-4236-beab-9db20295559d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:03.431582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5935a15-9738-4236-beab-9db20295559d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:03.431902 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5935a15-9738-4236-beab-9db20295559d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:03.495474 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 957/1900] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:03 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:03.499536 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf007b-2583-4cce-b4d4-f7b2326f3bf6 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:03.500876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b5935a15-9738-4236-beab-9db20295559d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:03.502101 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b5935a15-9738-4236-beab-9db20295559d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:03.506031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-2fcf007b-2583-4cce-b4d4-f7b2326f3bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:03.533951 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 944/1901] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:03.534347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf007b-2583-4cce-b4d4-f7b2326f3bf6 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:03.539773 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510102fe-3c38-4ff6-b0f7-1ca116a686aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:03.541579 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dbcca-e4e2-43a7-b3c1-927aeb329e1e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:03.541897 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dbcca-e4e2-43a7-b3c1-927aeb329e1e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:03.542170 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dbcca-e4e2-43a7-b3c1-927aeb329e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:03.546699 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510102fe-3c38-4ff6-b0f7-1ca116a686aa admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:03.546986 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510102fe-3c38-4ff6-b0f7-1ca116a686aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:03.547256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510102fe-3c38-4ff6-b0f7-1ca116a686aa admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:03.549041 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510102fe-3c38-4ff6-b0f7-1ca116a686aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:03.551766 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510102fe-3c38-4ff6-b0f7-1ca116a686aa admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:03.576038 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e35dbcca-e4e2-43a7-b3c1-927aeb329e1e None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:03.577348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 958/1902] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:58:03.577602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e35dbcca-e4e2-43a7-b3c1-927aeb329e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:03.582497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510102fe-3c38-4ff6-b0f7-1ca116a686aa admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:03.587314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 945/1903] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:03.591605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35dbcca-e4e2-43a7-b3c1-927aeb329e1e None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:03.598788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510102fe-3c38-4ff6-b0f7-1ca116a686aa admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:03.602861 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35dbcca-e4e2-43a7-b3c1-927aeb329e1e None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:03.607838 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5f88a-fe25-40fc-922a-04561a8ca8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:03.609862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5f88a-fe25-40fc-922a-04561a8ca8ff admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:03.609862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5f88a-fe25-40fc-922a-04561a8ca8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:03.609862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5f88a-fe25-40fc-922a-04561a8ca8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:03.609862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5f88a-fe25-40fc-922a-04561a8ca8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:03.610216 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fe54c-6e48-4c83-9b14-d8ef142a2309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:03.611032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fe54c-6e48-4c83-9b14-d8ef142a2309 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:03.611870 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5f88a-fe25-40fc-922a-04561a8ca8ff admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:03.611983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fe54c-6e48-4c83-9b14-d8ef142a2309 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:03.612294 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fe54c-6e48-4c83-9b14-d8ef142a2309 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:03.613052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fe54c-6e48-4c83-9b14-d8ef142a2309 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:58:03.613575 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fe54c-6e48-4c83-9b14-d8ef142a2309 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:03.615944 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fe54c-6e48-4c83-9b14-d8ef142a2309 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:03.628052 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 959/1904] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:03.629444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5f88a-fe25-40fc-922a-04561a8ca8ff admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:03.632995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 946/1905] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:58:03.640969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5f88a-fe25-40fc-922a-04561a8ca8ff admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:03.645513 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fe54c-6e48-4c83-9b14-d8ef142a2309 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:03.648756 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88b800-b705-46dd-8248-9f6af5322df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:03.649650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88b800-b705-46dd-8248-9f6af5322df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:03.650054 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88b800-b705-46dd-8248-9f6af5322df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:03.650434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88b800-b705-46dd-8248-9f6af5322df0 admin admin] PATH_INFO: `/v3/projects/f1fbea3e0e38454a87d29e5e32ab01d5/users/31fb3df4008142e783c7183884c79653/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:03.663759 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fe54c-6e48-4c83-9b14-d8ef142a2309 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:03.670642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e639f-4ddd-48e4-9928-ffdbef5cbcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:03.671330 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e639f-4ddd-48e4-9928-ffdbef5cbcce admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:03.671612 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e639f-4ddd-48e4-9928-ffdbef5cbcce admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:03.671714 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88b800-b705-46dd-8248-9f6af5322df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1fbea3e0e38454a87d29e5e32ab01d5, user_id=31fb3df4008142e783c7183884c79653, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:03.671885 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e639f-4ddd-48e4-9928-ffdbef5cbcce admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:03.672653 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e639f-4ddd-48e4-9928-ffdbef5cbcce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:03.674780 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e639f-4ddd-48e4-9928-ffdbef5cbcce admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:03.675668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88b800-b705-46dd-8248-9f6af5322df0 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:03.744481 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:03.761057 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 960/1906] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:03 2022] PUT /identity/v3/projects/f1fbea3e0e38454a87d29e5e32ab01d5/users/31fb3df4008142e783c7183884c79653/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:03.764030 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270666bf-7769-4f6d-8c26-8723299ec348 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:03.764323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270666bf-7769-4f6d-8c26-8723299ec348 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:03.764641 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270666bf-7769-4f6d-8c26-8723299ec348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:03.811264 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-270666bf-7769-4f6d-8c26-8723299ec348 None None] MFA Rules not processed for user `31fb3df4008142e783c7183884c79653`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:03.813143 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-270666bf-7769-4f6d-8c26-8723299ec348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:03.823444 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 947/1907] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:03 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:03.824348 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e639f-4ddd-48e4-9928-ffdbef5cbcce admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:03.827440 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-846e639f-4ddd-48e4-9928-ffdbef5cbcce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:03.842085 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:03.935876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e639f-4ddd-48e4-9928-ffdbef5cbcce admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:03.945316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 961/1908] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:03.952066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05978753-9613-4de8-ac79-ae78d64303aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:03.952827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270666bf-7769-4f6d-8c26-8723299ec348 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:03.953327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05978753-9613-4de8-ac79-ae78d64303aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:03.953734 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05978753-9613-4de8-ac79-ae78d64303aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:03.954104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05978753-9613-4de8-ac79-ae78d64303aa admin admin] PATH_INFO: `/v3/users/6b6439b7d70a447ea23f5ab575360414` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:03.955746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05978753-9613-4de8-ac79-ae78d64303aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6439b7d70a447ea23f5ab575360414)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:03.958610 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05978753-9613-4de8-ac79-ae78d64303aa admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:04.037705 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270666bf-7769-4f6d-8c26-8723299ec348 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:04.044042 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e972132-37e5-4a54-9ddb-69290c77aafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:04.044711 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e972132-37e5-4a54-9ddb-69290c77aafc admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:04.044997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e972132-37e5-4a54-9ddb-69290c77aafc admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:04.045272 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e972132-37e5-4a54-9ddb-69290c77aafc admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:04.046004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e972132-37e5-4a54-9ddb-69290c77aafc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:04.047969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e972132-37e5-4a54-9ddb-69290c77aafc admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:04.157592 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 962/1909] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:03 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:04.158587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e972132-37e5-4a54-9ddb-69290c77aafc admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:04.163993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-8e972132-37e5-4a54-9ddb-69290c77aafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:04.206410 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-05978753-9613-4de8-ac79-ae78d64303aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6439b7d70a447ea23f5ab575360414'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:04.243792 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e972132-37e5-4a54-9ddb-69290c77aafc admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:04.247775 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9d49c-723e-4ac5-a8e4-2d6409198a7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:04.248638 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9d49c-723e-4ac5-a8e4-2d6409198a7e service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:04.249135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9d49c-723e-4ac5-a8e4-2d6409198a7e service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:04.249374 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9d49c-723e-4ac5-a8e4-2d6409198a7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:04.281313 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-05978753-9613-4de8-ac79-ae78d64303aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6439b7d70a447ea23f5ab575360414'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:04.282249 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-05978753-9613-4de8-ac79-ae78d64303aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6439b7d70a447ea23f5ab575360414'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:04.282920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-05978753-9613-4de8-ac79-ae78d64303aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6439b7d70a447ea23f5ab575360414'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:04.294061 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-05978753-9613-4de8-ac79-ae78d64303aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6439b7d70a447ea23f5ab575360414'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:04.317788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 948/1910] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:03 2022] DELETE /identity/v3/users/6b6439b7d70a447ea23f5ab575360414 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:04.319149 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05978753-9613-4de8-ac79-ae78d64303aa admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:04.320845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-05978753-9613-4de8-ac79-ae78d64303aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:04.366299 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9d49c-723e-4ac5-a8e4-2d6409198a7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:04.377798 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9d49c-723e-4ac5-a8e4-2d6409198a7e service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:04.418367 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 963/1911] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:04.420159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec713849-2c4d-4aaa-a3c0-a6963cc39739 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:04.422801 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec713849-2c4d-4aaa-a3c0-a6963cc39739 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:04.424378 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec713849-2c4d-4aaa-a3c0-a6963cc39739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:04.456516 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-ec713849-2c4d-4aaa-a3c0-a6963cc39739 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:04.457842 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ec713849-2c4d-4aaa-a3c0-a6963cc39739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:04.467277 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 964/1912] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:04.468293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05978753-9613-4de8-ac79-ae78d64303aa admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:04.477862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f970594-0413-4b38-b00f-c903fde58d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:04.478871 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f970594-0413-4b38-b00f-c903fde58d75 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:04.478871 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f970594-0413-4b38-b00f-c903fde58d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:04.479206 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f970594-0413-4b38-b00f-c903fde58d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:04.481808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f970594-0413-4b38-b00f-c903fde58d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:04.481808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f970594-0413-4b38-b00f-c903fde58d75 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:04.500605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 949/1913] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:04.503689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec713849-2c4d-4aaa-a3c0-a6963cc39739 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:04.519051 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec713849-2c4d-4aaa-a3c0-a6963cc39739 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:04.522351 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f970594-0413-4b38-b00f-c903fde58d75 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:04.528139 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3f970594-0413-4b38-b00f-c903fde58d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:04.548286 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9da894-543c-41ab-926b-7a89ff0bb5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:04.550300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9da894-543c-41ab-926b-7a89ff0bb5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:04.550655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9da894-543c-41ab-926b-7a89ff0bb5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:04.551807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9da894-543c-41ab-926b-7a89ff0bb5d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:04.552771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9da894-543c-41ab-926b-7a89ff0bb5d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:04.558815 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9da894-543c-41ab-926b-7a89ff0bb5d4 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:04.589477 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 965/1914] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:04.592000 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9da894-543c-41ab-926b-7a89ff0bb5d4 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:04.617617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9da894-543c-41ab-926b-7a89ff0bb5d4 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:04.625117 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbd830-18fc-4f62-86db-00acf5e97ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:04.626982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbd830-18fc-4f62-86db-00acf5e97ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:04.627547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbd830-18fc-4f62-86db-00acf5e97ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:04.628028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbd830-18fc-4f62-86db-00acf5e97ae6 admin admin] PATH_INFO: `/v3/projects/b779eba6be02430686412ba9d85ad0ef/users/97d8b4e4282c41498c02ccafa8b85c9b/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:04.665018 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbd830-18fc-4f62-86db-00acf5e97ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b779eba6be02430686412ba9d85ad0ef, user_id=97d8b4e4282c41498c02ccafa8b85c9b, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:04.674432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbd830-18fc-4f62-86db-00acf5e97ae6 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:04.686550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:04.691708 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f970594-0413-4b38-b00f-c903fde58d75 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:04.702138 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc37cd-6474-4ab9-9ff5-7f68c6a6b4f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:04.703257 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc37cd-6474-4ab9-9ff5-7f68c6a6b4f8 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:04.703685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc37cd-6474-4ab9-9ff5-7f68c6a6b4f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:04.704528 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc37cd-6474-4ab9-9ff5-7f68c6a6b4f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:04.728631 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc37cd-6474-4ab9-9ff5-7f68c6a6b4f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:04.731466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc37cd-6474-4ab9-9ff5-7f68c6a6b4f8 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:04.748089 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 950/1915] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:58:04.779540 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:04.815963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 966/1916] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:04 2022] PUT /identity/v3/projects/b779eba6be02430686412ba9d85ad0ef/users/97d8b4e4282c41498c02ccafa8b85c9b/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:04.829504 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3919cca-0d68-42d2-8980-73fe3b4113fa None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:04.829798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3919cca-0d68-42d2-8980-73fe3b4113fa None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:04.830074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3919cca-0d68-42d2-8980-73fe3b4113fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:04.883793 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e3919cca-0d68-42d2-8980-73fe3b4113fa None None] MFA Rules not processed for user `97d8b4e4282c41498c02ccafa8b85c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:04.886102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e3919cca-0d68-42d2-8980-73fe3b4113fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:04.958528 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 951/1917] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:04.963161 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbd830-18fc-4f62-86db-00acf5e97ae6 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:05.043116 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbd830-18fc-4f62-86db-00acf5e97ae6 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:05.047068 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8b739-3042-4c52-a8b5-5522cf4554d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:05.047667 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8b739-3042-4c52-a8b5-5522cf4554d2 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:05.047949 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8b739-3042-4c52-a8b5-5522cf4554d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:05.048220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8b739-3042-4c52-a8b5-5522cf4554d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:05.048920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8b739-3042-4c52-a8b5-5522cf4554d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:05.050868 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8b739-3042-4c52-a8b5-5522cf4554d2 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:05.162175 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 967/1918] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:04 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:05.166812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3919cca-0d68-42d2-8980-73fe3b4113fa None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:05.184288 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3919cca-0d68-42d2-8980-73fe3b4113fa None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:05.258967 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:05.270509 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96f986-68d3-4199-9681-2617de3ab06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:05.271136 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96f986-68d3-4199-9681-2617de3ab06c admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:05.271412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96f986-68d3-4199-9681-2617de3ab06c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:05.271679 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96f986-68d3-4199-9681-2617de3ab06c admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:05.272322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96f986-68d3-4199-9681-2617de3ab06c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:05.274283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96f986-68d3-4199-9681-2617de3ab06c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:05.382769 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8b739-3042-4c52-a8b5-5522cf4554d2 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:05.382769 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-84c8b739-3042-4c52-a8b5-5522cf4554d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:05.409644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 952/1919] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:05 2022] POST /identity/v3/users => generated 289 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:05.413882 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96f986-68d3-4199-9681-2617de3ab06c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:05.418032 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8b739-3042-4c52-a8b5-5522cf4554d2 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:05.424646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437927a7-564d-44c7-bc0c-c1b08a4be850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:05.425510 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437927a7-564d-44c7-bc0c-c1b08a4be850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:05.425991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437927a7-564d-44c7-bc0c-c1b08a4be850 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:05.426617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437927a7-564d-44c7-bc0c-c1b08a4be850 admin admin] PATH_INFO: `/v3/projects/9e56716e81044be5ab8524a8339524ea` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:05.428100 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437927a7-564d-44c7-bc0c-c1b08a4be850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e56716e81044be5ab8524a8339524ea)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:05.430303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437927a7-564d-44c7-bc0c-c1b08a4be850 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:05.435086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96f986-68d3-4199-9681-2617de3ab06c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:05.457401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49338234-a49e-4861-994b-7b5372e8b0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:05.458073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49338234-a49e-4861-994b-7b5372e8b0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:05.458356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49338234-a49e-4861-994b-7b5372e8b0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:05.458637 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49338234-a49e-4861-994b-7b5372e8b0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:05.465202 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49338234-a49e-4861-994b-7b5372e8b0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:05.465202 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49338234-a49e-4861-994b-7b5372e8b0d9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:05.487822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 953/1920] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:05.488862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49338234-a49e-4861-994b-7b5372e8b0d9 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:05.509536 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49338234-a49e-4861-994b-7b5372e8b0d9 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:05.515202 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea9bae-7479-4e5e-9393-42492ac35fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:05.515914 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea9bae-7479-4e5e-9393-42492ac35fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:05.516268 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea9bae-7479-4e5e-9393-42492ac35fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:05.516684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea9bae-7479-4e5e-9393-42492ac35fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:05.520597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea9bae-7479-4e5e-9393-42492ac35fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:05.520597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea9bae-7479-4e5e-9393-42492ac35fe0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:05.532514 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 954/1921] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:58:05.535142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea9bae-7479-4e5e-9393-42492ac35fe0 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:05.547306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea9bae-7479-4e5e-9393-42492ac35fe0 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:05.552679 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f6235-04ef-4e95-aac6-150cdd7d703e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:05.553471 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f6235-04ef-4e95-aac6-150cdd7d703e admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:05.553890 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f6235-04ef-4e95-aac6-150cdd7d703e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:05.554239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f6235-04ef-4e95-aac6-150cdd7d703e admin admin] PATH_INFO: `/v3/projects/673098b2c75b4462b81b18d0266c0cc1/users/b19fe9a49ca6470796acaec5f10352cf/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:05.571162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f6235-04ef-4e95-aac6-150cdd7d703e admin admin] RBAC: Authorizing `identity:create_grant(project_id=673098b2c75b4462b81b18d0266c0cc1, user_id=b19fe9a49ca6470796acaec5f10352cf, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:05.575177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f6235-04ef-4e95-aac6-150cdd7d703e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:05.684129 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 955/1922] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:05 2022] PUT /identity/v3/projects/673098b2c75b4462b81b18d0266c0cc1/users/b19fe9a49ca6470796acaec5f10352cf/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:05.698691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda27f5-d21e-45b1-946b-5525e331468f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:05.699866 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda27f5-d21e-45b1-946b-5525e331468f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:05.700528 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda27f5-d21e-45b1-946b-5525e331468f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:05.711153 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-437927a7-564d-44c7-bc0c-c1b08a4be850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e56716e81044be5ab8524a8339524ea', 'request_id': 'req-437927a7-564d-44c7-bc0c-c1b08a4be850'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:05.724898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-437927a7-564d-44c7-bc0c-c1b08a4be850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e56716e81044be5ab8524a8339524ea', 'request_id': 'req-437927a7-564d-44c7-bc0c-c1b08a4be850'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:05.738358 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7bda27f5-d21e-45b1-946b-5525e331468f None None] MFA Rules not processed for user `b19fe9a49ca6470796acaec5f10352cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:05.739593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7bda27f5-d21e-45b1-946b-5525e331468f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:05.789908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-437927a7-564d-44c7-bc0c-c1b08a4be850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e56716e81044be5ab8524a8339524ea', 'request_id': 'req-437927a7-564d-44c7-bc0c-c1b08a4be850'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:05.803115 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-437927a7-564d-44c7-bc0c-c1b08a4be850 admin admin] The token cache is being invalidate because project 9e56716e81044be5ab8524a8339524ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:05.803413 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-437927a7-564d-44c7-bc0c-c1b08a4be850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:05.804056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-437927a7-564d-44c7-bc0c-c1b08a4be850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:05.809150 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 968/1923] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:05 2022] DELETE /identity/v3/projects/9e56716e81044be5ab8524a8339524ea => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:05.810784 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437927a7-564d-44c7-bc0c-c1b08a4be850 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:05.812179 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-437927a7-564d-44c7-bc0c-c1b08a4be850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:05.822127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 956/1924] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:05.831257 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda27f5-d21e-45b1-946b-5525e331468f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:05.906496 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437927a7-564d-44c7-bc0c-c1b08a4be850 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:05.912105 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bd47a-1b7a-43be-a1d6-42371ff24b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:05.913345 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bd47a-1b7a-43be-a1d6-42371ff24b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:05.913851 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bd47a-1b7a-43be-a1d6-42371ff24b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:05.914451 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bd47a-1b7a-43be-a1d6-42371ff24b92 admin admin] PATH_INFO: `/v3/users/ba63d207ad1041e7b0b4988e70eb2948` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:05.915827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bd47a-1b7a-43be-a1d6-42371ff24b92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba63d207ad1041e7b0b4988e70eb2948)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:05.918796 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bd47a-1b7a-43be-a1d6-42371ff24b92 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:05.922373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda27f5-d21e-45b1-946b-5525e331468f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:05.928957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847ddb3-96d1-4e0a-b0e5-9bc09f227cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:05.929874 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847ddb3-96d1-4e0a-b0e5-9bc09f227cea admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:05.930176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847ddb3-96d1-4e0a-b0e5-9bc09f227cea admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:05.931137 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847ddb3-96d1-4e0a-b0e5-9bc09f227cea admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:05.931723 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847ddb3-96d1-4e0a-b0e5-9bc09f227cea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:05.934481 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847ddb3-96d1-4e0a-b0e5-9bc09f227cea admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:06.009165 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 957/1925] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:05 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:06.013412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847ddb3-96d1-4e0a-b0e5-9bc09f227cea admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:06.015246 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1847ddb3-96d1-4e0a-b0e5-9bc09f227cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:06.081788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847ddb3-96d1-4e0a-b0e5-9bc09f227cea admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:06.086533 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310e8ed-4f4c-442b-9411-2c341957afb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:06.087147 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310e8ed-4f4c-442b-9411-2c341957afb9 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:06.095631 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310e8ed-4f4c-442b-9411-2c341957afb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:06.095631 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310e8ed-4f4c-442b-9411-2c341957afb9 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:06.095631 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310e8ed-4f4c-442b-9411-2c341957afb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:06.095631 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310e8ed-4f4c-442b-9411-2c341957afb9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:06.186645 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-422bd47a-1b7a-43be-a1d6-42371ff24b92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba63d207ad1041e7b0b4988e70eb2948'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:06.189981 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 958/1926] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:06 2022] POST /identity/v3/users => generated 295 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:06.194326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310e8ed-4f4c-442b-9411-2c341957afb9 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:06.204242 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310e8ed-4f4c-442b-9411-2c341957afb9 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:06.208859 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb90a0-ab42-4ba8-b75a-3394a1356f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:06.209482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb90a0-ab42-4ba8-b75a-3394a1356f80 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:06.209778 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb90a0-ab42-4ba8-b75a-3394a1356f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:06.210046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb90a0-ab42-4ba8-b75a-3394a1356f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:06.210687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb90a0-ab42-4ba8-b75a-3394a1356f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:06.212285 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb90a0-ab42-4ba8-b75a-3394a1356f80 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:06.226944 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 959/1927] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:58:06.227904 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb90a0-ab42-4ba8-b75a-3394a1356f80 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:06.238415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb90a0-ab42-4ba8-b75a-3394a1356f80 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:06.244967 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058206d-7f52-4078-be5c-9d94336d6df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:06.244967 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058206d-7f52-4078-be5c-9d94336d6df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:06.244967 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058206d-7f52-4078-be5c-9d94336d6df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:06.244967 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058206d-7f52-4078-be5c-9d94336d6df6 admin admin] PATH_INFO: `/v3/projects/b46275e0e2064c6a8ab2cbc1acd17773/users/37f561bd982b4a9f97dc96bc2474b767/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:06.259125 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058206d-7f52-4078-be5c-9d94336d6df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46275e0e2064c6a8ab2cbc1acd17773, user_id=37f561bd982b4a9f97dc96bc2474b767, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:06.261911 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058206d-7f52-4078-be5c-9d94336d6df6 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:06.298325 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-422bd47a-1b7a-43be-a1d6-42371ff24b92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba63d207ad1041e7b0b4988e70eb2948'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:06.298919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-422bd47a-1b7a-43be-a1d6-42371ff24b92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba63d207ad1041e7b0b4988e70eb2948'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:06.312338 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-422bd47a-1b7a-43be-a1d6-42371ff24b92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba63d207ad1041e7b0b4988e70eb2948'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:06.313120 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-422bd47a-1b7a-43be-a1d6-42371ff24b92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba63d207ad1041e7b0b4988e70eb2948'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:06.325783 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 969/1928] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:05 2022] DELETE /identity/v3/users/ba63d207ad1041e7b0b4988e70eb2948 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:06.400381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 960/1929] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:06 2022] PUT /identity/v3/projects/b46275e0e2064c6a8ab2cbc1acd17773/users/37f561bd982b4a9f97dc96bc2474b767/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:06.402115 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bd47a-1b7a-43be-a1d6-42371ff24b92 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:06.403612 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-422bd47a-1b7a-43be-a1d6-42371ff24b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:06.442237 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:06.475401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bd47a-1b7a-43be-a1d6-42371ff24b92 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:06.536227 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cfbb4-3c3f-4182-99b9-27b26c73646e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:06.537035 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cfbb4-3c3f-4182-99b9-27b26c73646e admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:06.537244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cfbb4-3c3f-4182-99b9-27b26c73646e admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:06.537595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cfbb4-3c3f-4182-99b9-27b26c73646e admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:06.538129 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cfbb4-3c3f-4182-99b9-27b26c73646e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:06.546155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cfbb4-3c3f-4182-99b9-27b26c73646e admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:06.559659 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 970/1930] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:58:06.573096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058206d-7f52-4078-be5c-9d94336d6df6 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:06.586977 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058206d-7f52-4078-be5c-9d94336d6df6 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:06.594156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff60fc-476a-4c57-b198-01b0d0e378b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:06.594156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff60fc-476a-4c57-b198-01b0d0e378b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:06.594156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff60fc-476a-4c57-b198-01b0d0e378b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:06.601156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff60fc-476a-4c57-b198-01b0d0e378b1 admin admin] PATH_INFO: `/v3/projects/b46275e0e2064c6a8ab2cbc1acd17773/users/37f561bd982b4a9f97dc96bc2474b767/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:06.601156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff60fc-476a-4c57-b198-01b0d0e378b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46275e0e2064c6a8ab2cbc1acd17773, user_id=37f561bd982b4a9f97dc96bc2474b767, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:06.601156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff60fc-476a-4c57-b198-01b0d0e378b1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:06.614038 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 961/1931] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:06 2022] PUT /identity/v3/projects/b46275e0e2064c6a8ab2cbc1acd17773/users/37f561bd982b4a9f97dc96bc2474b767/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:06.625341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dba3ef-46bd-4693-a4eb-130267d3efc3 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:06.625629 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dba3ef-46bd-4693-a4eb-130267d3efc3 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:06.625906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dba3ef-46bd-4693-a4eb-130267d3efc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:06.670839 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-a6dba3ef-46bd-4693-a4eb-130267d3efc3 None None] MFA Rules not processed for user `37f561bd982b4a9f97dc96bc2474b767`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:06.672478 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-a6dba3ef-46bd-4693-a4eb-130267d3efc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:06.751273 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 971/1932] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:06.765448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff60fc-476a-4c57-b198-01b0d0e378b1 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:06.767185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-97ff60fc-476a-4c57-b198-01b0d0e378b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:06.790486 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:06.824271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dba3ef-46bd-4693-a4eb-130267d3efc3 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:06.826685 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-a6dba3ef-46bd-4693-a4eb-130267d3efc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:06.862796 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff60fc-476a-4c57-b198-01b0d0e378b1 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:06.872647 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4228a4-f973-411a-b9cd-de1d1de9efe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:06.873377 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4228a4-f973-411a-b9cd-de1d1de9efe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:06.873729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4228a4-f973-411a-b9cd-de1d1de9efe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:06.874231 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4228a4-f973-411a-b9cd-de1d1de9efe6 admin admin] PATH_INFO: `/v3/projects/2e028afc3aff488cb993e0a4b53da2a7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:06.875502 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4228a4-f973-411a-b9cd-de1d1de9efe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e028afc3aff488cb993e0a4b53da2a7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:06.877589 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4228a4-f973-411a-b9cd-de1d1de9efe6 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:06.894996 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dba3ef-46bd-4693-a4eb-130267d3efc3 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:06.899428 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947b7cd-7cbf-47e3-941a-db2d997fa1a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:06.900054 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947b7cd-7cbf-47e3-941a-db2d997fa1a9 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:06.900327 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947b7cd-7cbf-47e3-941a-db2d997fa1a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:06.900688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947b7cd-7cbf-47e3-941a-db2d997fa1a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:06.911540 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947b7cd-7cbf-47e3-941a-db2d997fa1a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:06.913145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947b7cd-7cbf-47e3-941a-db2d997fa1a9 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:06.923722 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 972/1933] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:58:06.996836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5b4228a4-f973-411a-b9cd-de1d1de9efe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e028afc3aff488cb993e0a4b53da2a7', 'request_id': 'req-5b4228a4-f973-411a-b9cd-de1d1de9efe6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:07.003263 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5b4228a4-f973-411a-b9cd-de1d1de9efe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e028afc3aff488cb993e0a4b53da2a7', 'request_id': 'req-5b4228a4-f973-411a-b9cd-de1d1de9efe6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:07.034904 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947b7cd-7cbf-47e3-941a-db2d997fa1a9 service cinder] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:07.043998 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947b7cd-7cbf-47e3-941a-db2d997fa1a9 service cinder] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:07.092944 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5b4228a4-f973-411a-b9cd-de1d1de9efe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e028afc3aff488cb993e0a4b53da2a7', 'request_id': 'req-5b4228a4-f973-411a-b9cd-de1d1de9efe6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:07.105783 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5b4228a4-f973-411a-b9cd-de1d1de9efe6 admin admin] The token cache is being invalidate because project 2e028afc3aff488cb993e0a4b53da2a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:07.106120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5b4228a4-f973-411a-b9cd-de1d1de9efe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:07.106809 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5b4228a4-f973-411a-b9cd-de1d1de9efe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:07.108059 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdd51f-cf2f-433a-acd2-68576ada657e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:07.108587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 962/1934] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:06 2022] DELETE /identity/v3/projects/2e028afc3aff488cb993e0a4b53da2a7 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:07.112115 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdd51f-cf2f-433a-acd2-68576ada657e service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:07.112115 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdd51f-cf2f-433a-acd2-68576ada657e service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:07.112386 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdd51f-cf2f-433a-acd2-68576ada657e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:07.112862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4228a4-f973-411a-b9cd-de1d1de9efe6 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:07.114760 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5b4228a4-f973-411a-b9cd-de1d1de9efe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:07.115140 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-abbdd51f-cf2f-433a-acd2-68576ada657e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:07.199743 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4228a4-f973-411a-b9cd-de1d1de9efe6 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:07.206260 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b9a25-4017-4d35-8b27-f6e24bceb1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:07.207253 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b9a25-4017-4d35-8b27-f6e24bceb1ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:07.208186 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b9a25-4017-4d35-8b27-f6e24bceb1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:07.208186 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b9a25-4017-4d35-8b27-f6e24bceb1ea admin admin] PATH_INFO: `/v3/users/f7423603f31d49fba159670cff190afc` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:07.209577 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b9a25-4017-4d35-8b27-f6e24bceb1ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7423603f31d49fba159670cff190afc)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:07.212172 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b9a25-4017-4d35-8b27-f6e24bceb1ea admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:07.236909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdd51f-cf2f-433a-acd2-68576ada657e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:07.238364 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdd51f-cf2f-433a-acd2-68576ada657e service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:07.257857 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 973/1935] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:07.380102 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdd51f-cf2f-433a-acd2-68576ada657e service cinder] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:07.381635 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-abbdd51f-cf2f-433a-acd2-68576ada657e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:07.395862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdd51f-cf2f-433a-acd2-68576ada657e service cinder] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:07.401016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44603d03-8c27-4550-ab9c-f183454f582b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:07.401678 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44603d03-8c27-4550-ab9c-f183454f582b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:07.401962 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44603d03-8c27-4550-ab9c-f183454f582b admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:07.402238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44603d03-8c27-4550-ab9c-f183454f582b admin admin] PATH_INFO: `/v3/users/f5800e502fcd4262bcd5ec1b9b2c83cc` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:07.403413 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44603d03-8c27-4550-ab9c-f183454f582b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5800e502fcd4262bcd5ec1b9b2c83cc)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:07.405412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44603d03-8c27-4550-ab9c-f183454f582b admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:07.462338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-943b9a25-4017-4d35-8b27-f6e24bceb1ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7423603f31d49fba159670cff190afc'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:07.462831 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:07.556302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-943b9a25-4017-4d35-8b27-f6e24bceb1ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7423603f31d49fba159670cff190afc'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:07.557594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-943b9a25-4017-4d35-8b27-f6e24bceb1ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7423603f31d49fba159670cff190afc'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:07.558944 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-943b9a25-4017-4d35-8b27-f6e24bceb1ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7423603f31d49fba159670cff190afc'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:07.568251 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-943b9a25-4017-4d35-8b27-f6e24bceb1ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7423603f31d49fba159670cff190afc'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:07.586373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 963/1936] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:07 2022] DELETE /identity/v3/users/f7423603f31d49fba159670cff190afc => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:07.606378 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-44603d03-8c27-4550-ab9c-f183454f582b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5800e502fcd4262bcd5ec1b9b2c83cc'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:07.658420 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-44603d03-8c27-4550-ab9c-f183454f582b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5800e502fcd4262bcd5ec1b9b2c83cc'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:07.659288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-44603d03-8c27-4550-ab9c-f183454f582b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5800e502fcd4262bcd5ec1b9b2c83cc'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:07.673565 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-44603d03-8c27-4550-ab9c-f183454f582b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5800e502fcd4262bcd5ec1b9b2c83cc'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:07.674512 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-44603d03-8c27-4550-ab9c-f183454f582b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5800e502fcd4262bcd5ec1b9b2c83cc'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:07.682545 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:07.688700 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 974/1937] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:07 2022] DELETE /identity/v3/users/f5800e502fcd4262bcd5ec1b9b2c83cc => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:07.693647 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f4360-6504-4bd2-9d2e-978e4d0fd338 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:07.693940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f4360-6504-4bd2-9d2e-978e4d0fd338 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:07.694248 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f4360-6504-4bd2-9d2e-978e4d0fd338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:07.714571 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2d2f4360-6504-4bd2-9d2e-978e4d0fd338 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:07.715775 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2d2f4360-6504-4bd2-9d2e-978e4d0fd338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:07.785992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 964/1938] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:07.797061 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44603d03-8c27-4550-ab9c-f183454f582b admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:07.798562 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-44603d03-8c27-4550-ab9c-f183454f582b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:07.862421 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44603d03-8c27-4550-ab9c-f183454f582b admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:07.863831 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf3fa1-fc5f-4180-9d57-9404490ad14e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:07.864471 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf3fa1-fc5f-4180-9d57-9404490ad14e service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:07.864751 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf3fa1-fc5f-4180-9d57-9404490ad14e service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:07.865020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf3fa1-fc5f-4180-9d57-9404490ad14e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:07.874112 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf3fa1-fc5f-4180-9d57-9404490ad14e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:07.875604 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf3fa1-fc5f-4180-9d57-9404490ad14e service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:07.885318 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 975/1939] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:07.990556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f4360-6504-4bd2-9d2e-978e4d0fd338 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:07.994644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2d2f4360-6504-4bd2-9d2e-978e4d0fd338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:08.036281 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f4360-6504-4bd2-9d2e-978e4d0fd338 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:08.044014 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d756ba-6378-4fc5-94c3-2b7d4ba6396e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:08.045025 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d756ba-6378-4fc5-94c3-2b7d4ba6396e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:08.045236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d756ba-6378-4fc5-94c3-2b7d4ba6396e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:08.045652 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d756ba-6378-4fc5-94c3-2b7d4ba6396e admin admin] PATH_INFO: `/v3/projects/467e86e2ca6d4a8888e95f87c334c6f6` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:08.047511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d756ba-6378-4fc5-94c3-2b7d4ba6396e admin admin] RBAC: Authorizing `identity:delete_project(project_id=467e86e2ca6d4a8888e95f87c334c6f6)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:08.049746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d756ba-6378-4fc5-94c3-2b7d4ba6396e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:08.182453 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-05d756ba-6378-4fc5-94c3-2b7d4ba6396e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '467e86e2ca6d4a8888e95f87c334c6f6', 'request_id': 'req-05d756ba-6378-4fc5-94c3-2b7d4ba6396e'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:08.191972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-05d756ba-6378-4fc5-94c3-2b7d4ba6396e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '467e86e2ca6d4a8888e95f87c334c6f6', 'request_id': 'req-05d756ba-6378-4fc5-94c3-2b7d4ba6396e'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:08.235814 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:08.254521 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-05d756ba-6378-4fc5-94c3-2b7d4ba6396e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '467e86e2ca6d4a8888e95f87c334c6f6', 'request_id': 'req-05d756ba-6378-4fc5-94c3-2b7d4ba6396e'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:08.267456 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-05d756ba-6378-4fc5-94c3-2b7d4ba6396e admin admin] The token cache is being invalidate because project 467e86e2ca6d4a8888e95f87c334c6f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:08.268044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-05d756ba-6378-4fc5-94c3-2b7d4ba6396e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:08.268996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-05d756ba-6378-4fc5-94c3-2b7d4ba6396e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:08.272522 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 965/1940] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:07 2022] DELETE /identity/v3/projects/467e86e2ca6d4a8888e95f87c334c6f6 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:08.277146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e0111-73b4-4ca5-8308-5afc01f79c38 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:08.279110 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e0111-73b4-4ca5-8308-5afc01f79c38 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:08.279405 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e0111-73b4-4ca5-8308-5afc01f79c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:08.304796 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-b80e0111-73b4-4ca5-8308-5afc01f79c38 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:08.306153 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b80e0111-73b4-4ca5-8308-5afc01f79c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:08.388170 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 976/1941] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:08.396071 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47381798-a9a6-47ba-bbb3-dd9791c2fbda None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:08.396356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47381798-a9a6-47ba-bbb3-dd9791c2fbda None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:08.396659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47381798-a9a6-47ba-bbb3-dd9791c2fbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:08.437334 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-47381798-a9a6-47ba-bbb3-dd9791c2fbda None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:08.438743 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-47381798-a9a6-47ba-bbb3-dd9791c2fbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:08.450640 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 966/1942] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:08.454610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e0111-73b4-4ca5-8308-5afc01f79c38 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:08.466793 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e0111-73b4-4ca5-8308-5afc01f79c38 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:08.474896 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877979ab-6c1d-4f0c-81cb-07c81873c977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:08.475941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877979ab-6c1d-4f0c-81cb-07c81873c977 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:08.476248 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877979ab-6c1d-4f0c-81cb-07c81873c977 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:08.476570 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877979ab-6c1d-4f0c-81cb-07c81873c977 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:08.477640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877979ab-6c1d-4f0c-81cb-07c81873c977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:58:08.477947 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877979ab-6c1d-4f0c-81cb-07c81873c977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:08.481617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877979ab-6c1d-4f0c-81cb-07c81873c977 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:08.494924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47381798-a9a6-47ba-bbb3-dd9791c2fbda None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:08.496009 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 977/1943] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:58:08.497252 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-47381798-a9a6-47ba-bbb3-dd9791c2fbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:08.499879 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877979ab-6c1d-4f0c-81cb-07c81873c977 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:08.510495 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877979ab-6c1d-4f0c-81cb-07c81873c977 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:08.511033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47381798-a9a6-47ba-bbb3-dd9791c2fbda None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:08.517586 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc1010-e82e-4bd4-9e51-352d79c49526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:08.518244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc1010-e82e-4bd4-9e51-352d79c49526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:08.518522 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc1010-e82e-4bd4-9e51-352d79c49526 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:08.518797 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc1010-e82e-4bd4-9e51-352d79c49526 admin admin] PATH_INFO: `/v3/projects/1c262efba5e044cf85196910ffc94a3b` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:08.519022 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf3481-0d19-4bbb-a857-a31c883cfd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:08.520033 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf3481-0d19-4bbb-a857-a31c883cfd50 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:08.520460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc1010-e82e-4bd4-9e51-352d79c49526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c262efba5e044cf85196910ffc94a3b)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:08.520824 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf3481-0d19-4bbb-a857-a31c883cfd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:08.521265 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf3481-0d19-4bbb-a857-a31c883cfd50 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:08.522186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf3481-0d19-4bbb-a857-a31c883cfd50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:08.522681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc1010-e82e-4bd4-9e51-352d79c49526 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:08.525124 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf3481-0d19-4bbb-a857-a31c883cfd50 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:08.584176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:08.632494 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 978/1944] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:08 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:08.634576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf3481-0d19-4bbb-a857-a31c883cfd50 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:08.648962 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1ecc1010-e82e-4bd4-9e51-352d79c49526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c262efba5e044cf85196910ffc94a3b', 'request_id': 'req-1ecc1010-e82e-4bd4-9e51-352d79c49526'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:08.657825 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1ecc1010-e82e-4bd4-9e51-352d79c49526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c262efba5e044cf85196910ffc94a3b', 'request_id': 'req-1ecc1010-e82e-4bd4-9e51-352d79c49526'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:08.723954 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf3481-0d19-4bbb-a857-a31c883cfd50 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:08.728620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4ac60-b205-4df9-921d-63103425ee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:08.729797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4ac60-b205-4df9-921d-63103425ee42 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:08.730079 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4ac60-b205-4df9-921d-63103425ee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:08.730353 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4ac60-b205-4df9-921d-63103425ee42 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:08.730981 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4ac60-b205-4df9-921d-63103425ee42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:08.732924 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4ac60-b205-4df9-921d-63103425ee42 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:08.744258 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1ecc1010-e82e-4bd4-9e51-352d79c49526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c262efba5e044cf85196910ffc94a3b', 'request_id': 'req-1ecc1010-e82e-4bd4-9e51-352d79c49526'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:08.755297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1ecc1010-e82e-4bd4-9e51-352d79c49526 admin admin] The token cache is being invalidate because project 1c262efba5e044cf85196910ffc94a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:08.755564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:08.755671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1ecc1010-e82e-4bd4-9e51-352d79c49526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:08.756827 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1ecc1010-e82e-4bd4-9e51-352d79c49526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:08.758731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 967/1945] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:08 2022] DELETE /identity/v3/projects/1c262efba5e044cf85196910ffc94a3b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:08.762599 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc1010-e82e-4bd4-9e51-352d79c49526 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:08.764018 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1ecc1010-e82e-4bd4-9e51-352d79c49526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:08.801216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 979/1946] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:08 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:08.807159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4ac60-b205-4df9-921d-63103425ee42 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:08.808832 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0aa4ac60-b205-4df9-921d-63103425ee42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:08.821078 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4ac60-b205-4df9-921d-63103425ee42 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:08.826513 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764d0a9-1bab-4dfc-97a5-11a9b1b5d83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:08.827147 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764d0a9-1bab-4dfc-97a5-11a9b1b5d83b admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:08.827429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764d0a9-1bab-4dfc-97a5-11a9b1b5d83b admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:08.827705 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764d0a9-1bab-4dfc-97a5-11a9b1b5d83b admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:08.828347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764d0a9-1bab-4dfc-97a5-11a9b1b5d83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:08.830544 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764d0a9-1bab-4dfc-97a5-11a9b1b5d83b admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:08.830661 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc1010-e82e-4bd4-9e51-352d79c49526 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:08.834777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1c2da-d6de-46fa-8b48-df01376922b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:08.835408 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1c2da-d6de-46fa-8b48-df01376922b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:08.835682 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1c2da-d6de-46fa-8b48-df01376922b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:08.835950 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1c2da-d6de-46fa-8b48-df01376922b6 admin admin] PATH_INFO: `/v3/users/f5b8265730d94089a4199e052c3edf42` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:08.837154 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1c2da-d6de-46fa-8b48-df01376922b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5b8265730d94089a4199e052c3edf42)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:08.839663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1c2da-d6de-46fa-8b48-df01376922b6 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:08.840517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 980/1947] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:58:08.844358 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764d0a9-1bab-4dfc-97a5-11a9b1b5d83b admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:08.853945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764d0a9-1bab-4dfc-97a5-11a9b1b5d83b admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:08.858563 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd352c7-381a-43ba-8400-68fe0e5f3883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:08.859157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd352c7-381a-43ba-8400-68fe0e5f3883 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:08.859436 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd352c7-381a-43ba-8400-68fe0e5f3883 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:08.859727 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd352c7-381a-43ba-8400-68fe0e5f3883 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:08.860346 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd352c7-381a-43ba-8400-68fe0e5f3883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:08.861986 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd352c7-381a-43ba-8400-68fe0e5f3883 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:08.872769 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 981/1948] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:58:08.876785 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd352c7-381a-43ba-8400-68fe0e5f3883 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:08.886816 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd352c7-381a-43ba-8400-68fe0e5f3883 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:08.891630 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850e32a-85c6-4617-930a-4fde9e150657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:08.892200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850e32a-85c6-4617-930a-4fde9e150657 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:08.892581 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850e32a-85c6-4617-930a-4fde9e150657 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:08.892861 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850e32a-85c6-4617-930a-4fde9e150657 admin admin] PATH_INFO: `/v3/projects/1257b44b574d4160861696311e299356/users/9196e7d626ec432a9a7ccea2f8af49a1/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:08.908661 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850e32a-85c6-4617-930a-4fde9e150657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1257b44b574d4160861696311e299356, user_id=9196e7d626ec432a9a7ccea2f8af49a1, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:08.911312 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850e32a-85c6-4617-930a-4fde9e150657 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:09.008940 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 982/1949] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:08 2022] PUT /identity/v3/projects/1257b44b574d4160861696311e299356/users/9196e7d626ec432a9a7ccea2f8af49a1/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:09.012450 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9aaf7-3d75-473f-90ef-a8851401d5a8 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:09.012837 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9aaf7-3d75-473f-90ef-a8851401d5a8 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:09.013012 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9aaf7-3d75-473f-90ef-a8851401d5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:09.034875 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-71e1c2da-d6de-46fa-8b48-df01376922b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5b8265730d94089a4199e052c3edf42'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:09.081785 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-1bd9aaf7-3d75-473f-90ef-a8851401d5a8 None None] MFA Rules not processed for user `9196e7d626ec432a9a7ccea2f8af49a1`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:09.083122 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1bd9aaf7-3d75-473f-90ef-a8851401d5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:09.122155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-71e1c2da-d6de-46fa-8b48-df01376922b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5b8265730d94089a4199e052c3edf42'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:09.123287 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-71e1c2da-d6de-46fa-8b48-df01376922b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5b8265730d94089a4199e052c3edf42'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:09.124592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-71e1c2da-d6de-46fa-8b48-df01376922b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5b8265730d94089a4199e052c3edf42'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:09.134809 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-71e1c2da-d6de-46fa-8b48-df01376922b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5b8265730d94089a4199e052c3edf42'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:09.153809 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 983/1950] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:09.160771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9aaf7-3d75-473f-90ef-a8851401d5a8 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:09.162156 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1bd9aaf7-3d75-473f-90ef-a8851401d5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:09.172078 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 968/1951] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:08 2022] DELETE /identity/v3/users/f5b8265730d94089a4199e052c3edf42 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:09.216052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:09.249816 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9aaf7-3d75-473f-90ef-a8851401d5a8 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:09.323317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b07ca7-89de-48db-a1d4-76c261d31474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:09.323940 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b07ca7-89de-48db-a1d4-76c261d31474 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:09.324873 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b07ca7-89de-48db-a1d4-76c261d31474 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:09.325417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b07ca7-89de-48db-a1d4-76c261d31474 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:09.325898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b07ca7-89de-48db-a1d4-76c261d31474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:09.327816 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b07ca7-89de-48db-a1d4-76c261d31474 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:09.426461 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1c2da-d6de-46fa-8b48-df01376922b6 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:09.431653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 984/1952] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:09 2022] POST /identity/v3/projects => generated 385 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:09.437618 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1c2da-d6de-46fa-8b48-df01376922b6 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:09.532682 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d3634-4a29-45d6-adb9-4749e8359f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:09.533242 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d3634-4a29-45d6-adb9-4749e8359f3b admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:09.533433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d3634-4a29-45d6-adb9-4749e8359f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:09.536684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d3634-4a29-45d6-adb9-4749e8359f3b admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:09.537929 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d3634-4a29-45d6-adb9-4749e8359f3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:09.540862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d3634-4a29-45d6-adb9-4749e8359f3b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:09.696884 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 969/1953] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:09 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:09.698428 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b07ca7-89de-48db-a1d4-76c261d31474 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:09.710724 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b07ca7-89de-48db-a1d4-76c261d31474 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:09.724624 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c58c99-9278-41e9-9eec-9535b9df07a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:09.724624 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c58c99-9278-41e9-9eec-9535b9df07a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:09.724624 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c58c99-9278-41e9-9eec-9535b9df07a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:09.724624 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c58c99-9278-41e9-9eec-9535b9df07a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:09.725186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c58c99-9278-41e9-9eec-9535b9df07a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:09.725186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c58c99-9278-41e9-9eec-9535b9df07a0 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:09.748540 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 985/1954] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:09.752684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d3634-4a29-45d6-adb9-4749e8359f3b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:09.771073 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c58c99-9278-41e9-9eec-9535b9df07a0 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:09.773240 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e6c58c99-9278-41e9-9eec-9535b9df07a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:09.775181 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d3634-4a29-45d6-adb9-4749e8359f3b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:09.785213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e55460-c632-41b8-8bdb-f51b9ac35936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:09.785923 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e55460-c632-41b8-8bdb-f51b9ac35936 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:09.790067 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e55460-c632-41b8-8bdb-f51b9ac35936 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:09.790373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e55460-c632-41b8-8bdb-f51b9ac35936 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:09.791746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e55460-c632-41b8-8bdb-f51b9ac35936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:09.797751 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e55460-c632-41b8-8bdb-f51b9ac35936 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:09.800388 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c58c99-9278-41e9-9eec-9535b9df07a0 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:09.821726 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00560059-0b0e-4000-b170-25b3199c25d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:09.822486 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00560059-0b0e-4000-b170-25b3199c25d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:09.822899 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00560059-0b0e-4000-b170-25b3199c25d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:09.823176 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00560059-0b0e-4000-b170-25b3199c25d7 admin admin] PATH_INFO: `/v3/projects/ae062e33fe194e6bb25b76f9f753b0d1` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:09.824684 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00560059-0b0e-4000-b170-25b3199c25d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae062e33fe194e6bb25b76f9f753b0d1)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:09.829142 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00560059-0b0e-4000-b170-25b3199c25d7 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:09.832134 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 970/1955] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:09.837149 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:09.838981 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e55460-c632-41b8-8bdb-f51b9ac35936 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:09.863381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e55460-c632-41b8-8bdb-f51b9ac35936 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:09.876901 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f5b1f-7973-4fa3-9e91-a130b079dd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:09.877905 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f5b1f-7973-4fa3-9e91-a130b079dd9b admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:09.878251 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f5b1f-7973-4fa3-9e91-a130b079dd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:09.878538 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f5b1f-7973-4fa3-9e91-a130b079dd9b admin admin] PATH_INFO: `/v3/projects/e5271f35fbea4389a3b70c87a28a60a8/users/9f28ca08d0c941d18ffa4cf3dea3d7fc/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:09.898375 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f5b1f-7973-4fa3-9e91-a130b079dd9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5271f35fbea4389a3b70c87a28a60a8, user_id=9f28ca08d0c941d18ffa4cf3dea3d7fc, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:09.901538 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f5b1f-7973-4fa3-9e91-a130b079dd9b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:09.961949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 971/1956] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:09 2022] PUT /identity/v3/projects/e5271f35fbea4389a3b70c87a28a60a8/users/9f28ca08d0c941d18ffa4cf3dea3d7fc/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:09.972059 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b21384-656d-4ac5-9229-d5d90f2fbcd4 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:09.972352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b21384-656d-4ac5-9229-d5d90f2fbcd4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:09.972654 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b21384-656d-4ac5-9229-d5d90f2fbcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:09.999155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-00560059-0b0e-4000-b170-25b3199c25d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae062e33fe194e6bb25b76f9f753b0d1', 'request_id': 'req-00560059-0b0e-4000-b170-25b3199c25d7'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:10.009643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-00560059-0b0e-4000-b170-25b3199c25d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae062e33fe194e6bb25b76f9f753b0d1', 'request_id': 'req-00560059-0b0e-4000-b170-25b3199c25d7'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:10.024943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-77b21384-656d-4ac5-9229-d5d90f2fbcd4 None None] MFA Rules not processed for user `9f28ca08d0c941d18ffa4cf3dea3d7fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:10.026828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-77b21384-656d-4ac5-9229-d5d90f2fbcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:10.099520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 972/1957] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:10.104602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b21384-656d-4ac5-9229-d5d90f2fbcd4 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:10.145621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-00560059-0b0e-4000-b170-25b3199c25d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae062e33fe194e6bb25b76f9f753b0d1', 'request_id': 'req-00560059-0b0e-4000-b170-25b3199c25d7'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:10.161823 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-00560059-0b0e-4000-b170-25b3199c25d7 admin admin] The token cache is being invalidate because project ae062e33fe194e6bb25b76f9f753b0d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:10.162187 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-00560059-0b0e-4000-b170-25b3199c25d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:10.163033 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-00560059-0b0e-4000-b170-25b3199c25d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:10.168620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 986/1958] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:09 2022] DELETE /identity/v3/projects/ae062e33fe194e6bb25b76f9f753b0d1 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:10.170124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b21384-656d-4ac5-9229-d5d90f2fbcd4 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:10.171043 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94fc4e-cc4a-4ddb-a1b0-e17cb973e9bb None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:10.171396 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94fc4e-cc4a-4ddb-a1b0-e17cb973e9bb None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:10.171754 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94fc4e-cc4a-4ddb-a1b0-e17cb973e9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:10.175083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a7df0-086a-482a-b9db-df2f7c9e0988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:10.175695 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a7df0-086a-482a-b9db-df2f7c9e0988 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:10.175977 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a7df0-086a-482a-b9db-df2f7c9e0988 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:10.176256 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a7df0-086a-482a-b9db-df2f7c9e0988 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:10.176930 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a7df0-086a-482a-b9db-df2f7c9e0988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:10.179110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a7df0-086a-482a-b9db-df2f7c9e0988 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:10.192670 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-1c94fc4e-cc4a-4ddb-a1b0-e17cb973e9bb None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:10.194437 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1c94fc4e-cc4a-4ddb-a1b0-e17cb973e9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:10.203059 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 987/1959] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:10.210594 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44712217-b16f-4e01-bcb4-6fa88296928b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:10.210880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44712217-b16f-4e01-bcb4-6fa88296928b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:10.211157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44712217-b16f-4e01-bcb4-6fa88296928b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:10.230767 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-44712217-b16f-4e01-bcb4-6fa88296928b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:10.231947 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-44712217-b16f-4e01-bcb4-6fa88296928b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:10.240748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 988/1960] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:10.245006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44712217-b16f-4e01-bcb4-6fa88296928b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:10.254207 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44712217-b16f-4e01-bcb4-6fa88296928b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:10.265731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 973/1961] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:10 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:10.270633 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a7df0-086a-482a-b9db-df2f7c9e0988 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:10.271310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f210fd2-06fa-4d48-84a2-4e88ee2d13d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:10.272545 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c94a7df0-086a-482a-b9db-df2f7c9e0988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:10.272876 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f210fd2-06fa-4d48-84a2-4e88ee2d13d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:10.274159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f210fd2-06fa-4d48-84a2-4e88ee2d13d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:10.274733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f210fd2-06fa-4d48-84a2-4e88ee2d13d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:10.284626 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f210fd2-06fa-4d48-84a2-4e88ee2d13d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:58:10.284626 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f210fd2-06fa-4d48-84a2-4e88ee2d13d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:10.284626 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f210fd2-06fa-4d48-84a2-4e88ee2d13d6 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:10.295922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 989/1962] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:58:10.310680 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f210fd2-06fa-4d48-84a2-4e88ee2d13d6 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:10.321206 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f210fd2-06fa-4d48-84a2-4e88ee2d13d6 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:10.345389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a7df0-086a-482a-b9db-df2f7c9e0988 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:10.350091 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967e94f-a853-4335-88de-be3902d4a257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:10.350703 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967e94f-a853-4335-88de-be3902d4a257 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:10.350981 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967e94f-a853-4335-88de-be3902d4a257 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:10.351256 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967e94f-a853-4335-88de-be3902d4a257 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:10.351899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967e94f-a853-4335-88de-be3902d4a257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:10.354452 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967e94f-a853-4335-88de-be3902d4a257 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:10.380438 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9d374-1f22-45ef-abdb-aef60870346c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:10.381179 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9d374-1f22-45ef-abdb-aef60870346c admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:10.381553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9d374-1f22-45ef-abdb-aef60870346c admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:10.381889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9d374-1f22-45ef-abdb-aef60870346c admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:10.382639 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9d374-1f22-45ef-abdb-aef60870346c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:10.384639 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9d374-1f22-45ef-abdb-aef60870346c admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:10.464205 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 974/1963] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:10 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:10.468115 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967e94f-a853-4335-88de-be3902d4a257 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:10.477565 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967e94f-a853-4335-88de-be3902d4a257 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:10.482943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e13b4-7bf8-42da-a60c-04c98c0704e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:10.484732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e13b4-7bf8-42da-a60c-04c98c0704e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:10.484732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e13b4-7bf8-42da-a60c-04c98c0704e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:10.484732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e13b4-7bf8-42da-a60c-04c98c0704e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:10.484732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e13b4-7bf8-42da-a60c-04c98c0704e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:10.486296 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e13b4-7bf8-42da-a60c-04c98c0704e5 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:10.496507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 975/1964] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:58:10.500308 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e13b4-7bf8-42da-a60c-04c98c0704e5 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:10.507958 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:10.513830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e13b4-7bf8-42da-a60c-04c98c0704e5 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:10.519440 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 990/1965] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:10 2022] POST /identity/v3/projects => generated 381 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:10.520515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9d374-1f22-45ef-abdb-aef60870346c admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:10.580213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b5153-b310-43b0-98fe-4b9cd78bbd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:10.580920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b5153-b310-43b0-98fe-4b9cd78bbd5d admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:10.581201 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b5153-b310-43b0-98fe-4b9cd78bbd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:10.581471 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b5153-b310-43b0-98fe-4b9cd78bbd5d admin admin] PATH_INFO: `/v3/projects/6281abe07a064272935ce733dd5ba265/users/7b501f232162427bacf4f1a61b37c6e2/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:10.597948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9d374-1f22-45ef-abdb-aef60870346c admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:10.598200 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b5153-b310-43b0-98fe-4b9cd78bbd5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6281abe07a064272935ce733dd5ba265, user_id=7b501f232162427bacf4f1a61b37c6e2, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:10.600932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b5153-b310-43b0-98fe-4b9cd78bbd5d admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:10.602766 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074733b4-d9fc-4c4e-95b0-c7b9dcdb4685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:10.603388 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074733b4-d9fc-4c4e-95b0-c7b9dcdb4685 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:10.604254 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074733b4-d9fc-4c4e-95b0-c7b9dcdb4685 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:10.604561 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074733b4-d9fc-4c4e-95b0-c7b9dcdb4685 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:10.605251 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074733b4-d9fc-4c4e-95b0-c7b9dcdb4685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:10.607226 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074733b4-d9fc-4c4e-95b0-c7b9dcdb4685 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:10.665901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 991/1966] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:10 2022] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:10.670324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 976/1967] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:10 2022] PUT /identity/v3/projects/6281abe07a064272935ce733dd5ba265/users/7b501f232162427bacf4f1a61b37c6e2/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:10.670929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074733b4-d9fc-4c4e-95b0-c7b9dcdb4685 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:10.671911 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b5153-b310-43b0-98fe-4b9cd78bbd5d admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:10.684024 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074733b4-d9fc-4c4e-95b0-c7b9dcdb4685 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:10.746137 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b5153-b310-43b0-98fe-4b9cd78bbd5d admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:10.751181 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0295db2-0e03-4a42-b2ad-437021be7433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:10.751812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0295db2-0e03-4a42-b2ad-437021be7433 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:10.752081 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0295db2-0e03-4a42-b2ad-437021be7433 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:10.752351 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0295db2-0e03-4a42-b2ad-437021be7433 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:10.753070 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0295db2-0e03-4a42-b2ad-437021be7433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:10.754701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0295db2-0e03-4a42-b2ad-437021be7433 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:10.765257 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 977/1968] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:10.766988 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5a2b0-ccc8-4e5c-ac28-10091efb724c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:10.767638 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5a2b0-ccc8-4e5c-ac28-10091efb724c admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:10.768002 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5a2b0-ccc8-4e5c-ac28-10091efb724c admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:10.768275 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5a2b0-ccc8-4e5c-ac28-10091efb724c admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:10.768951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5a2b0-ccc8-4e5c-ac28-10091efb724c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:10.769148 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0295db2-0e03-4a42-b2ad-437021be7433 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:10.770806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5a2b0-ccc8-4e5c-ac28-10091efb724c admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:10.780501 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0295db2-0e03-4a42-b2ad-437021be7433 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:10.787244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbdcbe-3009-4991-b6ea-1428d86cd6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:10.787929 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbdcbe-3009-4991-b6ea-1428d86cd6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:10.788467 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbdcbe-3009-4991-b6ea-1428d86cd6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:10.788808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbdcbe-3009-4991-b6ea-1428d86cd6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:10.788936 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 992/1969] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:10.789567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbdcbe-3009-4991-b6ea-1428d86cd6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:10.789683 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5a2b0-ccc8-4e5c-ac28-10091efb724c admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:10.791875 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbdcbe-3009-4991-b6ea-1428d86cd6a2 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:10.801363 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5a2b0-ccc8-4e5c-ac28-10091efb724c admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:10.804522 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 978/1970] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:10.806477 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8b84e-6df4-4564-b609-8716691e3980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:10.807551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8b84e-6df4-4564-b609-8716691e3980 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:10.807819 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8b84e-6df4-4564-b609-8716691e3980 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:10.808089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8b84e-6df4-4564-b609-8716691e3980 admin admin] PATH_INFO: `/v3/projects/6281abe07a064272935ce733dd5ba265/users/7b501f232162427bacf4f1a61b37c6e2/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:10.808383 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbdcbe-3009-4991-b6ea-1428d86cd6a2 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:10.810313 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8b84e-6df4-4564-b609-8716691e3980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6281abe07a064272935ce733dd5ba265, user_id=7b501f232162427bacf4f1a61b37c6e2, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:10.813191 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8b84e-6df4-4564-b609-8716691e3980 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:10.819280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbdcbe-3009-4991-b6ea-1428d86cd6a2 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:10.827348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 993/1971] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:10 2022] PUT /identity/v3/projects/6281abe07a064272935ce733dd5ba265/users/7b501f232162427bacf4f1a61b37c6e2/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:10.844136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bc2c8-0f17-45a6-a4ca-2f1800720c6e None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:10.844464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bc2c8-0f17-45a6-a4ca-2f1800720c6e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:10.844794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bc2c8-0f17-45a6-a4ca-2f1800720c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:10.878952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-dc1bc2c8-0f17-45a6-a4ca-2f1800720c6e None None] MFA Rules not processed for user `7b501f232162427bacf4f1a61b37c6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:10.880917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-dc1bc2c8-0f17-45a6-a4ca-2f1800720c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:10.884833 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017dc70-48bd-4785-ba34-6d6231ddb019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:10.885611 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017dc70-48bd-4785-ba34-6d6231ddb019 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:10.885820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017dc70-48bd-4785-ba34-6d6231ddb019 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:10.886057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017dc70-48bd-4785-ba34-6d6231ddb019 admin admin] PATH_INFO: `/v3/projects/54062e419e0a4c97af697347a7df87da/users/57a35cc676ea46ccbc96731a5651e213/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:10.905145 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017dc70-48bd-4785-ba34-6d6231ddb019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54062e419e0a4c97af697347a7df87da, user_id=57a35cc676ea46ccbc96731a5651e213, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:10.908241 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017dc70-48bd-4785-ba34-6d6231ddb019 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:10.939190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:10.979339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 994/1972] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:10.990760 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bc2c8-0f17-45a6-a4ca-2f1800720c6e None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:10.992201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-dc1bc2c8-0f17-45a6-a4ca-2f1800720c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:11.031957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 979/1973] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:10 2022] PUT /identity/v3/projects/54062e419e0a4c97af697347a7df87da/users/57a35cc676ea46ccbc96731a5651e213/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:11.043833 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97394189-13da-4867-9ae4-e730036bebe4 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:11.044234 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97394189-13da-4867-9ae4-e730036bebe4 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:11.044632 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97394189-13da-4867-9ae4-e730036bebe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:11.057226 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bc2c8-0f17-45a6-a4ca-2f1800720c6e None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:11.101176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-97394189-13da-4867-9ae4-e730036bebe4 None None] MFA Rules not processed for user `57a35cc676ea46ccbc96731a5651e213`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:11.102422 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-97394189-13da-4867-9ae4-e730036bebe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:11.135572 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dec7b-3f39-4e1a-b0e2-3c08b9a0748a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:11.136226 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dec7b-3f39-4e1a-b0e2-3c08b9a0748a service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:11.136688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dec7b-3f39-4e1a-b0e2-3c08b9a0748a service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:11.136961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3dec7b-3f39-4e1a-b0e2-3c08b9a0748a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:11.143692 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-bc3dec7b-3f39-4e1a-b0e2-3c08b9a0748a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:11.213990 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 980/1974] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:11.223986 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97394189-13da-4867-9ae4-e730036bebe4 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:11.252912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3dec7b-3f39-4e1a-b0e2-3c08b9a0748a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:11.254368 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3dec7b-3f39-4e1a-b0e2-3c08b9a0748a service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:11.268467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 995/1975] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:58:11.325327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97394189-13da-4867-9ae4-e730036bebe4 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:11.330725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf02356-93d2-41d5-9355-7803b5166dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:11.331569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf02356-93d2-41d5-9355-7803b5166dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:11.331851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf02356-93d2-41d5-9355-7803b5166dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:11.332125 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf02356-93d2-41d5-9355-7803b5166dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:11.332854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf02356-93d2-41d5-9355-7803b5166dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:11.335911 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf02356-93d2-41d5-9355-7803b5166dc2 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:11.352853 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:11.408073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:11.477023 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 981/1976] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:11 2022] POST /identity/v3/projects => generated 381 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:11.480727 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dec7b-3f39-4e1a-b0e2-3c08b9a0748a service cinder] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:11.502108 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3dec7b-3f39-4e1a-b0e2-3c08b9a0748a service cinder] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:11.583380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe4985-20d9-4c06-bef5-51d5a4b6ee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:11.583979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe4985-20d9-4c06-bef5-51d5a4b6ee49 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:11.584261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe4985-20d9-4c06-bef5-51d5a4b6ee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:11.584572 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe4985-20d9-4c06-bef5-51d5a4b6ee49 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:11.585229 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe4985-20d9-4c06-bef5-51d5a4b6ee49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:11.587173 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe4985-20d9-4c06-bef5-51d5a4b6ee49 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:11.718825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 996/1977] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:11 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:11.720929 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf02356-93d2-41d5-9355-7803b5166dc2 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:11.732618 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf02356-93d2-41d5-9355-7803b5166dc2 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:11.738104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72994d-5093-47a1-814d-fabdff603fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:11.738411 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72994d-5093-47a1-814d-fabdff603fbd admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:11.738699 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72994d-5093-47a1-814d-fabdff603fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:11.738976 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72994d-5093-47a1-814d-fabdff603fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:11.739757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72994d-5093-47a1-814d-fabdff603fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:11.743310 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72994d-5093-47a1-814d-fabdff603fbd admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:11.760455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 982/1978] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:58:11.764283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe4985-20d9-4c06-bef5-51d5a4b6ee49 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:11.775820 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe4985-20d9-4c06-bef5-51d5a4b6ee49 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:11.781284 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a4a0d-8514-4457-b551-34a7c9a7b53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:11.782126 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a4a0d-8514-4457-b551-34a7c9a7b53c admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:11.782476 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a4a0d-8514-4457-b551-34a7c9a7b53c admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:11.782830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a4a0d-8514-4457-b551-34a7c9a7b53c admin admin] PATH_INFO: `/v3/projects/4f125aca50ea4352a62bcddf321c6de4/users/6b596289619940bd9c1f162be61ba2a3/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:11.801244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a4a0d-8514-4457-b551-34a7c9a7b53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f125aca50ea4352a62bcddf321c6de4, user_id=6b596289619940bd9c1f162be61ba2a3, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:11.803958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a4a0d-8514-4457-b551-34a7c9a7b53c admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:11.864128 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 997/1979] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:11 2022] PUT /identity/v3/projects/4f125aca50ea4352a62bcddf321c6de4/users/6b596289619940bd9c1f162be61ba2a3/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:11.868333 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72994d-5093-47a1-814d-fabdff603fbd admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:11.878462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72994d-5093-47a1-814d-fabdff603fbd admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:11.934878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a4a0d-8514-4457-b551-34a7c9a7b53c admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:11.937264 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-217a4a0d-8514-4457-b551-34a7c9a7b53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:11.950688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889734d-5514-4317-ad7f-fa6585f0444f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:11.951648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889734d-5514-4317-ad7f-fa6585f0444f admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:11.952054 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889734d-5514-4317-ad7f-fa6585f0444f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:11.952450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889734d-5514-4317-ad7f-fa6585f0444f admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:11.953501 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889734d-5514-4317-ad7f-fa6585f0444f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:11.955370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889734d-5514-4317-ad7f-fa6585f0444f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:11.970337 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 983/1980] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:11.971663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889734d-5514-4317-ad7f-fa6585f0444f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:11.974514 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:11.981555 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889734d-5514-4317-ad7f-fa6585f0444f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:11.986213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68731ed-313e-4c06-adfa-ba27a6ed1a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:11.986955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68731ed-313e-4c06-adfa-ba27a6ed1a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:11.987304 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68731ed-313e-4c06-adfa-ba27a6ed1a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:11.987645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68731ed-313e-4c06-adfa-ba27a6ed1a5c admin admin] PATH_INFO: `/v3/projects/4f125aca50ea4352a62bcddf321c6de4/users/6b596289619940bd9c1f162be61ba2a3/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:11.989671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68731ed-313e-4c06-adfa-ba27a6ed1a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f125aca50ea4352a62bcddf321c6de4, user_id=6b596289619940bd9c1f162be61ba2a3, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:11.992450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68731ed-313e-4c06-adfa-ba27a6ed1a5c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:12.007000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 984/1981] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:11 2022] PUT /identity/v3/projects/4f125aca50ea4352a62bcddf321c6de4/users/6b596289619940bd9c1f162be61ba2a3/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:12.018627 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99210ad8-48f9-4a4c-87c5-74af872b9ce0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:12.018919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99210ad8-48f9-4a4c-87c5-74af872b9ce0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:12.019311 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99210ad8-48f9-4a4c-87c5-74af872b9ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:12.023805 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:12.028415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a4a0d-8514-4457-b551-34a7c9a7b53c admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:12.052548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-99210ad8-48f9-4a4c-87c5-74af872b9ce0 None None] MFA Rules not processed for user `6b596289619940bd9c1f162be61ba2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:12.052973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-99210ad8-48f9-4a4c-87c5-74af872b9ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:12.096035 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14834f-fe13-4500-aa1d-792a0998077f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:12.096907 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14834f-fe13-4500-aa1d-792a0998077f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:12.097073 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14834f-fe13-4500-aa1d-792a0998077f admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:12.098059 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14834f-fe13-4500-aa1d-792a0998077f admin admin] PATH_INFO: `/v3/users/97d8b4e4282c41498c02ccafa8b85c9b` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:12.098704 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14834f-fe13-4500-aa1d-792a0998077f admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d8b4e4282c41498c02ccafa8b85c9b)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:12.100817 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14834f-fe13-4500-aa1d-792a0998077f admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:12.157639 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 985/1982] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:12.161981 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99210ad8-48f9-4a4c-87c5-74af872b9ce0 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:12.218436 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99210ad8-48f9-4a4c-87c5-74af872b9ce0 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:12.222142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841d9e5-651c-4094-9026-a847a474bcc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:12.225773 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841d9e5-651c-4094-9026-a847a474bcc7 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:12.225773 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841d9e5-651c-4094-9026-a847a474bcc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:12.225773 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841d9e5-651c-4094-9026-a847a474bcc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:12.232760 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841d9e5-651c-4094-9026-a847a474bcc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:12.234226 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841d9e5-651c-4094-9026-a847a474bcc7 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:12.244519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 986/1983] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:12.247267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:12.255488 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-fa14834f-fe13-4500-aa1d-792a0998077f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d8b4e4282c41498c02ccafa8b85c9b'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:12.275409 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:12.315615 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-fa14834f-fe13-4500-aa1d-792a0998077f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d8b4e4282c41498c02ccafa8b85c9b'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:12.316266 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-fa14834f-fe13-4500-aa1d-792a0998077f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d8b4e4282c41498c02ccafa8b85c9b'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:12.331416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-fa14834f-fe13-4500-aa1d-792a0998077f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d8b4e4282c41498c02ccafa8b85c9b'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:12.332215 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-fa14834f-fe13-4500-aa1d-792a0998077f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d8b4e4282c41498c02ccafa8b85c9b'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:12.345649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 998/1984] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:11 2022] DELETE /identity/v3/users/97d8b4e4282c41498c02ccafa8b85c9b => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:12.350374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf11e6-4ffe-4beb-aa6c-1496b283d426 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:12.350661 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf11e6-4ffe-4beb-aa6c-1496b283d426 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:12.350944 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf11e6-4ffe-4beb-aa6c-1496b283d426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:12.370095 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-85cf11e6-4ffe-4beb-aa6c-1496b283d426 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:12.371297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-85cf11e6-4ffe-4beb-aa6c-1496b283d426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:12.432633 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 987/1985] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:12.442982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14834f-fe13-4500-aa1d-792a0998077f admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:12.444458 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-fa14834f-fe13-4500-aa1d-792a0998077f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:12.504054 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14834f-fe13-4500-aa1d-792a0998077f admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:12.507690 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607c0bf-4ea4-46da-930f-e97a2533d228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:12.508302 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607c0bf-4ea4-46da-930f-e97a2533d228 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:12.508635 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607c0bf-4ea4-46da-930f-e97a2533d228 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:12.508913 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607c0bf-4ea4-46da-930f-e97a2533d228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:12.515339 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:12.518489 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607c0bf-4ea4-46da-930f-e97a2533d228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:12.519907 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607c0bf-4ea4-46da-930f-e97a2533d228 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:12.529753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 999/1986] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:58:12.618588 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:13.035664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:13.071489 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf11e6-4ffe-4beb-aa6c-1496b283d426 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:13.073370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-85cf11e6-4ffe-4beb-aa6c-1496b283d426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:13.087158 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf11e6-4ffe-4beb-aa6c-1496b283d426 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:13.094668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12456db4-61ca-4c12-bfc1-253b2c118a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:13.095354 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12456db4-61ca-4c12-bfc1-253b2c118a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:13.095840 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12456db4-61ca-4c12-bfc1-253b2c118a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:13.096315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12456db4-61ca-4c12-bfc1-253b2c118a08 admin admin] PATH_INFO: `/v3/projects/b779eba6be02430686412ba9d85ad0ef` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:13.097550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12456db4-61ca-4c12-bfc1-253b2c118a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b779eba6be02430686412ba9d85ad0ef)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:13.099782 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12456db4-61ca-4c12-bfc1-253b2c118a08 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:13.177390 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607c0bf-4ea4-46da-930f-e97a2533d228 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:13.179353 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0607c0bf-4ea4-46da-930f-e97a2533d228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:13.223896 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-12456db4-61ca-4c12-bfc1-253b2c118a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b779eba6be02430686412ba9d85ad0ef', 'request_id': 'req-12456db4-61ca-4c12-bfc1-253b2c118a08'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:13.232168 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-12456db4-61ca-4c12-bfc1-253b2c118a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b779eba6be02430686412ba9d85ad0ef', 'request_id': 'req-12456db4-61ca-4c12-bfc1-253b2c118a08'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:13.289508 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607c0bf-4ea4-46da-930f-e97a2533d228 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:13.299389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-12456db4-61ca-4c12-bfc1-253b2c118a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b779eba6be02430686412ba9d85ad0ef', 'request_id': 'req-12456db4-61ca-4c12-bfc1-253b2c118a08'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:13.314522 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-12456db4-61ca-4c12-bfc1-253b2c118a08 admin admin] The token cache is being invalidate because project b779eba6be02430686412ba9d85ad0ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:13.314824 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-12456db4-61ca-4c12-bfc1-253b2c118a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:13.315626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-12456db4-61ca-4c12-bfc1-253b2c118a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:13.318265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 988/1987] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:13 2022] DELETE /identity/v3/projects/b779eba6be02430686412ba9d85ad0ef => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:13.319712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:13.324055 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12456db4-61ca-4c12-bfc1-253b2c118a08 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:13.325740 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-12456db4-61ca-4c12-bfc1-253b2c118a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:13.367112 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e3cc2-37ae-4697-87d8-bfb4f7c5e13f tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b596289619940bd9c1f162be61ba2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f125aca50ea4352a62bcddf321c6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:13.367746 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e3cc2-37ae-4697-87d8-bfb4f7c5e13f tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:13.368101 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e3cc2-37ae-4697-87d8-bfb4f7c5e13f tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:13.368479 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e3cc2-37ae-4697-87d8-bfb4f7c5e13f tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:13.369430 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e3cc2-37ae-4697-87d8-bfb4f7c5e13f tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:58:13.369832 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e3cc2-37ae-4697-87d8-bfb4f7c5e13f tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:13.371748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e3cc2-37ae-4697-87d8-bfb4f7c5e13f tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:13.385023 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1000/1988] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:58:13.389037 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e3cc2-37ae-4697-87d8-bfb4f7c5e13f tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:13.391453 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-8e8e3cc2-37ae-4697-87d8-bfb4f7c5e13f tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:13.411573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e3cc2-37ae-4697-87d8-bfb4f7c5e13f tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:13.411899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12456db4-61ca-4c12-bfc1-253b2c118a08 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:13.416265 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a893568-2f71-4e54-be4d-157ba71fc7dc tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b596289619940bd9c1f162be61ba2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f125aca50ea4352a62bcddf321c6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:13.416807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f2778-09eb-4e63-9baf-51e07c9bd55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:13.416942 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a893568-2f71-4e54-be4d-157ba71fc7dc tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:13.417178 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a893568-2f71-4e54-be4d-157ba71fc7dc tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:13.417455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a893568-2f71-4e54-be4d-157ba71fc7dc tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:13.417844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f2778-09eb-4e63-9baf-51e07c9bd55f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:13.418097 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a893568-2f71-4e54-be4d-157ba71fc7dc tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:13.418286 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f2778-09eb-4e63-9baf-51e07c9bd55f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:13.418573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f2778-09eb-4e63-9baf-51e07c9bd55f admin admin] PATH_INFO: `/v3/users/b19fe9a49ca6470796acaec5f10352cf` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:13.419821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f2778-09eb-4e63-9baf-51e07c9bd55f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b19fe9a49ca6470796acaec5f10352cf)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:13.420031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a893568-2f71-4e54-be4d-157ba71fc7dc tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:13.422046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f2778-09eb-4e63-9baf-51e07c9bd55f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:13.575628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1001/1989] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:13 2022] POST /identity/v3/projects => generated 355 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:13.577957 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a893568-2f71-4e54-be4d-157ba71fc7dc tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:13.581943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1a893568-2f71-4e54-be4d-157ba71fc7dc tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:13.642051 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a893568-2f71-4e54-be4d-157ba71fc7dc tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:13.646446 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76635917-25e0-46cc-9176-e75518363333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:13.647064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76635917-25e0-46cc-9176-e75518363333 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:13.647350 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76635917-25e0-46cc-9176-e75518363333 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:13.647628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76635917-25e0-46cc-9176-e75518363333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:13.649399 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-76635917-25e0-46cc-9176-e75518363333 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:13.697527 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7a2f2778-09eb-4e63-9baf-51e07c9bd55f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b19fe9a49ca6470796acaec5f10352cf'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:13.710306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76635917-25e0-46cc-9176-e75518363333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:13.711754 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76635917-25e0-46cc-9176-e75518363333 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:13.723719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1002/1990] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:13.723719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76635917-25e0-46cc-9176-e75518363333 service cinder] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:13.783505 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7a2f2778-09eb-4e63-9baf-51e07c9bd55f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b19fe9a49ca6470796acaec5f10352cf'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:13.784156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7a2f2778-09eb-4e63-9baf-51e07c9bd55f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b19fe9a49ca6470796acaec5f10352cf'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:13.784867 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7a2f2778-09eb-4e63-9baf-51e07c9bd55f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b19fe9a49ca6470796acaec5f10352cf'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:13.792228 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76635917-25e0-46cc-9176-e75518363333 service cinder] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:13.793181 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7a2f2778-09eb-4e63-9baf-51e07c9bd55f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b19fe9a49ca6470796acaec5f10352cf'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:13.798644 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32352ed-dd9f-4d43-ba3b-b9a32b7b7441 tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b596289619940bd9c1f162be61ba2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f125aca50ea4352a62bcddf321c6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:13.800579 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32352ed-dd9f-4d43-ba3b-b9a32b7b7441 tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:13.800948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32352ed-dd9f-4d43-ba3b-b9a32b7b7441 tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:13.801297 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32352ed-dd9f-4d43-ba3b-b9a32b7b7441 tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:13.802024 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32352ed-dd9f-4d43-ba3b-b9a32b7b7441 tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:58:13.802401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32352ed-dd9f-4d43-ba3b-b9a32b7b7441 tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:13.804066 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32352ed-dd9f-4d43-ba3b-b9a32b7b7441 tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:13.813179 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 989/1991] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:13 2022] DELETE /identity/v3/users/b19fe9a49ca6470796acaec5f10352cf => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:13.824473 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1003/1992] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:58:13.874740 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f2778-09eb-4e63-9baf-51e07c9bd55f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:13.876182 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7a2f2778-09eb-4e63-9baf-51e07c9bd55f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:13.965125 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f2778-09eb-4e63-9baf-51e07c9bd55f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:13.972796 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f246468-ceb2-4332-a35a-a6def22f54ef tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b596289619940bd9c1f162be61ba2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f125aca50ea4352a62bcddf321c6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:13.974293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f246468-ceb2-4332-a35a-a6def22f54ef tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:13.974826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f246468-ceb2-4332-a35a-a6def22f54ef tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:13.975358 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f246468-ceb2-4332-a35a-a6def22f54ef tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] PATH_INFO: `/v3/projects/ad86b9ce72244a409bed7538ffdb624a` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:13.976849 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f246468-ceb2-4332-a35a-a6def22f54ef tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ad86b9ce72244a409bed7538ffdb624a)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:13.981635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f246468-ceb2-4332-a35a-a6def22f54ef tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:14.007566 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:14.164598 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5f246468-ceb2-4332-a35a-a6def22f54ef tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad86b9ce72244a409bed7538ffdb624a', 'request_id': 'req-5f246468-ceb2-4332-a35a-a6def22f54ef'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:14.173334 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5f246468-ceb2-4332-a35a-a6def22f54ef tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad86b9ce72244a409bed7538ffdb624a', 'request_id': 'req-5f246468-ceb2-4332-a35a-a6def22f54ef'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:14.212368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:14.246984 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5f246468-ceb2-4332-a35a-a6def22f54ef tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad86b9ce72244a409bed7538ffdb624a', 'request_id': 'req-5f246468-ceb2-4332-a35a-a6def22f54ef'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:14.262286 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5f246468-ceb2-4332-a35a-a6def22f54ef tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] The token cache is being invalidate because project ad86b9ce72244a409bed7538ffdb624a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:14.263894 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5f246468-ceb2-4332-a35a-a6def22f54ef tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:14.264959 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5f246468-ceb2-4332-a35a-a6def22f54ef tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:14.267599 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 990/1993] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:13 2022] DELETE /identity/v3/projects/ad86b9ce72244a409bed7538ffdb624a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:14.333993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32352ed-dd9f-4d43-ba3b-b9a32b7b7441 tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:14.335934 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b32352ed-dd9f-4d43-ba3b-b9a32b7b7441 tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:14.417545 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32352ed-dd9f-4d43-ba3b-b9a32b7b7441 tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:14.481931 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e675e-3a41-481f-8faa-aaa7ee5b18c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:14.482585 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e675e-3a41-481f-8faa-aaa7ee5b18c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:14.483041 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e675e-3a41-481f-8faa-aaa7ee5b18c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:14.483350 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e675e-3a41-481f-8faa-aaa7ee5b18c4 admin admin] PATH_INFO: `/v3/projects/673098b2c75b4462b81b18d0266c0cc1` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:14.485203 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e675e-3a41-481f-8faa-aaa7ee5b18c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=673098b2c75b4462b81b18d0266c0cc1)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:14.487335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e675e-3a41-481f-8faa-aaa7ee5b18c4 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:14.601146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-203e675e-3a41-481f-8faa-aaa7ee5b18c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '673098b2c75b4462b81b18d0266c0cc1', 'request_id': 'req-203e675e-3a41-481f-8faa-aaa7ee5b18c4'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:14.612166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-203e675e-3a41-481f-8faa-aaa7ee5b18c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '673098b2c75b4462b81b18d0266c0cc1', 'request_id': 'req-203e675e-3a41-481f-8faa-aaa7ee5b18c4'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:14.715803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-203e675e-3a41-481f-8faa-aaa7ee5b18c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '673098b2c75b4462b81b18d0266c0cc1', 'request_id': 'req-203e675e-3a41-481f-8faa-aaa7ee5b18c4'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:14.740158 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-203e675e-3a41-481f-8faa-aaa7ee5b18c4 admin admin] The token cache is being invalidate because project 673098b2c75b4462b81b18d0266c0cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:14.740559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-203e675e-3a41-481f-8faa-aaa7ee5b18c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:14.742421 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-203e675e-3a41-481f-8faa-aaa7ee5b18c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:14.746836 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1004/1994] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:14 2022] DELETE /identity/v3/projects/673098b2c75b4462b81b18d0266c0cc1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:14.757818 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f246468-ceb2-4332-a35a-a6def22f54ef tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:14.770037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f246468-ceb2-4332-a35a-a6def22f54ef tempest-VolumeQuotaClassesTest-1096521246 tempest-VolumeQuotaClassesTest-1096521246-project-admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:14.844681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b558189-4758-49c5-9165-158189d88ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:14.845499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b558189-4758-49c5-9165-158189d88ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:14.845979 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b558189-4758-49c5-9165-158189d88ece admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:14.846255 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b558189-4758-49c5-9165-158189d88ece admin admin] PATH_INFO: `/v3/users/37f561bd982b4a9f97dc96bc2474b767` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:14.847804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b558189-4758-49c5-9165-158189d88ece admin admin] RBAC: Authorizing `identity:delete_user(user_id=37f561bd982b4a9f97dc96bc2474b767)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:14.850552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b558189-4758-49c5-9165-158189d88ece admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:15.097683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1b558189-4758-49c5-9165-158189d88ece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37f561bd982b4a9f97dc96bc2474b767'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:15.111246 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:15.166465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1b558189-4758-49c5-9165-158189d88ece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37f561bd982b4a9f97dc96bc2474b767'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:15.167079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1b558189-4758-49c5-9165-158189d88ece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37f561bd982b4a9f97dc96bc2474b767'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:15.167690 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1b558189-4758-49c5-9165-158189d88ece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37f561bd982b4a9f97dc96bc2474b767'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:15.175082 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1b558189-4758-49c5-9165-158189d88ece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37f561bd982b4a9f97dc96bc2474b767'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:15.194866 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 991/1995] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:14 2022] DELETE /identity/v3/users/37f561bd982b4a9f97dc96bc2474b767 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:15.466195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e675e-3a41-481f-8faa-aaa7ee5b18c4 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:15.468475 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-203e675e-3a41-481f-8faa-aaa7ee5b18c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:15.497208 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e675e-3a41-481f-8faa-aaa7ee5b18c4 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:15.567419 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fb258-d735-4197-be34-ce900029d82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:15.570150 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fb258-d735-4197-be34-ce900029d82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:15.570150 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fb258-d735-4197-be34-ce900029d82e admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:15.570150 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fb258-d735-4197-be34-ce900029d82e admin admin] PATH_INFO: `/v3/users/57a35cc676ea46ccbc96731a5651e213` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:15.571195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fb258-d735-4197-be34-ce900029d82e admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a35cc676ea46ccbc96731a5651e213)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:15.573862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fb258-d735-4197-be34-ce900029d82e admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:15.619896 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:15.647830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b558189-4758-49c5-9165-158189d88ece admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:15.650542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1b558189-4758-49c5-9165-158189d88ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:15.712553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b558189-4758-49c5-9165-158189d88ece admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:15.716495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67115d1-575e-4163-b8d4-88f1430e4ea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:15.717066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67115d1-575e-4163-b8d4-88f1430e4ea0 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:15.717343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67115d1-575e-4163-b8d4-88f1430e4ea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:15.717615 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67115d1-575e-4163-b8d4-88f1430e4ea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:15.719479 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c67115d1-575e-4163-b8d4-88f1430e4ea0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:15.795281 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67115d1-575e-4163-b8d4-88f1430e4ea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:15.797132 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67115d1-575e-4163-b8d4-88f1430e4ea0 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:15.808713 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ef3fb258-d735-4197-be34-ce900029d82e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a35cc676ea46ccbc96731a5651e213'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:15.809631 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 992/1996] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:15.839482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67115d1-575e-4163-b8d4-88f1430e4ea0 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:15.841024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c67115d1-575e-4163-b8d4-88f1430e4ea0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:15.864676 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67115d1-575e-4163-b8d4-88f1430e4ea0 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:15.870605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ae1c2-1d2e-48ba-b049-c574156f1068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:15.871121 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ae1c2-1d2e-48ba-b049-c574156f1068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:15.871401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ae1c2-1d2e-48ba-b049-c574156f1068 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:15.871688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ae1c2-1d2e-48ba-b049-c574156f1068 admin admin] PATH_INFO: `/v3/projects/b46275e0e2064c6a8ab2cbc1acd17773` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:15.874417 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ae1c2-1d2e-48ba-b049-c574156f1068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b46275e0e2064c6a8ab2cbc1acd17773)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:15.876384 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ae1c2-1d2e-48ba-b049-c574156f1068 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:15.906375 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ef3fb258-d735-4197-be34-ce900029d82e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a35cc676ea46ccbc96731a5651e213'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:15.907588 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ef3fb258-d735-4197-be34-ce900029d82e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a35cc676ea46ccbc96731a5651e213'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:15.926341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ef3fb258-d735-4197-be34-ce900029d82e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a35cc676ea46ccbc96731a5651e213'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:15.927079 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ef3fb258-d735-4197-be34-ce900029d82e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a35cc676ea46ccbc96731a5651e213'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:15.960528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1005/1997] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:15 2022] DELETE /identity/v3/users/57a35cc676ea46ccbc96731a5651e213 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:15.966135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fd6ce-528b-4951-843c-2010eaad786f None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:15.966432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fd6ce-528b-4951-843c-2010eaad786f None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:15.970410 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fd6ce-528b-4951-843c-2010eaad786f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:15.991200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-0a8fd6ce-528b-4951-843c-2010eaad786f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:15.997351 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0a8fd6ce-528b-4951-843c-2010eaad786f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:16.013538 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-785ae1c2-1d2e-48ba-b049-c574156f1068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46275e0e2064c6a8ab2cbc1acd17773', 'request_id': 'req-785ae1c2-1d2e-48ba-b049-c574156f1068'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:16.026900 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-785ae1c2-1d2e-48ba-b049-c574156f1068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46275e0e2064c6a8ab2cbc1acd17773', 'request_id': 'req-785ae1c2-1d2e-48ba-b049-c574156f1068'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:16.096884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1006/1998] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:16.107949 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fd6ce-528b-4951-843c-2010eaad786f None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:16.109361 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0a8fd6ce-528b-4951-843c-2010eaad786f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:16.114764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-785ae1c2-1d2e-48ba-b049-c574156f1068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46275e0e2064c6a8ab2cbc1acd17773', 'request_id': 'req-785ae1c2-1d2e-48ba-b049-c574156f1068'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:16.134706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-785ae1c2-1d2e-48ba-b049-c574156f1068 admin admin] The token cache is being invalidate because project b46275e0e2064c6a8ab2cbc1acd17773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:16.134706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-785ae1c2-1d2e-48ba-b049-c574156f1068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:16.134928 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-785ae1c2-1d2e-48ba-b049-c574156f1068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:16.136985 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 993/1999] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:15 2022] DELETE /identity/v3/projects/b46275e0e2064c6a8ab2cbc1acd17773 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:16.144593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abf884-b69b-4cec-824e-5e347abbe232 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:16.144593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abf884-b69b-4cec-824e-5e347abbe232 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:16.144593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abf884-b69b-4cec-824e-5e347abbe232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:16.172012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-52abf884-b69b-4cec-824e-5e347abbe232 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:16.173430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-52abf884-b69b-4cec-824e-5e347abbe232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:16.183353 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 994/2000] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:16.192202 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb2f3a-90e6-4e42-a220-e3765e7ea988 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:16.193053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb2f3a-90e6-4e42-a220-e3765e7ea988 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:16.193211 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb2f3a-90e6-4e42-a220-e3765e7ea988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:16.219621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fd6ce-528b-4951-843c-2010eaad786f None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:16.224003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e0122-1f50-4c1e-bc57-aac1f67d9eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:16.224723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e0122-1f50-4c1e-bc57-aac1f67d9eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:16.225224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e0122-1f50-4c1e-bc57-aac1f67d9eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:16.225597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e0122-1f50-4c1e-bc57-aac1f67d9eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:16.227632 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-991e0122-1f50-4c1e-bc57-aac1f67d9eb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:16.234477 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3bbb2f3a-90e6-4e42-a220-e3765e7ea988 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:16.236195 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3bbb2f3a-90e6-4e42-a220-e3765e7ea988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:16.242701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e0122-1f50-4c1e-bc57-aac1f67d9eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:16.245047 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e0122-1f50-4c1e-bc57-aac1f67d9eb4 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:16.245667 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 995/2001] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:16.251182 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb2f3a-90e6-4e42-a220-e3765e7ea988 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:16.254992 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1007/2002] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:58:16.260793 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb2f3a-90e6-4e42-a220-e3765e7ea988 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:16.265549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803f846-69d5-4cdf-b33a-404a4fd62b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:16.266230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803f846-69d5-4cdf-b33a-404a4fd62b90 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:16.266513 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803f846-69d5-4cdf-b33a-404a4fd62b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:16.266789 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803f846-69d5-4cdf-b33a-404a4fd62b90 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:16.267458 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803f846-69d5-4cdf-b33a-404a4fd62b90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:58:16.273675 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803f846-69d5-4cdf-b33a-404a4fd62b90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:16.273675 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803f846-69d5-4cdf-b33a-404a4fd62b90 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:16.282469 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 996/2003] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:58:16.287018 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e0122-1f50-4c1e-bc57-aac1f67d9eb4 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:16.298068 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e0122-1f50-4c1e-bc57-aac1f67d9eb4 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:16.303520 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d33f0-d10f-4756-86aa-fa58653cb47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:16.303723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d33f0-d10f-4756-86aa-fa58653cb47a admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:16.304219 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d33f0-d10f-4756-86aa-fa58653cb47a admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:16.304219 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d33f0-d10f-4756-86aa-fa58653cb47a admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:16.306200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d33f0-d10f-4756-86aa-fa58653cb47a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:16.306992 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d33f0-d10f-4756-86aa-fa58653cb47a admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:16.409464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1008/2004] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:16 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:16.413573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803f846-69d5-4cdf-b33a-404a4fd62b90 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:16.429439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803f846-69d5-4cdf-b33a-404a4fd62b90 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:16.507829 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f7265-f69f-49d5-b9d6-97c1bb83a42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:16.508857 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f7265-f69f-49d5-b9d6-97c1bb83a42f admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:16.514469 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f7265-f69f-49d5-b9d6-97c1bb83a42f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:16.514469 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f7265-f69f-49d5-b9d6-97c1bb83a42f admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:16.514469 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f7265-f69f-49d5-b9d6-97c1bb83a42f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:16.514469 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f7265-f69f-49d5-b9d6-97c1bb83a42f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:16.645389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 997/2005] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:16 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:16.649256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d33f0-d10f-4756-86aa-fa58653cb47a admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:16.664231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d33f0-d10f-4756-86aa-fa58653cb47a admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:16.689748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927aff3f-7ede-4b38-b935-ba482888ce09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:16.692040 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927aff3f-7ede-4b38-b935-ba482888ce09 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:16.692498 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927aff3f-7ede-4b38-b935-ba482888ce09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:16.694688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927aff3f-7ede-4b38-b935-ba482888ce09 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:16.698157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927aff3f-7ede-4b38-b935-ba482888ce09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:16.700882 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927aff3f-7ede-4b38-b935-ba482888ce09 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:16.719159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1009/2006] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:16.728840 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f7265-f69f-49d5-b9d6-97c1bb83a42f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:16.740213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f7265-f69f-49d5-b9d6-97c1bb83a42f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:16.765254 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61567f-c107-4839-b8ea-2f272a854672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:16.765860 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61567f-c107-4839-b8ea-2f272a854672 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:16.766242 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61567f-c107-4839-b8ea-2f272a854672 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:16.766538 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61567f-c107-4839-b8ea-2f272a854672 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:16.767278 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61567f-c107-4839-b8ea-2f272a854672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:16.768841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61567f-c107-4839-b8ea-2f272a854672 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:16.773618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:16.791520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 998/2007] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:16.792359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927aff3f-7ede-4b38-b935-ba482888ce09 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:16.803744 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927aff3f-7ede-4b38-b935-ba482888ce09 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:16.809178 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275539f-28ef-4b8e-8241-bf3bb4df42a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:16.809975 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275539f-28ef-4b8e-8241-bf3bb4df42a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:16.811440 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275539f-28ef-4b8e-8241-bf3bb4df42a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:16.811638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61567f-c107-4839-b8ea-2f272a854672 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:16.812072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275539f-28ef-4b8e-8241-bf3bb4df42a4 admin admin] PATH_INFO: `/v3/projects/e36ae06f03dc44cfbafb6eab470000f2/users/bedf711f87e742a4b7f3e2ef3c046d60/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:16.817324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fb61567f-c107-4839-b8ea-2f272a854672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:16.833971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275539f-28ef-4b8e-8241-bf3bb4df42a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e36ae06f03dc44cfbafb6eab470000f2, user_id=bedf711f87e742a4b7f3e2ef3c046d60, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:16.854875 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275539f-28ef-4b8e-8241-bf3bb4df42a4 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:16.861424 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61567f-c107-4839-b8ea-2f272a854672 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:16.866400 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2b802-419e-406a-8431-0742d3e2a089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:16.867047 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2b802-419e-406a-8431-0742d3e2a089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:16.867327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2b802-419e-406a-8431-0742d3e2a089 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:16.867609 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2b802-419e-406a-8431-0742d3e2a089 admin admin] PATH_INFO: `/v3/projects/54062e419e0a4c97af697347a7df87da` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:16.869484 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2b802-419e-406a-8431-0742d3e2a089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54062e419e0a4c97af697347a7df87da)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:16.871420 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2b802-419e-406a-8431-0742d3e2a089 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:16.909545 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1010/2008] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:16 2022] PUT /identity/v3/projects/e36ae06f03dc44cfbafb6eab470000f2/users/bedf711f87e742a4b7f3e2ef3c046d60/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:16.920484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d9bd5-7a29-4485-8219-bd3377a7c716 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:16.920788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d9bd5-7a29-4485-8219-bd3377a7c716 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:16.921591 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d9bd5-7a29-4485-8219-bd3377a7c716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:16.952378 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-9e2d9bd5-7a29-4485-8219-bd3377a7c716 None None] MFA Rules not processed for user `bedf711f87e742a4b7f3e2ef3c046d60`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:16.953688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9e2d9bd5-7a29-4485-8219-bd3377a7c716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:17.008499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bdb2b802-419e-406a-8431-0742d3e2a089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54062e419e0a4c97af697347a7df87da', 'request_id': 'req-bdb2b802-419e-406a-8431-0742d3e2a089'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:17.024659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bdb2b802-419e-406a-8431-0742d3e2a089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54062e419e0a4c97af697347a7df87da', 'request_id': 'req-bdb2b802-419e-406a-8431-0742d3e2a089'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:17.053099 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1011/2009] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:17.102331 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d9bd5-7a29-4485-8219-bd3377a7c716 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:17.104291 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9e2d9bd5-7a29-4485-8219-bd3377a7c716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:17.121923 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bdb2b802-419e-406a-8431-0742d3e2a089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54062e419e0a4c97af697347a7df87da', 'request_id': 'req-bdb2b802-419e-406a-8431-0742d3e2a089'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:17.140570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bdb2b802-419e-406a-8431-0742d3e2a089 admin admin] The token cache is being invalidate because project 54062e419e0a4c97af697347a7df87da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:17.141415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bdb2b802-419e-406a-8431-0742d3e2a089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:17.142696 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bdb2b802-419e-406a-8431-0742d3e2a089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:17.145325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 999/2010] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:16 2022] DELETE /identity/v3/projects/54062e419e0a4c97af697347a7df87da => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:17.148938 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2b802-419e-406a-8431-0742d3e2a089 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:17.150593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bdb2b802-419e-406a-8431-0742d3e2a089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:17.174460 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d9bd5-7a29-4485-8219-bd3377a7c716 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:17.231861 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2b802-419e-406a-8431-0742d3e2a089 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:17.237570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2ea76-b8d7-420a-a6b4-bcbdc91906db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:17.238794 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2ea76-b8d7-420a-a6b4-bcbdc91906db admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:17.239325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2ea76-b8d7-420a-a6b4-bcbdc91906db admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:17.239900 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2ea76-b8d7-420a-a6b4-bcbdc91906db admin admin] PATH_INFO: `/v3/users/6b596289619940bd9c1f162be61ba2a3` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:17.241639 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2ea76-b8d7-420a-a6b4-bcbdc91906db admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b596289619940bd9c1f162be61ba2a3)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:17.241956 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600da640-8581-4220-9d0f-f3a096e4d568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:17.242622 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600da640-8581-4220-9d0f-f3a096e4d568 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:17.242914 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600da640-8581-4220-9d0f-f3a096e4d568 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:17.243189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600da640-8581-4220-9d0f-f3a096e4d568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:17.245527 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2ea76-b8d7-420a-a6b4-bcbdc91906db admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:17.246490 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-600da640-8581-4220-9d0f-f3a096e4d568 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:17.329391 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600da640-8581-4220-9d0f-f3a096e4d568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:17.331100 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600da640-8581-4220-9d0f-f3a096e4d568 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:17.345285 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1012/2011] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:58:17.381527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600da640-8581-4220-9d0f-f3a096e4d568 service cinder] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:17.383141 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-600da640-8581-4220-9d0f-f3a096e4d568 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:17.406058 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600da640-8581-4220-9d0f-f3a096e4d568 service cinder] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:17.407573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:17.412633 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de7a2a-6ee8-450c-97f1-0d811ed97d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:17.413369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de7a2a-6ee8-450c-97f1-0d811ed97d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:17.421686 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de7a2a-6ee8-450c-97f1-0d811ed97d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:17.421686 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de7a2a-6ee8-450c-97f1-0d811ed97d8a admin admin] PATH_INFO: `/v3/users/bedf711f87e742a4b7f3e2ef3c046d60` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:17.421686 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de7a2a-6ee8-450c-97f1-0d811ed97d8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bedf711f87e742a4b7f3e2ef3c046d60)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:17.421686 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de7a2a-6ee8-450c-97f1-0d811ed97d8a admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:17.457311 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f9f2ea76-b8d7-420a-a6b4-bcbdc91906db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b596289619940bd9c1f162be61ba2a3'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:17.560915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f9f2ea76-b8d7-420a-a6b4-bcbdc91906db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b596289619940bd9c1f162be61ba2a3'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:17.561625 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f9f2ea76-b8d7-420a-a6b4-bcbdc91906db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b596289619940bd9c1f162be61ba2a3'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:17.562377 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f9f2ea76-b8d7-420a-a6b4-bcbdc91906db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b596289619940bd9c1f162be61ba2a3'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:17.572236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f9f2ea76-b8d7-420a-a6b4-bcbdc91906db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b596289619940bd9c1f162be61ba2a3'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:17.588677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1000/2012] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:17 2022] DELETE /identity/v3/users/6b596289619940bd9c1f162be61ba2a3 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:17.691571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-47de7a2a-6ee8-450c-97f1-0d811ed97d8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bedf711f87e742a4b7f3e2ef3c046d60'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:17.762278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-47de7a2a-6ee8-450c-97f1-0d811ed97d8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bedf711f87e742a4b7f3e2ef3c046d60'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:17.763378 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-47de7a2a-6ee8-450c-97f1-0d811ed97d8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bedf711f87e742a4b7f3e2ef3c046d60'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:17.800990 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-47de7a2a-6ee8-450c-97f1-0d811ed97d8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bedf711f87e742a4b7f3e2ef3c046d60'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:17.803005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-47de7a2a-6ee8-450c-97f1-0d811ed97d8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bedf711f87e742a4b7f3e2ef3c046d60'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:17.827555 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:17.854331 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1013/2013] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:17 2022] DELETE /identity/v3/users/bedf711f87e742a4b7f3e2ef3c046d60 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:17.859111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f44bd-94ce-4eb1-a247-1fa88e26c14a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:17.859707 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f44bd-94ce-4eb1-a247-1fa88e26c14a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:17.860156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f44bd-94ce-4eb1-a247-1fa88e26c14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:17.905646 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9f8f44bd-94ce-4eb1-a247-1fa88e26c14a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:17.907072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9f8f44bd-94ce-4eb1-a247-1fa88e26c14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:18.051251 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1001/2014] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:18.082495 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de7a2a-6ee8-450c-97f1-0d811ed97d8a admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:18.084462 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-47de7a2a-6ee8-450c-97f1-0d811ed97d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:18.245336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de7a2a-6ee8-450c-97f1-0d811ed97d8a admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:18.249726 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdee493-bab5-438e-a7a1-ad0a4027e109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:18.257724 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdee493-bab5-438e-a7a1-ad0a4027e109 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:18.257724 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdee493-bab5-438e-a7a1-ad0a4027e109 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:18.257724 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdee493-bab5-438e-a7a1-ad0a4027e109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:18.262411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdee493-bab5-438e-a7a1-ad0a4027e109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:18.263888 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdee493-bab5-438e-a7a1-ad0a4027e109 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:18.274195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1014/2015] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:18.328814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:18.719241 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f44bd-94ce-4eb1-a247-1fa88e26c14a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:18.721195 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9f8f44bd-94ce-4eb1-a247-1fa88e26c14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:18.733785 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f44bd-94ce-4eb1-a247-1fa88e26c14a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:18.744092 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb37c98-ddc0-43a6-bb86-36a700166a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:18.745027 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb37c98-ddc0-43a6-bb86-36a700166a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:18.745305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb37c98-ddc0-43a6-bb86-36a700166a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:18.746123 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb37c98-ddc0-43a6-bb86-36a700166a08 admin admin] PATH_INFO: `/v3/projects/e36ae06f03dc44cfbafb6eab470000f2` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:18.747021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb37c98-ddc0-43a6-bb86-36a700166a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e36ae06f03dc44cfbafb6eab470000f2)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:18.748888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb37c98-ddc0-43a6-bb86-36a700166a08 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:18.790229 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdee493-bab5-438e-a7a1-ad0a4027e109 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:18.792305 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-2fdee493-bab5-438e-a7a1-ad0a4027e109 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:18.806149 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdee493-bab5-438e-a7a1-ad0a4027e109 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:18.810876 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edeb6b-e6c8-4e74-b60d-49bd34447ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:18.811509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edeb6b-e6c8-4e74-b60d-49bd34447ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:18.811812 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edeb6b-e6c8-4e74-b60d-49bd34447ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:18.812249 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edeb6b-e6c8-4e74-b60d-49bd34447ac4 admin admin] PATH_INFO: `/v3/projects/4f125aca50ea4352a62bcddf321c6de4` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:18.815263 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edeb6b-e6c8-4e74-b60d-49bd34447ac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f125aca50ea4352a62bcddf321c6de4)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:18.815707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edeb6b-e6c8-4e74-b60d-49bd34447ac4 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:18.869040 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bbb37c98-ddc0-43a6-bb86-36a700166a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e36ae06f03dc44cfbafb6eab470000f2', 'request_id': 'req-bbb37c98-ddc0-43a6-bb86-36a700166a08'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:18.875283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bbb37c98-ddc0-43a6-bb86-36a700166a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e36ae06f03dc44cfbafb6eab470000f2', 'request_id': 'req-bbb37c98-ddc0-43a6-bb86-36a700166a08'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:18.949346 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b3edeb6b-e6c8-4e74-b60d-49bd34447ac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f125aca50ea4352a62bcddf321c6de4', 'request_id': 'req-b3edeb6b-e6c8-4e74-b60d-49bd34447ac4'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:18.955399 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b3edeb6b-e6c8-4e74-b60d-49bd34447ac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f125aca50ea4352a62bcddf321c6de4', 'request_id': 'req-b3edeb6b-e6c8-4e74-b60d-49bd34447ac4'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:18.961419 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bbb37c98-ddc0-43a6-bb86-36a700166a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e36ae06f03dc44cfbafb6eab470000f2', 'request_id': 'req-bbb37c98-ddc0-43a6-bb86-36a700166a08'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:18.973076 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bbb37c98-ddc0-43a6-bb86-36a700166a08 admin admin] The token cache is being invalidate because project e36ae06f03dc44cfbafb6eab470000f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:18.973358 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bbb37c98-ddc0-43a6-bb86-36a700166a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:18.973976 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bbb37c98-ddc0-43a6-bb86-36a700166a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:18.975460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1002/2016] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:18 2022] DELETE /identity/v3/projects/e36ae06f03dc44cfbafb6eab470000f2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:18.980577 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce7494-d42c-4412-9a92-ecba310bd3fe None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:18.980934 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce7494-d42c-4412-9a92-ecba310bd3fe None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:18.981130 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce7494-d42c-4412-9a92-ecba310bd3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:19.001835 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-00ce7494-d42c-4412-9a92-ecba310bd3fe None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:19.003045 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-00ce7494-d42c-4412-9a92-ecba310bd3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:19.028925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b3edeb6b-e6c8-4e74-b60d-49bd34447ac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f125aca50ea4352a62bcddf321c6de4', 'request_id': 'req-b3edeb6b-e6c8-4e74-b60d-49bd34447ac4'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:19.031584 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:19.041454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b3edeb6b-e6c8-4e74-b60d-49bd34447ac4 admin admin] The token cache is being invalidate because project 4f125aca50ea4352a62bcddf321c6de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:19.041740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b3edeb6b-e6c8-4e74-b60d-49bd34447ac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:19.042369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b3edeb6b-e6c8-4e74-b60d-49bd34447ac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:19.044098 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1015/2017] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:18 2022] DELETE /identity/v3/projects/4f125aca50ea4352a62bcddf321c6de4 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:19.049667 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdfd3b-4a72-4de3-ba6c-e790218ada2a None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:19.050268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdfd3b-4a72-4de3-ba6c-e790218ada2a None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:19.050268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdfd3b-4a72-4de3-ba6c-e790218ada2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:19.063350 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1003/2018] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:19.071279 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438a7df-eb72-48bd-9136-3de77ff3b4a5 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:19.072202 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438a7df-eb72-48bd-9136-3de77ff3b4a5 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:19.072443 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438a7df-eb72-48bd-9136-3de77ff3b4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:19.072543 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-52cdfd3b-4a72-4de3-ba6c-e790218ada2a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:19.073700 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-52cdfd3b-4a72-4de3-ba6c-e790218ada2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:19.082634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1016/2019] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:19.090257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2072ab0-3d8f-4410-a459-53dfb0f69596 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:19.090538 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2072ab0-3d8f-4410-a459-53dfb0f69596 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:19.090864 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2072ab0-3d8f-4410-a459-53dfb0f69596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:19.092381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d438a7df-eb72-48bd-9136-3de77ff3b4a5 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:19.094097 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d438a7df-eb72-48bd-9136-3de77ff3b4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:19.099136 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:19.106318 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1004/2020] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:19.111599 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438a7df-eb72-48bd-9136-3de77ff3b4a5 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:19.112087 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-b2072ab0-3d8f-4410-a459-53dfb0f69596 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:19.113408 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b2072ab0-3d8f-4410-a459-53dfb0f69596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:19.121879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438a7df-eb72-48bd-9136-3de77ff3b4a5 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:19.124580 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1017/2021] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:19.126946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4f8f0-d323-40d1-80d5-9c7b1b41875e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:19.127560 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4f8f0-d323-40d1-80d5-9c7b1b41875e admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:19.127842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4f8f0-d323-40d1-80d5-9c7b1b41875e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:19.128115 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4f8f0-d323-40d1-80d5-9c7b1b41875e admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:19.128348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2072ab0-3d8f-4410-a459-53dfb0f69596 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:19.128893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4f8f0-d323-40d1-80d5-9c7b1b41875e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:58:19.129199 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4f8f0-d323-40d1-80d5-9c7b1b41875e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:19.130811 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4f8f0-d323-40d1-80d5-9c7b1b41875e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:19.139413 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2072ab0-3d8f-4410-a459-53dfb0f69596 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:19.145141 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24824af-172c-4264-8dab-1bd174a16df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:19.146047 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24824af-172c-4264-8dab-1bd174a16df8 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:19.146260 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24824af-172c-4264-8dab-1bd174a16df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:19.150034 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24824af-172c-4264-8dab-1bd174a16df8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:19.150155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1005/2022] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:58:19.150256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24824af-172c-4264-8dab-1bd174a16df8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:58:19.150256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24824af-172c-4264-8dab-1bd174a16df8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:19.150256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24824af-172c-4264-8dab-1bd174a16df8 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:19.153144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4f8f0-d323-40d1-80d5-9c7b1b41875e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:19.165097 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1018/2023] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:58:19.165450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4f8f0-d323-40d1-80d5-9c7b1b41875e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:19.168234 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24824af-172c-4264-8dab-1bd174a16df8 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:19.171212 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae745891-3c89-4871-b886-c52b3970621c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:19.172039 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae745891-3c89-4871-b886-c52b3970621c admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:19.172542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae745891-3c89-4871-b886-c52b3970621c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:19.172995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae745891-3c89-4871-b886-c52b3970621c admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:19.173840 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae745891-3c89-4871-b886-c52b3970621c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:19.176142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae745891-3c89-4871-b886-c52b3970621c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:19.178467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24824af-172c-4264-8dab-1bd174a16df8 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:19.189118 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e910ca-903d-4c19-a2ce-b3c8638b1c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:19.189745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e910ca-903d-4c19-a2ce-b3c8638b1c01 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:19.193786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e910ca-903d-4c19-a2ce-b3c8638b1c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:19.193786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e910ca-903d-4c19-a2ce-b3c8638b1c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:19.193786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e910ca-903d-4c19-a2ce-b3c8638b1c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:19.193786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e910ca-903d-4c19-a2ce-b3c8638b1c01 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:19.277484 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1006/2024] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:19 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:19.285454 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae745891-3c89-4871-b886-c52b3970621c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:19.309963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1019/2025] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:19 2022] POST /identity/v3/projects => generated 407 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:19.317797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e910ca-903d-4c19-a2ce-b3c8638b1c01 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:19.382736 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae745891-3c89-4871-b886-c52b3970621c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:19.451996 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e910ca-903d-4c19-a2ce-b3c8638b1c01 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:19.458812 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91366e4e-a1c0-4f17-af80-8b9700878f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:19.459433 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91366e4e-a1c0-4f17-af80-8b9700878f37 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:19.459788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91366e4e-a1c0-4f17-af80-8b9700878f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:19.460131 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91366e4e-a1c0-4f17-af80-8b9700878f37 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:19.460891 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91366e4e-a1c0-4f17-af80-8b9700878f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:19.463943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91366e4e-a1c0-4f17-af80-8b9700878f37 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:19.473070 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a513f2b-48ec-4b47-a230-39dbb6eadf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:19.474065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a513f2b-48ec-4b47-a230-39dbb6eadf05 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:19.474414 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a513f2b-48ec-4b47-a230-39dbb6eadf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:19.474872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a513f2b-48ec-4b47-a230-39dbb6eadf05 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:19.478461 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a513f2b-48ec-4b47-a230-39dbb6eadf05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:19.478461 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a513f2b-48ec-4b47-a230-39dbb6eadf05 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:19.561877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:19.581469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1020/2026] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:19 2022] POST /identity/v3/users => generated 304 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:19.585305 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91366e4e-a1c0-4f17-af80-8b9700878f37 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:19.595854 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91366e4e-a1c0-4f17-af80-8b9700878f37 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:19.601908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f8be6-0621-4db1-a68a-bfd5400535f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:19.602561 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f8be6-0621-4db1-a68a-bfd5400535f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:19.603370 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f8be6-0621-4db1-a68a-bfd5400535f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:19.603650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f8be6-0621-4db1-a68a-bfd5400535f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:19.604324 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f8be6-0621-4db1-a68a-bfd5400535f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:19.605959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f8be6-0621-4db1-a68a-bfd5400535f3 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:19.623247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1021/2028] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:58:19.623833 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1007/2028] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:19 2022] POST /identity/v3/users => generated 293 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:19.624891 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a513f2b-48ec-4b47-a230-39dbb6eadf05 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:19.625304 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f8be6-0621-4db1-a68a-bfd5400535f3 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:19.637977 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f8be6-0621-4db1-a68a-bfd5400535f3 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:19.641797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:19.644102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a513f2b-48ec-4b47-a230-39dbb6eadf05 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:19.649264 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fa32d-93bd-4ef3-acab-488ab5310823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:19.650279 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fa32d-93bd-4ef3-acab-488ab5310823 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:19.650572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fa32d-93bd-4ef3-acab-488ab5310823 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:19.650964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fa32d-93bd-4ef3-acab-488ab5310823 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:19.651624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fa32d-93bd-4ef3-acab-488ab5310823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:19.652564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233ad23-77b3-4c39-a404-ace01f224e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:19.653260 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233ad23-77b3-4c39-a404-ace01f224e9d admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:19.653503 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fa32d-93bd-4ef3-acab-488ab5310823 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:19.653609 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233ad23-77b3-4c39-a404-ace01f224e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:19.653811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233ad23-77b3-4c39-a404-ace01f224e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:19.654470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233ad23-77b3-4c39-a404-ace01f224e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:19.656721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233ad23-77b3-4c39-a404-ace01f224e9d admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:19.665143 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1008/2029] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:19.669116 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1022/2030] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:58:19.673004 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fa32d-93bd-4ef3-acab-488ab5310823 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:19.679499 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233ad23-77b3-4c39-a404-ace01f224e9d admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:19.695813 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233ad23-77b3-4c39-a404-ace01f224e9d admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:19.699975 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fa32d-93bd-4ef3-acab-488ab5310823 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:19.701448 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ec834-c32f-4caa-9313-020f2c3e4b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:19.702495 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ec834-c32f-4caa-9313-020f2c3e4b65 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:19.702777 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ec834-c32f-4caa-9313-020f2c3e4b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:19.703137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ec834-c32f-4caa-9313-020f2c3e4b65 admin admin] PATH_INFO: `/v3/projects/1ee1e01c13704619996a3d1ea0fa9de3/users/5b82f4ff216945ac820ed4deed8a61c9/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:19.706086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e346b-024d-4902-9a71-33cde385a31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:19.707689 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e346b-024d-4902-9a71-33cde385a31c admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:19.707689 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e346b-024d-4902-9a71-33cde385a31c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:19.707689 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e346b-024d-4902-9a71-33cde385a31c admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:19.708371 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e346b-024d-4902-9a71-33cde385a31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:19.710779 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e346b-024d-4902-9a71-33cde385a31c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:19.724045 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ec834-c32f-4caa-9313-020f2c3e4b65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee1e01c13704619996a3d1ea0fa9de3, user_id=5b82f4ff216945ac820ed4deed8a61c9, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:19.725127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1009/2031] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:58:19.730015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e346b-024d-4902-9a71-33cde385a31c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:19.731790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ec834-c32f-4caa-9313-020f2c3e4b65 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:19.741864 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e346b-024d-4902-9a71-33cde385a31c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:19.755975 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f647b70-c3d9-4013-8c60-fd9767041dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:19.755975 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f647b70-c3d9-4013-8c60-fd9767041dff admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:19.755975 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f647b70-c3d9-4013-8c60-fd9767041dff admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:19.755975 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f647b70-c3d9-4013-8c60-fd9767041dff admin admin] PATH_INFO: `/v3/projects/d5cf8a9d6d884b60af54d32cb665e1db/users/30e82d7d24784b34914265cb35a426e8/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:19.771564 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f647b70-c3d9-4013-8c60-fd9767041dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5cf8a9d6d884b60af54d32cb665e1db, user_id=30e82d7d24784b34914265cb35a426e8, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:19.774386 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f647b70-c3d9-4013-8c60-fd9767041dff admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:19.824936 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1023/2032] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:19 2022] PUT /identity/v3/projects/1ee1e01c13704619996a3d1ea0fa9de3/users/5b82f4ff216945ac820ed4deed8a61c9/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:19.840126 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc5f7f-8e3e-4a60-b58f-519a058503e0 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:19.841913 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc5f7f-8e3e-4a60-b58f-519a058503e0 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:19.843140 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc5f7f-8e3e-4a60-b58f-519a058503e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:19.861412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1010/2033] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:19 2022] PUT /identity/v3/projects/d5cf8a9d6d884b60af54d32cb665e1db/users/30e82d7d24784b34914265cb35a426e8/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:19.872812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cccee9-0204-4339-9cad-4808eab0e001 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:19.873488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cccee9-0204-4339-9cad-4808eab0e001 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:19.874348 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cccee9-0204-4339-9cad-4808eab0e001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:19.891930 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-3cdc5f7f-8e3e-4a60-b58f-519a058503e0 None None] MFA Rules not processed for user `5b82f4ff216945ac820ed4deed8a61c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:19.893424 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3cdc5f7f-8e3e-4a60-b58f-519a058503e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:19.921021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f3cccee9-0204-4339-9cad-4808eab0e001 None None] MFA Rules not processed for user `30e82d7d24784b34914265cb35a426e8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:19.922357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f3cccee9-0204-4339-9cad-4808eab0e001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:19.980492 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1024/2034] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:19 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:19.985486 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc5f7f-8e3e-4a60-b58f-519a058503e0 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:20.015811 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1011/2035] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:20.175469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc5f7f-8e3e-4a60-b58f-519a058503e0 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:20.175469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c704eb-7961-4148-8191-0bf8765c2429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:20.175469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c704eb-7961-4148-8191-0bf8765c2429 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:20.175469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c704eb-7961-4148-8191-0bf8765c2429 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:20.175981 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c704eb-7961-4148-8191-0bf8765c2429 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:20.175981 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c704eb-7961-4148-8191-0bf8765c2429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:20.175981 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c704eb-7961-4148-8191-0bf8765c2429 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:20.233581 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cccee9-0204-4339-9cad-4808eab0e001 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:20.233581 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f3cccee9-0204-4339-9cad-4808eab0e001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:20.269818 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:20.311861 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cccee9-0204-4339-9cad-4808eab0e001 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:20.412088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ba084-bd9f-4ce9-958b-98e405d30ee8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:20.412088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ba084-bd9f-4ce9-958b-98e405d30ee8 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:20.412088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ba084-bd9f-4ce9-958b-98e405d30ee8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:20.412088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ba084-bd9f-4ce9-958b-98e405d30ee8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:20.413955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ba084-bd9f-4ce9-958b-98e405d30ee8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:20.413955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ba084-bd9f-4ce9-958b-98e405d30ee8 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:20.413955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1012/2036] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:20.514727 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1025/2037] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:19 2022] POST /identity/v3/projects => generated 407 bytes in 526 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:20.515290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ba084-bd9f-4ce9-958b-98e405d30ee8 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:20.527356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ba084-bd9f-4ce9-958b-98e405d30ee8 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:20.589289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b0354-7aae-42fc-97a7-3659acf0829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:20.589924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b0354-7aae-42fc-97a7-3659acf0829c admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:20.590204 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b0354-7aae-42fc-97a7-3659acf0829c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:20.590478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b0354-7aae-42fc-97a7-3659acf0829c admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:20.591130 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b0354-7aae-42fc-97a7-3659acf0829c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:20.593157 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b0354-7aae-42fc-97a7-3659acf0829c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:20.865624 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:20.872582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1013/2038] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:20 2022] POST /identity/v3/users => generated 310 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:20.877990 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c704eb-7961-4148-8191-0bf8765c2429 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:20.890088 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c704eb-7961-4148-8191-0bf8765c2429 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:20.896610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67b509-f8cb-40dd-a0e5-b15dc6a3ea78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:20.897236 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67b509-f8cb-40dd-a0e5-b15dc6a3ea78 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:20.897513 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67b509-f8cb-40dd-a0e5-b15dc6a3ea78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:20.897786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67b509-f8cb-40dd-a0e5-b15dc6a3ea78 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:20.898762 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67b509-f8cb-40dd-a0e5-b15dc6a3ea78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:20.903235 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67b509-f8cb-40dd-a0e5-b15dc6a3ea78 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:20.916528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1026/2039] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:20.920681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b0354-7aae-42fc-97a7-3659acf0829c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:20.931750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b0354-7aae-42fc-97a7-3659acf0829c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:20.937697 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f4422-4c06-4e22-82b2-ccdec61ffda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:20.938783 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f4422-4c06-4e22-82b2-ccdec61ffda4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:20.939352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f4422-4c06-4e22-82b2-ccdec61ffda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:20.939829 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f4422-4c06-4e22-82b2-ccdec61ffda4 admin admin] PATH_INFO: `/v3/projects/7276165f71b64243917f3b80ce93d4f4/users/51ba4f014cde4bb59861cf9ae4011be5/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:20.970194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f4422-4c06-4e22-82b2-ccdec61ffda4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7276165f71b64243917f3b80ce93d4f4, user_id=51ba4f014cde4bb59861cf9ae4011be5, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:21.044203 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f4422-4c06-4e22-82b2-ccdec61ffda4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:21.100317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1014/2040] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:20 2022] PUT /identity/v3/projects/7276165f71b64243917f3b80ce93d4f4/users/51ba4f014cde4bb59861cf9ae4011be5/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:21.104448 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67b509-f8cb-40dd-a0e5-b15dc6a3ea78 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:21.115454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67b509-f8cb-40dd-a0e5-b15dc6a3ea78 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:21.178229 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca9d7a-139c-4a3f-abfd-109b9b5de68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:21.178849 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca9d7a-139c-4a3f-abfd-109b9b5de68c admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:21.179127 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca9d7a-139c-4a3f-abfd-109b9b5de68c admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:21.179551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca9d7a-139c-4a3f-abfd-109b9b5de68c admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:21.180026 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca9d7a-139c-4a3f-abfd-109b9b5de68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:21.182304 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca9d7a-139c-4a3f-abfd-109b9b5de68c admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:21.193911 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1027/2041] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:21.199343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f4422-4c06-4e22-82b2-ccdec61ffda4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:21.211459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f4422-4c06-4e22-82b2-ccdec61ffda4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:21.217140 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c71b4-9cb9-4ecc-bc86-4aedd22bce63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:21.217816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c71b4-9cb9-4ecc-bc86-4aedd22bce63 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:21.218284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c71b4-9cb9-4ecc-bc86-4aedd22bce63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:21.218561 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c71b4-9cb9-4ecc-bc86-4aedd22bce63 admin admin] PATH_INFO: `/v3/projects/7276165f71b64243917f3b80ce93d4f4/users/51ba4f014cde4bb59861cf9ae4011be5/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:21.220521 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c71b4-9cb9-4ecc-bc86-4aedd22bce63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7276165f71b64243917f3b80ce93d4f4, user_id=51ba4f014cde4bb59861cf9ae4011be5, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:21.223473 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c71b4-9cb9-4ecc-bc86-4aedd22bce63 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:21.234672 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1015/2042] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:21 2022] PUT /identity/v3/projects/7276165f71b64243917f3b80ce93d4f4/users/51ba4f014cde4bb59861cf9ae4011be5/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:21.246056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e92604-1260-441d-8ea0-1bf634cf90c6 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:21.246345 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e92604-1260-441d-8ea0-1bf634cf90c6 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:21.246625 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e92604-1260-441d-8ea0-1bf634cf90c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:21.278950 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-e5e92604-1260-441d-8ea0-1bf634cf90c6 None None] MFA Rules not processed for user `51ba4f014cde4bb59861cf9ae4011be5`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:21.280267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e5e92604-1260-441d-8ea0-1bf634cf90c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:21.372880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1028/2043] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:21 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:21.385233 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c71b4-9cb9-4ecc-bc86-4aedd22bce63 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:21.387537 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ff3c71b4-9cb9-4ecc-bc86-4aedd22bce63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:21.494394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c71b4-9cb9-4ecc-bc86-4aedd22bce63 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:21.499303 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b2bff-0bcc-4666-b5b6-a5dcb3c1aa44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:21.499942 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b2bff-0bcc-4666-b5b6-a5dcb3c1aa44 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:21.500223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b2bff-0bcc-4666-b5b6-a5dcb3c1aa44 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:21.500594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b2bff-0bcc-4666-b5b6-a5dcb3c1aa44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:21.513709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b2bff-0bcc-4666-b5b6-a5dcb3c1aa44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:21.517601 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b2bff-0bcc-4666-b5b6-a5dcb3c1aa44 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:21.525974 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1016/2044] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:21 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:21.940928 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e92604-1260-441d-8ea0-1bf634cf90c6 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:21.951614 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e92604-1260-441d-8ea0-1bf634cf90c6 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:21.955447 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca2244-4dd9-4541-8641-c4404ee3f956 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:21.956199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca2244-4dd9-4541-8641-c4404ee3f956 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:21.956527 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca2244-4dd9-4541-8641-c4404ee3f956 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:21.956803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca2244-4dd9-4541-8641-c4404ee3f956 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:21.960629 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:22.061125 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca2244-4dd9-4541-8641-c4404ee3f956 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:22.063124 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca2244-4dd9-4541-8641-c4404ee3f956 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:22.076228 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1029/2045] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:21 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:58:22.110064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:22.127648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b2bff-0bcc-4666-b5b6-a5dcb3c1aa44 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:22.129177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-222b2bff-0bcc-4666-b5b6-a5dcb3c1aa44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:22.244718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b2bff-0bcc-4666-b5b6-a5dcb3c1aa44 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:22.250404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf5439-14ca-47b3-8c0b-5c2708c79035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:22.251385 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf5439-14ca-47b3-8c0b-5c2708c79035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:22.251946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf5439-14ca-47b3-8c0b-5c2708c79035 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:22.252476 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf5439-14ca-47b3-8c0b-5c2708c79035 admin admin] PATH_INFO: `/v3/users/9196e7d626ec432a9a7ccea2f8af49a1` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:22.254148 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf5439-14ca-47b3-8c0b-5c2708c79035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9196e7d626ec432a9a7ccea2f8af49a1)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:22.256597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf5439-14ca-47b3-8c0b-5c2708c79035 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:22.463088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1acf5439-14ca-47b3-8c0b-5c2708c79035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9196e7d626ec432a9a7ccea2f8af49a1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:22.531797 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1acf5439-14ca-47b3-8c0b-5c2708c79035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9196e7d626ec432a9a7ccea2f8af49a1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:22.532506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1acf5439-14ca-47b3-8c0b-5c2708c79035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9196e7d626ec432a9a7ccea2f8af49a1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:22.533105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1acf5439-14ca-47b3-8c0b-5c2708c79035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9196e7d626ec432a9a7ccea2f8af49a1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:22.541542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1acf5439-14ca-47b3-8c0b-5c2708c79035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9196e7d626ec432a9a7ccea2f8af49a1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:22.584874 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1017/2046] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:22 2022] DELETE /identity/v3/users/9196e7d626ec432a9a7ccea2f8af49a1 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:22.590073 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb524e-f22c-4e9a-a49c-f5100617022f None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:22.590825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb524e-f22c-4e9a-a49c-f5100617022f None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:22.591095 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb524e-f22c-4e9a-a49c-f5100617022f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:22.612990 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-2efb524e-f22c-4e9a-a49c-f5100617022f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:22.614311 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-2efb524e-f22c-4e9a-a49c-f5100617022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:22.703273 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1030/2047] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:22.715692 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf5439-14ca-47b3-8c0b-5c2708c79035 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:22.720646 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1acf5439-14ca-47b3-8c0b-5c2708c79035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:22.783581 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf5439-14ca-47b3-8c0b-5c2708c79035 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:22.787287 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f56dce-3156-416a-ab2b-96e3b9b197ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:22.788053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f56dce-3156-416a-ab2b-96e3b9b197ac service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:22.788345 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f56dce-3156-416a-ab2b-96e3b9b197ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:22.788649 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f56dce-3156-416a-ab2b-96e3b9b197ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:22.798056 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f56dce-3156-416a-ab2b-96e3b9b197ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:22.800848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f56dce-3156-416a-ab2b-96e3b9b197ac service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:22.810507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1018/2048] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:22.966330 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:23.087755 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:23.430023 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb524e-f22c-4e9a-a49c-f5100617022f None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:23.437429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-2efb524e-f22c-4e9a-a49c-f5100617022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:23.445555 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb524e-f22c-4e9a-a49c-f5100617022f None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:23.450747 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3532b-a826-4e6c-a289-fc80a6f1dd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:23.451708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3532b-a826-4e6c-a289-fc80a6f1dd11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:23.452139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3532b-a826-4e6c-a289-fc80a6f1dd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:23.452622 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3532b-a826-4e6c-a289-fc80a6f1dd11 admin admin] PATH_INFO: `/v3/projects/1257b44b574d4160861696311e299356` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:23.453794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3532b-a826-4e6c-a289-fc80a6f1dd11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1257b44b574d4160861696311e299356)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:23.456679 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3532b-a826-4e6c-a289-fc80a6f1dd11 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:23.601533 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:23.610156 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ada3532b-a826-4e6c-a289-fc80a6f1dd11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1257b44b574d4160861696311e299356', 'request_id': 'req-ada3532b-a826-4e6c-a289-fc80a6f1dd11'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:23.616585 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ada3532b-a826-4e6c-a289-fc80a6f1dd11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1257b44b574d4160861696311e299356', 'request_id': 'req-ada3532b-a826-4e6c-a289-fc80a6f1dd11'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:23.680928 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:23.737443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ada3532b-a826-4e6c-a289-fc80a6f1dd11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1257b44b574d4160861696311e299356', 'request_id': 'req-ada3532b-a826-4e6c-a289-fc80a6f1dd11'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:23.748148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ada3532b-a826-4e6c-a289-fc80a6f1dd11 admin admin] The token cache is being invalidate because project 1257b44b574d4160861696311e299356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:23.748470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ada3532b-a826-4e6c-a289-fc80a6f1dd11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:23.749088 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ada3532b-a826-4e6c-a289-fc80a6f1dd11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:23.750698 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1031/2049] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:23 2022] DELETE /identity/v3/projects/1257b44b574d4160861696311e299356 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:23.754599 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f56dce-3156-416a-ab2b-96e3b9b197ac service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:23.764111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f56dce-3156-416a-ab2b-96e3b9b197ac service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:23.837460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f923b-7ede-41d3-bdc9-dcd4192f1dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:23.838397 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f923b-7ede-41d3-bdc9-dcd4192f1dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:23.838675 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f923b-7ede-41d3-bdc9-dcd4192f1dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:23.838949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f923b-7ede-41d3-bdc9-dcd4192f1dc1 admin admin] PATH_INFO: `/v3/users/9f28ca08d0c941d18ffa4cf3dea3d7fc` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:23.840118 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f923b-7ede-41d3-bdc9-dcd4192f1dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f28ca08d0c941d18ffa4cf3dea3d7fc)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:23.842163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f923b-7ede-41d3-bdc9-dcd4192f1dc1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:23.989401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:24.032662 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ed9f923b-7ede-41d3-bdc9-dcd4192f1dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f28ca08d0c941d18ffa4cf3dea3d7fc'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:24.109153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ed9f923b-7ede-41d3-bdc9-dcd4192f1dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f28ca08d0c941d18ffa4cf3dea3d7fc'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:24.110263 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ed9f923b-7ede-41d3-bdc9-dcd4192f1dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f28ca08d0c941d18ffa4cf3dea3d7fc'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:24.110949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ed9f923b-7ede-41d3-bdc9-dcd4192f1dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f28ca08d0c941d18ffa4cf3dea3d7fc'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:24.118480 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ed9f923b-7ede-41d3-bdc9-dcd4192f1dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f28ca08d0c941d18ffa4cf3dea3d7fc'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:24.137842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1019/2050] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:23 2022] DELETE /identity/v3/users/9f28ca08d0c941d18ffa4cf3dea3d7fc => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:24.178089 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:24.612783 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3532b-a826-4e6c-a289-fc80a6f1dd11 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:24.614831 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ada3532b-a826-4e6c-a289-fc80a6f1dd11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:24.628278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3532b-a826-4e6c-a289-fc80a6f1dd11 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:24.687348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec327e26-b6dd-4011-8ed8-6093dcb6a13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:24.687989 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec327e26-b6dd-4011-8ed8-6093dcb6a13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:24.688278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec327e26-b6dd-4011-8ed8-6093dcb6a13f admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:24.688587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec327e26-b6dd-4011-8ed8-6093dcb6a13f admin admin] PATH_INFO: `/v3/projects/e5271f35fbea4389a3b70c87a28a60a8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:24.689855 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec327e26-b6dd-4011-8ed8-6093dcb6a13f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5271f35fbea4389a3b70c87a28a60a8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:24.691775 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec327e26-b6dd-4011-8ed8-6093dcb6a13f admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:24.818015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ec327e26-b6dd-4011-8ed8-6093dcb6a13f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5271f35fbea4389a3b70c87a28a60a8', 'request_id': 'req-ec327e26-b6dd-4011-8ed8-6093dcb6a13f'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:24.824141 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ec327e26-b6dd-4011-8ed8-6093dcb6a13f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5271f35fbea4389a3b70c87a28a60a8', 'request_id': 'req-ec327e26-b6dd-4011-8ed8-6093dcb6a13f'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:24.903359 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:24.932628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ec327e26-b6dd-4011-8ed8-6093dcb6a13f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5271f35fbea4389a3b70c87a28a60a8', 'request_id': 'req-ec327e26-b6dd-4011-8ed8-6093dcb6a13f'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:24.945596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ec327e26-b6dd-4011-8ed8-6093dcb6a13f admin admin] The token cache is being invalidate because project e5271f35fbea4389a3b70c87a28a60a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:24.946112 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ec327e26-b6dd-4011-8ed8-6093dcb6a13f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:24.946864 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ec327e26-b6dd-4011-8ed8-6093dcb6a13f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:24.949243 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1032/2051] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:24 2022] DELETE /identity/v3/projects/e5271f35fbea4389a3b70c87a28a60a8 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:24.952766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f923b-7ede-41d3-bdc9-dcd4192f1dc1 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:24.954356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ed9f923b-7ede-41d3-bdc9-dcd4192f1dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:24.974803 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f923b-7ede-41d3-bdc9-dcd4192f1dc1 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:24.977146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec327e26-b6dd-4011-8ed8-6093dcb6a13f admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:24.981274 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ec327e26-b6dd-4011-8ed8-6093dcb6a13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:25.014303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:25.063835 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6540686-db7b-4cc0-b743-7b4114d71427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:25.065285 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6540686-db7b-4cc0-b743-7b4114d71427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:25.065737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6540686-db7b-4cc0-b743-7b4114d71427 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:25.066239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6540686-db7b-4cc0-b743-7b4114d71427 admin admin] PATH_INFO: `/v3/users/7b501f232162427bacf4f1a61b37c6e2` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:25.079570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6540686-db7b-4cc0-b743-7b4114d71427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b501f232162427bacf4f1a61b37c6e2)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:25.082217 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6540686-db7b-4cc0-b743-7b4114d71427 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:25.116853 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec327e26-b6dd-4011-8ed8-6093dcb6a13f admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:25.128948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba7278-93ed-4fd3-bb05-349e81cfe2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:25.129586 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba7278-93ed-4fd3-bb05-349e81cfe2dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:25.129847 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba7278-93ed-4fd3-bb05-349e81cfe2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:25.130124 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba7278-93ed-4fd3-bb05-349e81cfe2dd admin admin] PATH_INFO: `/v3/users/31fb3df4008142e783c7183884c79653` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:25.131596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba7278-93ed-4fd3-bb05-349e81cfe2dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=31fb3df4008142e783c7183884c79653)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:25.133699 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba7278-93ed-4fd3-bb05-349e81cfe2dd admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:25.277215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e6540686-db7b-4cc0-b743-7b4114d71427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b501f232162427bacf4f1a61b37c6e2'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:25.303914 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:25.348805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-aaba7278-93ed-4fd3-bb05-349e81cfe2dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31fb3df4008142e783c7183884c79653'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:25.384302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e6540686-db7b-4cc0-b743-7b4114d71427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b501f232162427bacf4f1a61b37c6e2'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:25.385040 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e6540686-db7b-4cc0-b743-7b4114d71427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b501f232162427bacf4f1a61b37c6e2'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:25.385748 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e6540686-db7b-4cc0-b743-7b4114d71427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b501f232162427bacf4f1a61b37c6e2'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:25.395369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e6540686-db7b-4cc0-b743-7b4114d71427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b501f232162427bacf4f1a61b37c6e2'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:25.415281 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1020/2052] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:24 2022] DELETE /identity/v3/users/7b501f232162427bacf4f1a61b37c6e2 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:25.476576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-aaba7278-93ed-4fd3-bb05-349e81cfe2dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31fb3df4008142e783c7183884c79653'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:25.477345 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-aaba7278-93ed-4fd3-bb05-349e81cfe2dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31fb3df4008142e783c7183884c79653'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:25.499502 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-aaba7278-93ed-4fd3-bb05-349e81cfe2dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31fb3df4008142e783c7183884c79653'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:25.501503 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-aaba7278-93ed-4fd3-bb05-349e81cfe2dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31fb3df4008142e783c7183884c79653'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:25.517596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1033/2053] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:24 2022] DELETE /identity/v3/users/31fb3df4008142e783c7183884c79653 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:25.528614 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017206cb-33b6-4bf1-813a-55d0e5add806 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:25.529076 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017206cb-33b6-4bf1-813a-55d0e5add806 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:25.529632 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017206cb-33b6-4bf1-813a-55d0e5add806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:25.557147 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-017206cb-33b6-4bf1-813a-55d0e5add806 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:25.558908 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-017206cb-33b6-4bf1-813a-55d0e5add806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:25.629728 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1021/2054] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:25.640727 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba7278-93ed-4fd3-bb05-349e81cfe2dd admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:25.642365 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-aaba7278-93ed-4fd3-bb05-349e81cfe2dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:25.703701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba7278-93ed-4fd3-bb05-349e81cfe2dd admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:25.710895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57614e5c-3f11-444b-902e-a41d552556c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:25.711579 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57614e5c-3f11-444b-902e-a41d552556c3 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:25.712682 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57614e5c-3f11-444b-902e-a41d552556c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:25.712967 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57614e5c-3f11-444b-902e-a41d552556c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:25.723889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57614e5c-3f11-444b-902e-a41d552556c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:25.725901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57614e5c-3f11-444b-902e-a41d552556c3 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:25.738149 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1034/2055] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:26.043796 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017206cb-33b6-4bf1-813a-55d0e5add806 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:26.045871 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-017206cb-33b6-4bf1-813a-55d0e5add806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:26.059990 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017206cb-33b6-4bf1-813a-55d0e5add806 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:26.065405 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcad6a-bf3f-4b39-b921-6144f3037542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:26.066117 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcad6a-bf3f-4b39-b921-6144f3037542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:26.066319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcad6a-bf3f-4b39-b921-6144f3037542 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:26.067919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcad6a-bf3f-4b39-b921-6144f3037542 admin admin] PATH_INFO: `/v3/projects/6281abe07a064272935ce733dd5ba265` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:26.069418 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcad6a-bf3f-4b39-b921-6144f3037542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6281abe07a064272935ce733dd5ba265)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:26.075951 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcad6a-bf3f-4b39-b921-6144f3037542 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:26.217747 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-61dcad6a-bf3f-4b39-b921-6144f3037542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6281abe07a064272935ce733dd5ba265', 'request_id': 'req-61dcad6a-bf3f-4b39-b921-6144f3037542'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:26.224925 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-61dcad6a-bf3f-4b39-b921-6144f3037542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6281abe07a064272935ce733dd5ba265', 'request_id': 'req-61dcad6a-bf3f-4b39-b921-6144f3037542'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:26.325833 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-61dcad6a-bf3f-4b39-b921-6144f3037542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6281abe07a064272935ce733dd5ba265', 'request_id': 'req-61dcad6a-bf3f-4b39-b921-6144f3037542'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:26.335290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57614e5c-3f11-444b-902e-a41d552556c3 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:26.336806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-57614e5c-3f11-444b-902e-a41d552556c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:26.342588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-61dcad6a-bf3f-4b39-b921-6144f3037542 admin admin] The token cache is being invalidate because project 6281abe07a064272935ce733dd5ba265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:26.343265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-61dcad6a-bf3f-4b39-b921-6144f3037542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:26.344063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-61dcad6a-bf3f-4b39-b921-6144f3037542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:26.345836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1022/2056] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:26 2022] DELETE /identity/v3/projects/6281abe07a064272935ce733dd5ba265 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:26.351690 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f5820-a316-437e-8d08-7db288cfbe9f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:26.352194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f5820-a316-437e-8d08-7db288cfbe9f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:26.353881 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57614e5c-3f11-444b-902e-a41d552556c3 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:26.354309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f5820-a316-437e-8d08-7db288cfbe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:26.387209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-5f9f5820-a316-437e-8d08-7db288cfbe9f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:26.388838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5f9f5820-a316-437e-8d08-7db288cfbe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:26.410352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:26.441509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362a536-94c5-4474-addb-c3848ae10170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:26.443376 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362a536-94c5-4474-addb-c3848ae10170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:26.443707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362a536-94c5-4474-addb-c3848ae10170 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:26.444225 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362a536-94c5-4474-addb-c3848ae10170 admin admin] PATH_INFO: `/v3/projects/f1fbea3e0e38454a87d29e5e32ab01d5` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:26.445596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362a536-94c5-4474-addb-c3848ae10170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1fbea3e0e38454a87d29e5e32ab01d5)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:26.447566 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362a536-94c5-4474-addb-c3848ae10170 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:26.466419 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1023/2057] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:26.474819 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1c91c-c1a1-402c-86ad-39a94369c99c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:26.479373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1c91c-c1a1-402c-86ad-39a94369c99c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:26.479373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1c91c-c1a1-402c-86ad-39a94369c99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:26.496085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4ea1c91c-c1a1-402c-86ad-39a94369c99c None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:26.497365 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4ea1c91c-c1a1-402c-86ad-39a94369c99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:26.505340 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1024/2058] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:26.509463 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1c91c-c1a1-402c-86ad-39a94369c99c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:26.518383 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1c91c-c1a1-402c-86ad-39a94369c99c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:26.521317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:26.525475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d2852-f66e-4ac2-805f-51e4f0760f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:26.526063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d2852-f66e-4ac2-805f-51e4f0760f21 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:26.531484 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d2852-f66e-4ac2-805f-51e4f0760f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:26.531484 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d2852-f66e-4ac2-805f-51e4f0760f21 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:26.531484 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d2852-f66e-4ac2-805f-51e4f0760f21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:58:26.531484 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d2852-f66e-4ac2-805f-51e4f0760f21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:26.531484 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d2852-f66e-4ac2-805f-51e4f0760f21 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:26.546355 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1025/2059] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:58:26.547692 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d2852-f66e-4ac2-805f-51e4f0760f21 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:26.559833 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d2852-f66e-4ac2-805f-51e4f0760f21 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:26.590408 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f362a536-94c5-4474-addb-c3848ae10170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1fbea3e0e38454a87d29e5e32ab01d5', 'request_id': 'req-f362a536-94c5-4474-addb-c3848ae10170'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:26.600954 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f362a536-94c5-4474-addb-c3848ae10170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1fbea3e0e38454a87d29e5e32ab01d5', 'request_id': 'req-f362a536-94c5-4474-addb-c3848ae10170'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:26.635024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d34a38-84ee-4c35-891f-a16787ed6115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:26.635759 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d34a38-84ee-4c35-891f-a16787ed6115 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:26.636117 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d34a38-84ee-4c35-891f-a16787ed6115 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:26.636477 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d34a38-84ee-4c35-891f-a16787ed6115 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:26.637180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d34a38-84ee-4c35-891f-a16787ed6115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:26.639228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d34a38-84ee-4c35-891f-a16787ed6115 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:26.647521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f362a536-94c5-4474-addb-c3848ae10170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1fbea3e0e38454a87d29e5e32ab01d5', 'request_id': 'req-f362a536-94c5-4474-addb-c3848ae10170'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:26.667833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f362a536-94c5-4474-addb-c3848ae10170 admin admin] The token cache is being invalidate because project f1fbea3e0e38454a87d29e5e32ab01d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:26.668245 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f362a536-94c5-4474-addb-c3848ae10170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:26.669058 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f362a536-94c5-4474-addb-c3848ae10170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:26.671418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1035/2060] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:26 2022] DELETE /identity/v3/projects/f1fbea3e0e38454a87d29e5e32ab01d5 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:26.677912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb4f18-4b98-4150-b1b4-592790cc4d98 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:26.678192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb4f18-4b98-4150-b1b4-592790cc4d98 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:26.678653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb4f18-4b98-4150-b1b4-592790cc4d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:26.703395 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-2fdb4f18-4b98-4150-b1b4-592790cc4d98 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:26.704842 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-2fdb4f18-4b98-4150-b1b4-592790cc4d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:26.716091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1036/2061] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:26.725052 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3b5d8-0405-403f-876e-e17a04286fa8 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:26.725339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3b5d8-0405-403f-876e-e17a04286fa8 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:26.725616 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3b5d8-0405-403f-876e-e17a04286fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:26.749571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-d7f3b5d8-0405-403f-876e-e17a04286fa8 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:26.750802 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d7f3b5d8-0405-403f-876e-e17a04286fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:26.759089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1037/2062] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:26.763188 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3b5d8-0405-403f-876e-e17a04286fa8 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:26.771994 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3b5d8-0405-403f-876e-e17a04286fa8 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:26.777407 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab61949-1f3e-4bcc-a271-7b4af580658e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:26.778004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab61949-1f3e-4bcc-a271-7b4af580658e admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:26.778283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab61949-1f3e-4bcc-a271-7b4af580658e admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:26.778587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab61949-1f3e-4bcc-a271-7b4af580658e admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:26.779236 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab61949-1f3e-4bcc-a271-7b4af580658e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:58:26.779537 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab61949-1f3e-4bcc-a271-7b4af580658e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:26.781172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab61949-1f3e-4bcc-a271-7b4af580658e admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:26.788531 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1026/2063] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:26 2022] POST /identity/v3/projects => generated 383 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:26.790575 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d34a38-84ee-4c35-891f-a16787ed6115 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:26.792462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d6d34a38-84ee-4c35-891f-a16787ed6115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:26.802096 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1038/2064] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:58:26.803315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab61949-1f3e-4bcc-a271-7b4af580658e admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:26.813636 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab61949-1f3e-4bcc-a271-7b4af580658e admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:26.865570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d34a38-84ee-4c35-891f-a16787ed6115 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:26.870601 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe774b2-d119-4c2f-9407-b85e50576149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:26.871211 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe774b2-d119-4c2f-9407-b85e50576149 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:26.871511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe774b2-d119-4c2f-9407-b85e50576149 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:26.871906 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe774b2-d119-4c2f-9407-b85e50576149 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:26.872565 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe774b2-d119-4c2f-9407-b85e50576149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:26.873658 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792e79e-141a-4b5d-8210-b624a12ac5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:26.874274 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792e79e-141a-4b5d-8210-b624a12ac5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:26.874531 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe774b2-d119-4c2f-9407-b85e50576149 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:26.874643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792e79e-141a-4b5d-8210-b624a12ac5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:26.874817 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792e79e-141a-4b5d-8210-b624a12ac5c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:26.875446 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792e79e-141a-4b5d-8210-b624a12ac5c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:26.877374 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792e79e-141a-4b5d-8210-b624a12ac5c9 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:26.953194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1027/2065] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:26 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:26.954168 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe774b2-d119-4c2f-9407-b85e50576149 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:26.964684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe774b2-d119-4c2f-9407-b85e50576149 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:26.971781 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7aacce-c25b-4d03-a33b-fff3a1583299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:26.980677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aacce-c25b-4d03-a33b-fff3a1583299 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:26.980677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aacce-c25b-4d03-a33b-fff3a1583299 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:26.980677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aacce-c25b-4d03-a33b-fff3a1583299 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:26.980677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7aacce-c25b-4d03-a33b-fff3a1583299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:26.980985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1039/2066] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:26 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:26.981069 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7aacce-c25b-4d03-a33b-fff3a1583299 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:26.981602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792e79e-141a-4b5d-8210-b624a12ac5c9 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:26.989605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1028/2067] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:26.990585 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7aacce-c25b-4d03-a33b-fff3a1583299 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:27.001039 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7aacce-c25b-4d03-a33b-fff3a1583299 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:27.049547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792e79e-141a-4b5d-8210-b624a12ac5c9 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:27.054734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27837a48-1b22-4762-8a14-fbe8ed37a65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:27.055758 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27837a48-1b22-4762-8a14-fbe8ed37a65e admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:27.056224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27837a48-1b22-4762-8a14-fbe8ed37a65e admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:27.056835 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27837a48-1b22-4762-8a14-fbe8ed37a65e admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:27.057760 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27837a48-1b22-4762-8a14-fbe8ed37a65e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:27.060028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27837a48-1b22-4762-8a14-fbe8ed37a65e admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:27.069050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22262d-fa93-401f-b781-1a48c9cd16b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:27.070327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22262d-fa93-401f-b781-1a48c9cd16b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:27.070859 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22262d-fa93-401f-b781-1a48c9cd16b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:27.071718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22262d-fa93-401f-b781-1a48c9cd16b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:27.072766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22262d-fa93-401f-b781-1a48c9cd16b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:27.074629 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22262d-fa93-401f-b781-1a48c9cd16b4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:27.084978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1029/2068] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:27.090457 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22262d-fa93-401f-b781-1a48c9cd16b4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:27.100140 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22262d-fa93-401f-b781-1a48c9cd16b4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:27.104877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda27d42-8469-4c0c-88dd-708caccd2962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:27.105513 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda27d42-8469-4c0c-88dd-708caccd2962 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:27.105796 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda27d42-8469-4c0c-88dd-708caccd2962 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:27.106071 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda27d42-8469-4c0c-88dd-708caccd2962 admin admin] PATH_INFO: `/v3/projects/e04de1feccd240188b34b8802598140d/users/6904eda251ca4fcaa730b2a0ee53ee53/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:27.120306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda27d42-8469-4c0c-88dd-708caccd2962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e04de1feccd240188b34b8802598140d, user_id=6904eda251ca4fcaa730b2a0ee53ee53, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:27.123055 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda27d42-8469-4c0c-88dd-708caccd2962 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:27.160519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1040/2069] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:26 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:27.164686 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27837a48-1b22-4762-8a14-fbe8ed37a65e admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:27.175287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27837a48-1b22-4762-8a14-fbe8ed37a65e admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:27.179962 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcb3ab-4c5a-4d78-bef0-8b6ecc992b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:27.180601 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcb3ab-4c5a-4d78-bef0-8b6ecc992b32 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:27.181010 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcb3ab-4c5a-4d78-bef0-8b6ecc992b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:27.181511 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcb3ab-4c5a-4d78-bef0-8b6ecc992b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:27.181957 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcb3ab-4c5a-4d78-bef0-8b6ecc992b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:27.183556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcb3ab-4c5a-4d78-bef0-8b6ecc992b32 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:27.193906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1041/2070] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:58:27.198280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcb3ab-4c5a-4d78-bef0-8b6ecc992b32 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:27.208882 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcb3ab-4c5a-4d78-bef0-8b6ecc992b32 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:27.214368 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d144d1-2cf2-4901-a5ba-f123a576692d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:27.214964 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d144d1-2cf2-4901-a5ba-f123a576692d admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:27.215476 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d144d1-2cf2-4901-a5ba-f123a576692d admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:27.215669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d144d1-2cf2-4901-a5ba-f123a576692d admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:27.216308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d144d1-2cf2-4901-a5ba-f123a576692d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:27.217920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d144d1-2cf2-4901-a5ba-f123a576692d admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:27.229512 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1042/2071] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:58:27.235837 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d144d1-2cf2-4901-a5ba-f123a576692d admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:27.242484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d144d1-2cf2-4901-a5ba-f123a576692d admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:27.247525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24f3b1-3022-4f75-868c-fcd0748a9ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:27.248131 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24f3b1-3022-4f75-868c-fcd0748a9ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:27.248409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24f3b1-3022-4f75-868c-fcd0748a9ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:27.248716 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24f3b1-3022-4f75-868c-fcd0748a9ad3 admin admin] PATH_INFO: `/v3/projects/ffc1ee9512da4511a7e93ea534d2c033/users/5f73ca5833864b62913e5c58a44bb5ce/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:27.257882 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1030/2072] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:27 2022] PUT /identity/v3/projects/e04de1feccd240188b34b8802598140d/users/6904eda251ca4fcaa730b2a0ee53ee53/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:27.265721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24f3b1-3022-4f75-868c-fcd0748a9ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc1ee9512da4511a7e93ea534d2c033, user_id=5f73ca5833864b62913e5c58a44bb5ce, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:27.268417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24f3b1-3022-4f75-868c-fcd0748a9ad3 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:27.269046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10725bc4-0c4e-4792-beff-f51d30e9177d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:27.269333 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10725bc4-0c4e-4792-beff-f51d30e9177d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:27.269628 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10725bc4-0c4e-4792-beff-f51d30e9177d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:27.297046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-10725bc4-0c4e-4792-beff-f51d30e9177d None None] MFA Rules not processed for user `6904eda251ca4fcaa730b2a0ee53ee53`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:27.298289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-10725bc4-0c4e-4792-beff-f51d30e9177d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:27.361094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1043/2073] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:27 2022] PUT /identity/v3/projects/ffc1ee9512da4511a7e93ea534d2c033/users/5f73ca5833864b62913e5c58a44bb5ce/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:27.363044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a1847-3b36-4dc7-91f2-d030e9283be3 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:27.363352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a1847-3b36-4dc7-91f2-d030e9283be3 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:27.363629 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a1847-3b36-4dc7-91f2-d030e9283be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:27.411569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1031/2074] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:27.420398 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10725bc4-0c4e-4792-beff-f51d30e9177d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:27.422242 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-10725bc4-0c4e-4792-beff-f51d30e9177d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:27.425651 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-8a8a1847-3b36-4dc7-91f2-d030e9283be3 None None] MFA Rules not processed for user `5f73ca5833864b62913e5c58a44bb5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:27.430999 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-8a8a1847-3b36-4dc7-91f2-d030e9283be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:27.505796 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10725bc4-0c4e-4792-beff-f51d30e9177d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:27.541032 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1044/2075] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:27.553543 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a1847-3b36-4dc7-91f2-d030e9283be3 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:27.554920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-8a8a1847-3b36-4dc7-91f2-d030e9283be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:27.563218 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a4bc3-b6ec-41f1-84f2-86216f4f244e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:27.563837 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a4bc3-b6ec-41f1-84f2-86216f4f244e service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:27.564122 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a4bc3-b6ec-41f1-84f2-86216f4f244e service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:27.564625 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a4bc3-b6ec-41f1-84f2-86216f4f244e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:27.614627 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a1847-3b36-4dc7-91f2-d030e9283be3 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:27.622535 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271ffb8-c82e-4212-9efb-cb49b0f85c75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:27.623232 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271ffb8-c82e-4212-9efb-cb49b0f85c75 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:27.623812 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271ffb8-c82e-4212-9efb-cb49b0f85c75 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:27.623812 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271ffb8-c82e-4212-9efb-cb49b0f85c75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:27.628680 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a4bc3-b6ec-41f1-84f2-86216f4f244e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:27.630172 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a4bc3-b6ec-41f1-84f2-86216f4f244e service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:27.632695 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271ffb8-c82e-4212-9efb-cb49b0f85c75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:27.634149 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271ffb8-c82e-4212-9efb-cb49b0f85c75 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:27.639579 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1032/2076] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:58:27.643202 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1045/2077] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:58:27.663438 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:27.726246 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:28.783468 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:29.131596 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:29.588664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:29.590338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a4bc3-b6ec-41f1-84f2-86216f4f244e service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:29.591743 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-287a4bc3-b6ec-41f1-84f2-86216f4f244e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:29.657213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a4bc3-b6ec-41f1-84f2-86216f4f244e service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:29.661771 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca454c2c-99f0-4845-af57-4aed41936668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:29.662765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca454c2c-99f0-4845-af57-4aed41936668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:29.663045 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca454c2c-99f0-4845-af57-4aed41936668 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:29.663315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca454c2c-99f0-4845-af57-4aed41936668 admin admin] PATH_INFO: `/v3/users/30e82d7d24784b34914265cb35a426e8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:29.664446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca454c2c-99f0-4845-af57-4aed41936668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e82d7d24784b34914265cb35a426e8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:29.667007 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca454c2c-99f0-4845-af57-4aed41936668 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:29.714114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:29.893460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ca454c2c-99f0-4845-af57-4aed41936668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e82d7d24784b34914265cb35a426e8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:29.977556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ca454c2c-99f0-4845-af57-4aed41936668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e82d7d24784b34914265cb35a426e8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:29.978175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ca454c2c-99f0-4845-af57-4aed41936668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e82d7d24784b34914265cb35a426e8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:29.978838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ca454c2c-99f0-4845-af57-4aed41936668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e82d7d24784b34914265cb35a426e8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:29.986151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ca454c2c-99f0-4845-af57-4aed41936668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e82d7d24784b34914265cb35a426e8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:30.003461 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1033/2078] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:29 2022] DELETE /identity/v3/users/30e82d7d24784b34914265cb35a426e8 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:30.008411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc43ed6-229c-4228-9153-fa3efd10228a None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:30.008411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc43ed6-229c-4228-9153-fa3efd10228a None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:30.009015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc43ed6-229c-4228-9153-fa3efd10228a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:30.027047 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-9cc43ed6-229c-4228-9153-fa3efd10228a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:30.028241 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9cc43ed6-229c-4228-9153-fa3efd10228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:30.092112 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1046/2079] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:30.102458 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca454c2c-99f0-4845-af57-4aed41936668 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:30.104134 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ca454c2c-99f0-4845-af57-4aed41936668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:30.170275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca454c2c-99f0-4845-af57-4aed41936668 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:30.174209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40934903-53b6-437e-8562-90302436af8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:30.174828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40934903-53b6-437e-8562-90302436af8e service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:30.175110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40934903-53b6-437e-8562-90302436af8e service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:30.175433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40934903-53b6-437e-8562-90302436af8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:30.187788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40934903-53b6-437e-8562-90302436af8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:30.190368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40934903-53b6-437e-8562-90302436af8e service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:30.200800 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1034/2080] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:30.909766 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc43ed6-229c-4228-9153-fa3efd10228a None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:30.910754 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9cc43ed6-229c-4228-9153-fa3efd10228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:30.923233 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc43ed6-229c-4228-9153-fa3efd10228a None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:30.928626 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5be2f5-ecbc-48db-8f87-762cc1d891ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:30.929406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5be2f5-ecbc-48db-8f87-762cc1d891ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:30.930063 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5be2f5-ecbc-48db-8f87-762cc1d891ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:30.935021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5be2f5-ecbc-48db-8f87-762cc1d891ce admin admin] PATH_INFO: `/v3/projects/d5cf8a9d6d884b60af54d32cb665e1db` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:30.935021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5be2f5-ecbc-48db-8f87-762cc1d891ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5cf8a9d6d884b60af54d32cb665e1db)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:30.935021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5be2f5-ecbc-48db-8f87-762cc1d891ce admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:31.059780 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-5b5be2f5-ecbc-48db-8f87-762cc1d891ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5cf8a9d6d884b60af54d32cb665e1db', 'request_id': 'req-5b5be2f5-ecbc-48db-8f87-762cc1d891ce'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:31.066336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-5b5be2f5-ecbc-48db-8f87-762cc1d891ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5cf8a9d6d884b60af54d32cb665e1db', 'request_id': 'req-5b5be2f5-ecbc-48db-8f87-762cc1d891ce'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:31.188297 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-5b5be2f5-ecbc-48db-8f87-762cc1d891ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5cf8a9d6d884b60af54d32cb665e1db', 'request_id': 'req-5b5be2f5-ecbc-48db-8f87-762cc1d891ce'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:31.203238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-5b5be2f5-ecbc-48db-8f87-762cc1d891ce admin admin] The token cache is being invalidate because project d5cf8a9d6d884b60af54d32cb665e1db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:31.203541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-5b5be2f5-ecbc-48db-8f87-762cc1d891ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:31.204173 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-5b5be2f5-ecbc-48db-8f87-762cc1d891ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:31.206130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1047/2081] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:30 2022] DELETE /identity/v3/projects/d5cf8a9d6d884b60af54d32cb665e1db => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:31.213265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473475a1-ddf7-456f-8896-372ab5cdef3e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:31.213767 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473475a1-ddf7-456f-8896-372ab5cdef3e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:31.213849 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473475a1-ddf7-456f-8896-372ab5cdef3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:31.227702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5be2f5-ecbc-48db-8f87-762cc1d891ce admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:31.229166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-5b5be2f5-ecbc-48db-8f87-762cc1d891ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:31.235992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-473475a1-ddf7-456f-8896-372ab5cdef3e None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:31.237264 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-473475a1-ddf7-456f-8896-372ab5cdef3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:31.266321 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:31.294041 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5be2f5-ecbc-48db-8f87-762cc1d891ce admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:31.298618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef99321-b98f-490d-84c3-3eef141e2d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:31.299256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef99321-b98f-490d-84c3-3eef141e2d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:31.299539 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef99321-b98f-490d-84c3-3eef141e2d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:31.299683 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1035/2082] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:31.300694 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef99321-b98f-490d-84c3-3eef141e2d3c admin admin] PATH_INFO: `/v3/users/5b82f4ff216945ac820ed4deed8a61c9` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:31.301883 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef99321-b98f-490d-84c3-3eef141e2d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b82f4ff216945ac820ed4deed8a61c9)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:31.303839 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef99321-b98f-490d-84c3-3eef141e2d3c admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:31.308090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53981217-57fa-4511-95cb-75a9858d1f5a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:31.308363 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53981217-57fa-4511-95cb-75a9858d1f5a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:31.308756 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53981217-57fa-4511-95cb-75a9858d1f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:31.330133 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-53981217-57fa-4511-95cb-75a9858d1f5a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:31.331349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-53981217-57fa-4511-95cb-75a9858d1f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:31.339894 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1036/2083] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:31.344162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53981217-57fa-4511-95cb-75a9858d1f5a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:31.354900 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53981217-57fa-4511-95cb-75a9858d1f5a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:31.366157 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ad5f9-54b5-41c4-be99-a162e90bb8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:31.366998 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ad5f9-54b5-41c4-be99-a162e90bb8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:31.368106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ad5f9-54b5-41c4-be99-a162e90bb8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:31.368568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ad5f9-54b5-41c4-be99-a162e90bb8c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:31.369393 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ad5f9-54b5-41c4-be99-a162e90bb8c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:58:31.370004 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ad5f9-54b5-41c4-be99-a162e90bb8c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:31.371884 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ad5f9-54b5-41c4-be99-a162e90bb8c8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:31.386542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1037/2084] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:58:31.391069 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ad5f9-54b5-41c4-be99-a162e90bb8c8 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:31.402511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ad5f9-54b5-41c4-be99-a162e90bb8c8 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:31.412369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57e5de-73c1-4c5f-ac37-db460123dcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:31.413147 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57e5de-73c1-4c5f-ac37-db460123dcd4 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:31.413436 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57e5de-73c1-4c5f-ac37-db460123dcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:31.413764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57e5de-73c1-4c5f-ac37-db460123dcd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:31.415122 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57e5de-73c1-4c5f-ac37-db460123dcd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:31.417213 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57e5de-73c1-4c5f-ac37-db460123dcd4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:31.574898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:31.582169 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1038/2085] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:31 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:31.583337 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57e5de-73c1-4c5f-ac37-db460123dcd4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:31.676863 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0ef99321-b98f-490d-84c3-3eef141e2d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b82f4ff216945ac820ed4deed8a61c9'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:31.677990 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57e5de-73c1-4c5f-ac37-db460123dcd4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:31.692644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69430391-5127-47f0-a37b-6aa616710224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:31.692644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69430391-5127-47f0-a37b-6aa616710224 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:31.692644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69430391-5127-47f0-a37b-6aa616710224 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:31.692644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69430391-5127-47f0-a37b-6aa616710224 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:31.695447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69430391-5127-47f0-a37b-6aa616710224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:31.697279 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69430391-5127-47f0-a37b-6aa616710224 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:31.812828 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0ef99321-b98f-490d-84c3-3eef141e2d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b82f4ff216945ac820ed4deed8a61c9'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:31.814511 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0ef99321-b98f-490d-84c3-3eef141e2d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b82f4ff216945ac820ed4deed8a61c9'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:31.843051 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1039/2086] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:31 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:31.845282 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69430391-5127-47f0-a37b-6aa616710224 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:31.848289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-69430391-5127-47f0-a37b-6aa616710224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:31.858157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0ef99321-b98f-490d-84c3-3eef141e2d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b82f4ff216945ac820ed4deed8a61c9'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:31.859269 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0ef99321-b98f-490d-84c3-3eef141e2d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b82f4ff216945ac820ed4deed8a61c9'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:31.868861 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69430391-5127-47f0-a37b-6aa616710224 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:31.876776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78985b49-062a-480e-993a-4948dbcb7894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:31.880718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78985b49-062a-480e-993a-4948dbcb7894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:31.880718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78985b49-062a-480e-993a-4948dbcb7894 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:31.880718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78985b49-062a-480e-993a-4948dbcb7894 admin admin] PATH_INFO: `/v3/users/6904eda251ca4fcaa730b2a0ee53ee53` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:31.881049 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1048/2087] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:31 2022] DELETE /identity/v3/users/5b82f4ff216945ac820ed4deed8a61c9 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:31.881049 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef99321-b98f-490d-84c3-3eef141e2d3c admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:31.881224 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78985b49-062a-480e-993a-4948dbcb7894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6904eda251ca4fcaa730b2a0ee53ee53)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:31.882608 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0ef99321-b98f-490d-84c3-3eef141e2d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:31.884799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78985b49-062a-480e-993a-4948dbcb7894 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:31.982449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef99321-b98f-490d-84c3-3eef141e2d3c admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:31.987869 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d270059-25df-46c9-be7a-33d9b9966253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:31.988639 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d270059-25df-46c9-be7a-33d9b9966253 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:31.989028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d270059-25df-46c9-be7a-33d9b9966253 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:31.989371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d270059-25df-46c9-be7a-33d9b9966253 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:31.990259 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d270059-25df-46c9-be7a-33d9b9966253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:31.992149 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d270059-25df-46c9-be7a-33d9b9966253 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:32.003536 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1049/2088] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:32.004982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23cef7-ccd4-4d76-b293-90e737858167 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:32.005276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23cef7-ccd4-4d76-b293-90e737858167 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:32.005548 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23cef7-ccd4-4d76-b293-90e737858167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:32.026468 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-3a23cef7-ccd4-4d76-b293-90e737858167 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:32.027714 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3a23cef7-ccd4-4d76-b293-90e737858167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:32.035651 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1050/2089] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:32.040984 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23cef7-ccd4-4d76-b293-90e737858167 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:32.048284 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23cef7-ccd4-4d76-b293-90e737858167 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:32.053356 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a31246-4abc-43dc-82c3-aafc517c1f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:32.053973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a31246-4abc-43dc-82c3-aafc517c1f43 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:32.054254 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a31246-4abc-43dc-82c3-aafc517c1f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:32.054525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a31246-4abc-43dc-82c3-aafc517c1f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:32.055714 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a31246-4abc-43dc-82c3-aafc517c1f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:32.057451 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a31246-4abc-43dc-82c3-aafc517c1f43 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:32.078737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1051/2090] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:32.078737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a31246-4abc-43dc-82c3-aafc517c1f43 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:32.078737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-15a31246-4abc-43dc-82c3-aafc517c1f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:32.108386 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-78985b49-062a-480e-993a-4948dbcb7894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6904eda251ca4fcaa730b2a0ee53ee53'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:32.160125 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-78985b49-062a-480e-993a-4948dbcb7894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6904eda251ca4fcaa730b2a0ee53ee53'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:32.160292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-78985b49-062a-480e-993a-4948dbcb7894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6904eda251ca4fcaa730b2a0ee53ee53'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:32.160827 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-78985b49-062a-480e-993a-4948dbcb7894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6904eda251ca4fcaa730b2a0ee53ee53'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:32.177021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-78985b49-062a-480e-993a-4948dbcb7894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6904eda251ca4fcaa730b2a0ee53ee53'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:32.179287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a31246-4abc-43dc-82c3-aafc517c1f43 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:32.182784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:32.192311 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e739b-7c4e-4430-b221-0552e1722b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:32.194525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e739b-7c4e-4430-b221-0552e1722b77 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:32.194873 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e739b-7c4e-4430-b221-0552e1722b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:32.195157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e739b-7c4e-4430-b221-0552e1722b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:32.198935 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e65e739b-7c4e-4430-b221-0552e1722b77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:32.209352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1040/2091] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:31 2022] DELETE /identity/v3/users/6904eda251ca4fcaa730b2a0ee53ee53 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:32.211381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78985b49-062a-480e-993a-4948dbcb7894 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:32.213682 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-78985b49-062a-480e-993a-4948dbcb7894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:32.232492 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e739b-7c4e-4430-b221-0552e1722b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:32.234123 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e739b-7c4e-4430-b221-0552e1722b77 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:32.247031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1052/2092] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:32.248992 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda393f-2985-4eb2-80aa-0f36abea9b93 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:32.249629 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda393f-2985-4eb2-80aa-0f36abea9b93 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:32.249840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda393f-2985-4eb2-80aa-0f36abea9b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:32.275786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-0fda393f-2985-4eb2-80aa-0f36abea9b93 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:32.277642 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0fda393f-2985-4eb2-80aa-0f36abea9b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:32.303779 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:32.344159 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78985b49-062a-480e-993a-4948dbcb7894 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:32.354270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c03f9-cad9-4b08-9a00-bfcf712467a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:32.355223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c03f9-cad9-4b08-9a00-bfcf712467a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:32.355966 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c03f9-cad9-4b08-9a00-bfcf712467a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:32.356447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c03f9-cad9-4b08-9a00-bfcf712467a9 admin admin] PATH_INFO: `/v3/projects/31567bd8432241c6ba85d49b989fa006/users/49dcf3b303e54f8ca2e45bf09381313e/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:32.367055 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1053/2093] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:32.385473 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda393f-2985-4eb2-80aa-0f36abea9b93 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:32.387528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0fda393f-2985-4eb2-80aa-0f36abea9b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:32.397050 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c03f9-cad9-4b08-9a00-bfcf712467a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31567bd8432241c6ba85d49b989fa006, user_id=49dcf3b303e54f8ca2e45bf09381313e, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:32.400159 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c03f9-cad9-4b08-9a00-bfcf712467a9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:32.464666 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda393f-2985-4eb2-80aa-0f36abea9b93 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:32.468335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20990fc5-4185-4249-bd4e-3cadb0530164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:32.469032 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20990fc5-4185-4249-bd4e-3cadb0530164 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:32.469294 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20990fc5-4185-4249-bd4e-3cadb0530164 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:32.469567 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20990fc5-4185-4249-bd4e-3cadb0530164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:32.479834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20990fc5-4185-4249-bd4e-3cadb0530164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:32.481283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20990fc5-4185-4249-bd4e-3cadb0530164 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:32.492487 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1041/2094] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:32 2022] PUT /identity/v3/projects/31567bd8432241c6ba85d49b989fa006/users/49dcf3b303e54f8ca2e45bf09381313e/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:32.494903 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1054/2095] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:32.497724 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cea09-447d-4274-9482-124ddc07982f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:32.498009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cea09-447d-4274-9482-124ddc07982f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:32.498288 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cea09-447d-4274-9482-124ddc07982f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:32.519883 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b24cea09-447d-4274-9482-124ddc07982f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:32.521017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b24cea09-447d-4274-9482-124ddc07982f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:32.595238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1042/2096] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:32.613428 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20990fc5-4185-4249-bd4e-3cadb0530164 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:32.625364 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20990fc5-4185-4249-bd4e-3cadb0530164 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:32.738598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d400854-6e79-48f5-8d5e-683fbea7c227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:32.739146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d400854-6e79-48f5-8d5e-683fbea7c227 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:32.739974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d400854-6e79-48f5-8d5e-683fbea7c227 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:32.740261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d400854-6e79-48f5-8d5e-683fbea7c227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:32.753435 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d400854-6e79-48f5-8d5e-683fbea7c227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:32.754896 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d400854-6e79-48f5-8d5e-683fbea7c227 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:32.768360 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1055/2097] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:58:32.934531 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cea09-447d-4274-9482-124ddc07982f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:32.936610 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b24cea09-447d-4274-9482-124ddc07982f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:32.957402 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cea09-447d-4274-9482-124ddc07982f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:32.964061 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08283a2e-1b50-4465-9cc7-d85baefe6037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:32.964828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08283a2e-1b50-4465-9cc7-d85baefe6037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:32.965173 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08283a2e-1b50-4465-9cc7-d85baefe6037 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:32.965740 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08283a2e-1b50-4465-9cc7-d85baefe6037 admin admin] PATH_INFO: `/v3/projects/1ee1e01c13704619996a3d1ea0fa9de3` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:32.967531 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08283a2e-1b50-4465-9cc7-d85baefe6037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ee1e01c13704619996a3d1ea0fa9de3)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:32.970377 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08283a2e-1b50-4465-9cc7-d85baefe6037 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:33.064744 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-08283a2e-1b50-4465-9cc7-d85baefe6037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ee1e01c13704619996a3d1ea0fa9de3', 'request_id': 'req-08283a2e-1b50-4465-9cc7-d85baefe6037'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:33.072199 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-08283a2e-1b50-4465-9cc7-d85baefe6037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ee1e01c13704619996a3d1ea0fa9de3', 'request_id': 'req-08283a2e-1b50-4465-9cc7-d85baefe6037'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:33.177583 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-08283a2e-1b50-4465-9cc7-d85baefe6037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ee1e01c13704619996a3d1ea0fa9de3', 'request_id': 'req-08283a2e-1b50-4465-9cc7-d85baefe6037'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:33.180642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:33.196305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-08283a2e-1b50-4465-9cc7-d85baefe6037 admin admin] The token cache is being invalidate because project 1ee1e01c13704619996a3d1ea0fa9de3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:33.196305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-08283a2e-1b50-4465-9cc7-d85baefe6037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:33.197077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-08283a2e-1b50-4465-9cc7-d85baefe6037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:33.199314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1043/2098] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:32 2022] DELETE /identity/v3/projects/1ee1e01c13704619996a3d1ea0fa9de3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:33.205871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d400854-6e79-48f5-8d5e-683fbea7c227 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:33.221456 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d400854-6e79-48f5-8d5e-683fbea7c227 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:33.281403 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7493190-0e1b-4c28-962f-78d95b5c2f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:33.282128 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7493190-0e1b-4c28-962f-78d95b5c2f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:33.282485 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7493190-0e1b-4c28-962f-78d95b5c2f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:33.282828 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7493190-0e1b-4c28-962f-78d95b5c2f79 admin admin] PATH_INFO: `/v3/users/51ba4f014cde4bb59861cf9ae4011be5` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:33.283968 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7493190-0e1b-4c28-962f-78d95b5c2f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ba4f014cde4bb59861cf9ae4011be5)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:33.285985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7493190-0e1b-4c28-962f-78d95b5c2f79 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:33.300301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:33.316559 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08283a2e-1b50-4465-9cc7-d85baefe6037 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:33.318465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-08283a2e-1b50-4465-9cc7-d85baefe6037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:33.331493 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08283a2e-1b50-4465-9cc7-d85baefe6037 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:33.336789 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253c4d7-7534-46c3-920e-896f6cd08caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:33.337410 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253c4d7-7534-46c3-920e-896f6cd08caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:33.337688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253c4d7-7534-46c3-920e-896f6cd08caf admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:33.337961 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253c4d7-7534-46c3-920e-896f6cd08caf admin admin] PATH_INFO: `/v3/projects/e04de1feccd240188b34b8802598140d` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:33.339095 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253c4d7-7534-46c3-920e-896f6cd08caf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e04de1feccd240188b34b8802598140d)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:33.341039 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253c4d7-7534-46c3-920e-896f6cd08caf admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:33.538131 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d7493190-0e1b-4c28-962f-78d95b5c2f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ba4f014cde4bb59861cf9ae4011be5'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:33.544922 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-9253c4d7-7534-46c3-920e-896f6cd08caf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e04de1feccd240188b34b8802598140d', 'request_id': 'req-9253c4d7-7534-46c3-920e-896f6cd08caf'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:33.554453 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-9253c4d7-7534-46c3-920e-896f6cd08caf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e04de1feccd240188b34b8802598140d', 'request_id': 'req-9253c4d7-7534-46c3-920e-896f6cd08caf'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:33.628648 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d7493190-0e1b-4c28-962f-78d95b5c2f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ba4f014cde4bb59861cf9ae4011be5'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:33.629543 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d7493190-0e1b-4c28-962f-78d95b5c2f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ba4f014cde4bb59861cf9ae4011be5'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:33.654927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d7493190-0e1b-4c28-962f-78d95b5c2f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ba4f014cde4bb59861cf9ae4011be5'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:33.655683 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d7493190-0e1b-4c28-962f-78d95b5c2f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ba4f014cde4bb59861cf9ae4011be5'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:33.674739 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1056/2099] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:33 2022] DELETE /identity/v3/users/51ba4f014cde4bb59861cf9ae4011be5 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:33.675832 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7493190-0e1b-4c28-962f-78d95b5c2f79 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:33.677230 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d7493190-0e1b-4c28-962f-78d95b5c2f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:33.714211 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-9253c4d7-7534-46c3-920e-896f6cd08caf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e04de1feccd240188b34b8802598140d', 'request_id': 'req-9253c4d7-7534-46c3-920e-896f6cd08caf'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:33.728465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-9253c4d7-7534-46c3-920e-896f6cd08caf admin admin] The token cache is being invalidate because project e04de1feccd240188b34b8802598140d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:33.728465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-9253c4d7-7534-46c3-920e-896f6cd08caf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:33.729187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-9253c4d7-7534-46c3-920e-896f6cd08caf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:33.731070 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1044/2100] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:33 2022] DELETE /identity/v3/projects/e04de1feccd240188b34b8802598140d => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:33.735708 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac8616-6cc7-4909-b39b-7ac3f98aca4f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:33.735993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac8616-6cc7-4909-b39b-7ac3f98aca4f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:33.736271 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac8616-6cc7-4909-b39b-7ac3f98aca4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:33.768598 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-06ac8616-6cc7-4909-b39b-7ac3f98aca4f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:33.770419 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-06ac8616-6cc7-4909-b39b-7ac3f98aca4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:33.793104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1045/2101] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:33.794808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7493190-0e1b-4c28-962f-78d95b5c2f79 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:33.795766 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bbb00-c0b9-4c2b-943f-b42b8cebe6f2 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:33.796055 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bbb00-c0b9-4c2b-943f-b42b8cebe6f2 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:33.797180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bbb00-c0b9-4c2b-943f-b42b8cebe6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:33.802191 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966a4bf-59eb-4d13-b3d2-ac238060a423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:33.802953 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966a4bf-59eb-4d13-b3d2-ac238060a423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:33.803494 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966a4bf-59eb-4d13-b3d2-ac238060a423 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:33.803866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966a4bf-59eb-4d13-b3d2-ac238060a423 admin admin] PATH_INFO: `/v3/users/5f73ca5833864b62913e5c58a44bb5ce` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:33.806711 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966a4bf-59eb-4d13-b3d2-ac238060a423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f73ca5833864b62913e5c58a44bb5ce)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:33.808877 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966a4bf-59eb-4d13-b3d2-ac238060a423 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:33.849465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-275bbb00-c0b9-4c2b-943f-b42b8cebe6f2 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:33.850680 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-275bbb00-c0b9-4c2b-943f-b42b8cebe6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:33.874752 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1046/2102] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:33.879341 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bbb00-c0b9-4c2b-943f-b42b8cebe6f2 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:33.896061 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bbb00-c0b9-4c2b-943f-b42b8cebe6f2 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:33.907596 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25b6fe-119b-42f7-ac71-0b01377b903d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:33.910066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25b6fe-119b-42f7-ac71-0b01377b903d admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:33.910351 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25b6fe-119b-42f7-ac71-0b01377b903d admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:33.910728 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25b6fe-119b-42f7-ac71-0b01377b903d admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:33.911675 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25b6fe-119b-42f7-ac71-0b01377b903d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:58:33.912128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25b6fe-119b-42f7-ac71-0b01377b903d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:33.914681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25b6fe-119b-42f7-ac71-0b01377b903d admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:33.931858 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1047/2103] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:58:33.936397 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25b6fe-119b-42f7-ac71-0b01377b903d admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:33.949883 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25b6fe-119b-42f7-ac71-0b01377b903d admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:33.956880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df321f-e3a7-4dcd-bc53-fc81a96b3e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:33.957623 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df321f-e3a7-4dcd-bc53-fc81a96b3e40 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:33.957977 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df321f-e3a7-4dcd-bc53-fc81a96b3e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:33.958327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df321f-e3a7-4dcd-bc53-fc81a96b3e40 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:33.959125 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df321f-e3a7-4dcd-bc53-fc81a96b3e40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:33.961837 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df321f-e3a7-4dcd-bc53-fc81a96b3e40 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:34.049707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d966a4bf-59eb-4d13-b3d2-ac238060a423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f73ca5833864b62913e5c58a44bb5ce'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:34.078202 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1048/2104] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:33 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:34.079534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df321f-e3a7-4dcd-bc53-fc81a96b3e40 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:34.139525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d966a4bf-59eb-4d13-b3d2-ac238060a423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f73ca5833864b62913e5c58a44bb5ce'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:34.140093 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d966a4bf-59eb-4d13-b3d2-ac238060a423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f73ca5833864b62913e5c58a44bb5ce'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:34.158153 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d966a4bf-59eb-4d13-b3d2-ac238060a423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f73ca5833864b62913e5c58a44bb5ce'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:34.159233 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d966a4bf-59eb-4d13-b3d2-ac238060a423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f73ca5833864b62913e5c58a44bb5ce'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:34.188580 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df321f-e3a7-4dcd-bc53-fc81a96b3e40 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:34.197661 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1057/2105] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:33 2022] DELETE /identity/v3/users/5f73ca5833864b62913e5c58a44bb5ce => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:34.204255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb19ee2-3694-4abf-b7a1-2e757d27952a None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:34.204255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb19ee2-3694-4abf-b7a1-2e757d27952a None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:34.204255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb19ee2-3694-4abf-b7a1-2e757d27952a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:34.247905 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-ffb19ee2-3694-4abf-b7a1-2e757d27952a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:34.249212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ffb19ee2-3694-4abf-b7a1-2e757d27952a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:34.254451 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:34.338168 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1058/2106] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:34.338473 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1918f-be6d-4e17-840e-76e9c80d7a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:34.339295 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1918f-be6d-4e17-840e-76e9c80d7a41 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:34.339590 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1918f-be6d-4e17-840e-76e9c80d7a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:34.339867 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1918f-be6d-4e17-840e-76e9c80d7a41 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:34.340617 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1918f-be6d-4e17-840e-76e9c80d7a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:34.342736 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1918f-be6d-4e17-840e-76e9c80d7a41 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:34.348950 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb19ee2-3694-4abf-b7a1-2e757d27952a None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:34.350708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ffb19ee2-3694-4abf-b7a1-2e757d27952a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:34.389546 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:34.416620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb19ee2-3694-4abf-b7a1-2e757d27952a None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:34.421952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f92bb-ad35-4931-8b3e-e60c5de01f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:34.422577 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f92bb-ad35-4931-8b3e-e60c5de01f31 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:34.422862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f92bb-ad35-4931-8b3e-e60c5de01f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:34.429550 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f92bb-ad35-4931-8b3e-e60c5de01f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:34.430498 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1049/2107] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:34 2022] POST /identity/v3/users => generated 286 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:34.430498 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1918f-be6d-4e17-840e-76e9c80d7a41 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:34.433407 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a6d1918f-be6d-4e17-840e-76e9c80d7a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:34.447979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f92bb-ad35-4931-8b3e-e60c5de01f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:34.449051 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1918f-be6d-4e17-840e-76e9c80d7a41 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:34.449657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f92bb-ad35-4931-8b3e-e60c5de01f31 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:34.458176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16e1c2-41c2-46ab-aa39-e87befd3a77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:34.458176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16e1c2-41c2-46ab-aa39-e87befd3a77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:34.458176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16e1c2-41c2-46ab-aa39-e87befd3a77c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:34.458176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16e1c2-41c2-46ab-aa39-e87befd3a77c admin admin] PATH_INFO: `/v3/projects/7276165f71b64243917f3b80ce93d4f4` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:34.459103 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16e1c2-41c2-46ab-aa39-e87befd3a77c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7276165f71b64243917f3b80ce93d4f4)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:34.461593 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1059/2108] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:34.462045 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16e1c2-41c2-46ab-aa39-e87befd3a77c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:34.462593 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f92bb-ad35-4931-8b3e-e60c5de01f31 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:34.465531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7f3f92bb-ad35-4931-8b3e-e60c5de01f31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:34.480164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f92bb-ad35-4931-8b3e-e60c5de01f31 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:34.493017 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c045f9a-3bf8-4d19-94c2-1cae032b80ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:34.493017 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c045f9a-3bf8-4d19-94c2-1cae032b80ea admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:34.493017 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c045f9a-3bf8-4d19-94c2-1cae032b80ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:34.493017 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c045f9a-3bf8-4d19-94c2-1cae032b80ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:34.493383 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c045f9a-3bf8-4d19-94c2-1cae032b80ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:34.493383 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c045f9a-3bf8-4d19-94c2-1cae032b80ea admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:34.511095 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1060/2109] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:34.512863 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c045f9a-3bf8-4d19-94c2-1cae032b80ea admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:34.528866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c045f9a-3bf8-4d19-94c2-1cae032b80ea admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:34.538406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97005acc-c075-445b-badc-db82701af4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:34.539023 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97005acc-c075-445b-badc-db82701af4bb admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:34.539967 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97005acc-c075-445b-badc-db82701af4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:34.540248 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97005acc-c075-445b-badc-db82701af4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:34.540979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97005acc-c075-445b-badc-db82701af4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:34.542788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97005acc-c075-445b-badc-db82701af4bb admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:34.557809 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1061/2110] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:34.559633 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97005acc-c075-445b-badc-db82701af4bb admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:34.577987 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97005acc-c075-445b-badc-db82701af4bb admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:34.586818 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af450f8-d95b-46b9-af5a-c7721ccccace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:34.588050 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af450f8-d95b-46b9-af5a-c7721ccccace admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:34.588583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af450f8-d95b-46b9-af5a-c7721ccccace admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:34.588818 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af450f8-d95b-46b9-af5a-c7721ccccace admin admin] PATH_INFO: `/v3/projects/d54522b27e2b4215899050dda31b35a0/users/007f7b3dc17a4cab982514d8c7765720/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:34.627712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af450f8-d95b-46b9-af5a-c7721ccccace admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54522b27e2b4215899050dda31b35a0, user_id=007f7b3dc17a4cab982514d8c7765720, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:34.630826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af450f8-d95b-46b9-af5a-c7721ccccace admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:34.634526 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-df16e1c2-41c2-46ab-aa39-e87befd3a77c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7276165f71b64243917f3b80ce93d4f4', 'request_id': 'req-df16e1c2-41c2-46ab-aa39-e87befd3a77c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:34.642302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-df16e1c2-41c2-46ab-aa39-e87befd3a77c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7276165f71b64243917f3b80ce93d4f4', 'request_id': 'req-df16e1c2-41c2-46ab-aa39-e87befd3a77c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:34.734357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-df16e1c2-41c2-46ab-aa39-e87befd3a77c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7276165f71b64243917f3b80ce93d4f4', 'request_id': 'req-df16e1c2-41c2-46ab-aa39-e87befd3a77c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:34.738897 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1062/2111] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:34 2022] PUT /identity/v3/projects/d54522b27e2b4215899050dda31b35a0/users/007f7b3dc17a4cab982514d8c7765720/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:34.749295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccbeec-52c6-46e1-af8f-2f558c645b11 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:34.749612 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccbeec-52c6-46e1-af8f-2f558c645b11 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:34.749780 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccbeec-52c6-46e1-af8f-2f558c645b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:34.765148 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-df16e1c2-41c2-46ab-aa39-e87befd3a77c admin admin] The token cache is being invalidate because project 7276165f71b64243917f3b80ce93d4f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:34.766133 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-df16e1c2-41c2-46ab-aa39-e87befd3a77c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:34.768310 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-df16e1c2-41c2-46ab-aa39-e87befd3a77c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:34.773084 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1050/2112] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:34 2022] DELETE /identity/v3/projects/7276165f71b64243917f3b80ce93d4f4 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:34.779392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719871ad-6011-4c5c-b922-653c474ca0f9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:34.783182 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719871ad-6011-4c5c-b922-653c474ca0f9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:34.783182 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719871ad-6011-4c5c-b922-653c474ca0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:34.800138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-d2ccbeec-52c6-46e1-af8f-2f558c645b11 None None] MFA Rules not processed for user `007f7b3dc17a4cab982514d8c7765720`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:34.806973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d2ccbeec-52c6-46e1-af8f-2f558c645b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:34.823776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-719871ad-6011-4c5c-b922-653c474ca0f9 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:34.825127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-719871ad-6011-4c5c-b922-653c474ca0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:34.887917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1063/2113] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:34.904045 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccbeec-52c6-46e1-af8f-2f558c645b11 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:34.912860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d2ccbeec-52c6-46e1-af8f-2f558c645b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:34.913162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1051/2114] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:34.915589 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e473234-11b6-48ff-8dd1-3a224d126d00 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:34.916168 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e473234-11b6-48ff-8dd1-3a224d126d00 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:34.916449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e473234-11b6-48ff-8dd1-3a224d126d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:34.954404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-5e473234-11b6-48ff-8dd1-3a224d126d00 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:34.958780 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5e473234-11b6-48ff-8dd1-3a224d126d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:34.968203 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1052/2115] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:34.969534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e473234-11b6-48ff-8dd1-3a224d126d00 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:34.979827 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e473234-11b6-48ff-8dd1-3a224d126d00 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:34.985085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805786ac-db2e-40d8-95a6-7ce6e8a97bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:34.987538 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805786ac-db2e-40d8-95a6-7ce6e8a97bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:34.987538 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805786ac-db2e-40d8-95a6-7ce6e8a97bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:34.987538 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805786ac-db2e-40d8-95a6-7ce6e8a97bc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:34.987538 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805786ac-db2e-40d8-95a6-7ce6e8a97bc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:58:34.987538 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805786ac-db2e-40d8-95a6-7ce6e8a97bc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:34.989462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805786ac-db2e-40d8-95a6-7ce6e8a97bc8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:34.993038 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccbeec-52c6-46e1-af8f-2f558c645b11 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:34.997098 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898efef-74cb-46aa-aed9-f7147ed7f574 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a2c1f1668814a5e9e654c6308fa0628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:34.998335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898efef-74cb-46aa-aed9-f7147ed7f574 service glance] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:34.998623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898efef-74cb-46aa-aed9-f7147ed7f574 service glance] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:34.998900 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898efef-74cb-46aa-aed9-f7147ed7f574 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:35.007863 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1053/2116] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:58:35.007863 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805786ac-db2e-40d8-95a6-7ce6e8a97bc8 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:35.011188 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898efef-74cb-46aa-aed9-f7147ed7f574 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:35.012845 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898efef-74cb-46aa-aed9-f7147ed7f574 service glance] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:35.021011 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805786ac-db2e-40d8-95a6-7ce6e8a97bc8 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:35.029380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e1864-dcfc-4c8b-af62-29ed571f736e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:35.032374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e1864-dcfc-4c8b-af62-29ed571f736e admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:35.032807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e1864-dcfc-4c8b-af62-29ed571f736e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:35.033053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e1864-dcfc-4c8b-af62-29ed571f736e admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:35.033661 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1064/2117] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:35.035016 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e1864-dcfc-4c8b-af62-29ed571f736e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:35.036802 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e1864-dcfc-4c8b-af62-29ed571f736e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:35.176473 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1054/2118] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:35 2022] POST /identity/v3/projects => generated 367 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:35.179055 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898efef-74cb-46aa-aed9-f7147ed7f574 service glance] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:35.196935 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898efef-74cb-46aa-aed9-f7147ed7f574 service glance] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:35.224769 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e1864-dcfc-4c8b-af62-29ed571f736e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:35.225928 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ac4e1864-dcfc-4c8b-af62-29ed571f736e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:35.313465 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a5741-86db-4b63-9753-fe6f1ca23a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:35.314418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a5741-86db-4b63-9753-fe6f1ca23a92 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:35.314700 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a5741-86db-4b63-9753-fe6f1ca23a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:35.314971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a5741-86db-4b63-9753-fe6f1ca23a92 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:35.315784 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a5741-86db-4b63-9753-fe6f1ca23a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:35.319295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a5741-86db-4b63-9753-fe6f1ca23a92 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:35.334308 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e1864-dcfc-4c8b-af62-29ed571f736e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:35.340564 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b5d24-bded-4fb9-bd0d-d3c913b6d220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:35.341289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b5d24-bded-4fb9-bd0d-d3c913b6d220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:35.341568 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b5d24-bded-4fb9-bd0d-d3c913b6d220 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:35.341854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b5d24-bded-4fb9-bd0d-d3c913b6d220 admin admin] PATH_INFO: `/v3/projects/ffc1ee9512da4511a7e93ea534d2c033` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:35.343130 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b5d24-bded-4fb9-bd0d-d3c913b6d220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc1ee9512da4511a7e93ea534d2c033)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:35.345136 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b5d24-bded-4fb9-bd0d-d3c913b6d220 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:35.542202 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1065/2119] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:35 2022] POST /identity/v3/users => generated 284 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:35.542202 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a5741-86db-4b63-9753-fe6f1ca23a92 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:35.543340 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-295a5741-86db-4b63-9753-fe6f1ca23a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:35.556526 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a5741-86db-4b63-9753-fe6f1ca23a92 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:35.586013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-330b5d24-bded-4fb9-bd0d-d3c913b6d220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc1ee9512da4511a7e93ea534d2c033', 'request_id': 'req-330b5d24-bded-4fb9-bd0d-d3c913b6d220'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:35.586013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-330b5d24-bded-4fb9-bd0d-d3c913b6d220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc1ee9512da4511a7e93ea534d2c033', 'request_id': 'req-330b5d24-bded-4fb9-bd0d-d3c913b6d220'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:35.631474 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d5ead-5880-4e07-9ff6-c1ac0070116a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:35.632123 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d5ead-5880-4e07-9ff6-c1ac0070116a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:35.632575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d5ead-5880-4e07-9ff6-c1ac0070116a admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:35.632710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d5ead-5880-4e07-9ff6-c1ac0070116a admin admin] PATH_INFO: `/v3/users/e8a7ebc8c8f64fe897a8dbedcc803eee` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:35.634397 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d5ead-5880-4e07-9ff6-c1ac0070116a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a7ebc8c8f64fe897a8dbedcc803eee)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:35.636400 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d5ead-5880-4e07-9ff6-c1ac0070116a admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:35.703065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-330b5d24-bded-4fb9-bd0d-d3c913b6d220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc1ee9512da4511a7e93ea534d2c033', 'request_id': 'req-330b5d24-bded-4fb9-bd0d-d3c913b6d220'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:35.720043 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-330b5d24-bded-4fb9-bd0d-d3c913b6d220 admin admin] The token cache is being invalidate because project ffc1ee9512da4511a7e93ea534d2c033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:35.720576 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-330b5d24-bded-4fb9-bd0d-d3c913b6d220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:35.721511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-330b5d24-bded-4fb9-bd0d-d3c913b6d220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:35.723502 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1055/2120] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:35 2022] DELETE /identity/v3/projects/ffc1ee9512da4511a7e93ea534d2c033 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:35.727484 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b5d24-bded-4fb9-bd0d-d3c913b6d220 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:35.728927 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-330b5d24-bded-4fb9-bd0d-d3c913b6d220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:35.741896 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b5d24-bded-4fb9-bd0d-d3c913b6d220 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:35.747592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c745ed-37bb-4758-8886-e986964dff5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:35.748322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c745ed-37bb-4758-8886-e986964dff5b admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:35.748808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c745ed-37bb-4758-8886-e986964dff5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:35.749174 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c745ed-37bb-4758-8886-e986964dff5b admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:35.749937 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c745ed-37bb-4758-8886-e986964dff5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:35.751691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c745ed-37bb-4758-8886-e986964dff5b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:35.762672 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1056/2121] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:35.763938 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7051cf4-4f90-4b72-9b9e-d845481f028d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:35.764221 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7051cf4-4f90-4b72-9b9e-d845481f028d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:35.764520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7051cf4-4f90-4b72-9b9e-d845481f028d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:35.785594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a7051cf4-4f90-4b72-9b9e-d845481f028d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:35.786943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a7051cf4-4f90-4b72-9b9e-d845481f028d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:35.798202 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:35.812103 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1057/2122] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:35.821278 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7051cf4-4f90-4b72-9b9e-d845481f028d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:35.837950 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7051cf4-4f90-4b72-9b9e-d845481f028d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:35.845451 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfdc3e-23e7-4740-bb60-72767cdb95d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:35.846474 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfdc3e-23e7-4740-bb60-72767cdb95d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:35.846814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfdc3e-23e7-4740-bb60-72767cdb95d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:35.847145 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfdc3e-23e7-4740-bb60-72767cdb95d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:35.852205 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfdc3e-23e7-4740-bb60-72767cdb95d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:35.852330 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4e7d5ead-5880-4e07-9ff6-c1ac0070116a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a7ebc8c8f64fe897a8dbedcc803eee'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:35.852444 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfdc3e-23e7-4740-bb60-72767cdb95d1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:35.864801 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1058/2123] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:35.867073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20918f28-36d6-469d-b0c3-f5a4abeec41d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:35.868561 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20918f28-36d6-469d-b0c3-f5a4abeec41d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:35.868936 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20918f28-36d6-469d-b0c3-f5a4abeec41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:35.890463 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-20918f28-36d6-469d-b0c3-f5a4abeec41d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:35.891788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-20918f28-36d6-469d-b0c3-f5a4abeec41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:35.897466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:35.906154 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1059/2124] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:35.907104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20918f28-36d6-469d-b0c3-f5a4abeec41d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:35.917439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20918f28-36d6-469d-b0c3-f5a4abeec41d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:35.923350 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c3d15-2772-40a9-aa7d-b6f0f80e8589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:35.924220 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c3d15-2772-40a9-aa7d-b6f0f80e8589 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:35.924613 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c3d15-2772-40a9-aa7d-b6f0f80e8589 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:35.924934 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c3d15-2772-40a9-aa7d-b6f0f80e8589 admin admin] PATH_INFO: `/v3/projects/6a9bc424f2214d6cb22d48ece430e747/users/3aa35dbc601c4b799374f5ca885729ad/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:35.926851 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4e7d5ead-5880-4e07-9ff6-c1ac0070116a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a7ebc8c8f64fe897a8dbedcc803eee'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:35.928701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4e7d5ead-5880-4e07-9ff6-c1ac0070116a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a7ebc8c8f64fe897a8dbedcc803eee'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:35.949781 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c3d15-2772-40a9-aa7d-b6f0f80e8589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9bc424f2214d6cb22d48ece430e747, user_id=3aa35dbc601c4b799374f5ca885729ad, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:35.952165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4e7d5ead-5880-4e07-9ff6-c1ac0070116a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a7ebc8c8f64fe897a8dbedcc803eee'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:35.952743 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c3d15-2772-40a9-aa7d-b6f0f80e8589 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:35.953033 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4e7d5ead-5880-4e07-9ff6-c1ac0070116a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a7ebc8c8f64fe897a8dbedcc803eee'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:35.968580 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1066/2125] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:35 2022] DELETE /identity/v3/users/e8a7ebc8c8f64fe897a8dbedcc803eee => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:35.972292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d5ead-5880-4e07-9ff6-c1ac0070116a admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:35.972292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4e7d5ead-5880-4e07-9ff6-c1ac0070116a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:36.058377 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1060/2126] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:35 2022] PUT /identity/v3/projects/6a9bc424f2214d6cb22d48ece430e747/users/3aa35dbc601c4b799374f5ca885729ad/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:36.070955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60817616-d035-43a3-ad63-864f1f4a0c1c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:36.071533 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60817616-d035-43a3-ad63-864f1f4a0c1c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:36.072187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60817616-d035-43a3-ad63-864f1f4a0c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:36.106072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d5ead-5880-4e07-9ff6-c1ac0070116a admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:36.151162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-60817616-d035-43a3-ad63-864f1f4a0c1c None None] MFA Rules not processed for user `3aa35dbc601c4b799374f5ca885729ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:36.152392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-60817616-d035-43a3-ad63-864f1f4a0c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:36.225776 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b372f4-5871-4b91-9e0a-ad58149d6f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:36.227042 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b372f4-5871-4b91-9e0a-ad58149d6f13 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:36.227324 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b372f4-5871-4b91-9e0a-ad58149d6f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:36.228106 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b372f4-5871-4b91-9e0a-ad58149d6f13 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:36.228871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b372f4-5871-4b91-9e0a-ad58149d6f13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:58:36.229202 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b372f4-5871-4b91-9e0a-ad58149d6f13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:36.230899 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b372f4-5871-4b91-9e0a-ad58149d6f13 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:36.249517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1067/2127] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:58:36.251219 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b372f4-5871-4b91-9e0a-ad58149d6f13 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:36.266744 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b372f4-5871-4b91-9e0a-ad58149d6f13 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:36.275791 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6632d4-c8f3-4fbc-bc0e-aeb1813759df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:36.276865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6632d4-c8f3-4fbc-bc0e-aeb1813759df admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:36.277211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6632d4-c8f3-4fbc-bc0e-aeb1813759df admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:36.277541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6632d4-c8f3-4fbc-bc0e-aeb1813759df admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:36.278325 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6632d4-c8f3-4fbc-bc0e-aeb1813759df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:36.280321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6632d4-c8f3-4fbc-bc0e-aeb1813759df admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:36.304654 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1061/2128] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:36.313613 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60817616-d035-43a3-ad63-864f1f4a0c1c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:36.316039 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-60817616-d035-43a3-ad63-864f1f4a0c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:36.347370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60817616-d035-43a3-ad63-864f1f4a0c1c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:36.374366 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee280f-a2d6-4ce3-b497-72e043f6f57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:36.375732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee280f-a2d6-4ce3-b497-72e043f6f57c admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:36.375732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee280f-a2d6-4ce3-b497-72e043f6f57c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:36.375732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee280f-a2d6-4ce3-b497-72e043f6f57c admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:36.376257 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee280f-a2d6-4ce3-b497-72e043f6f57c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:36.378282 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee280f-a2d6-4ce3-b497-72e043f6f57c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:36.407060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1068/2129] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:36 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:36.407060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6632d4-c8f3-4fbc-bc0e-aeb1813759df admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:36.407060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ca6632d4-c8f3-4fbc-bc0e-aeb1813759df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:36.502999 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6632d4-c8f3-4fbc-bc0e-aeb1813759df admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:36.511432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a130ea-d1a4-433e-903d-ebae9304d497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:36.513691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a130ea-d1a4-433e-903d-ebae9304d497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:36.513691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a130ea-d1a4-433e-903d-ebae9304d497 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:36.513691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a130ea-d1a4-433e-903d-ebae9304d497 admin admin] PATH_INFO: `/v3/projects/77a4dfe1b3f04f02a5186b36e8fff072` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:36.517447 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a130ea-d1a4-433e-903d-ebae9304d497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a4dfe1b3f04f02a5186b36e8fff072)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:36.519804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a130ea-d1a4-433e-903d-ebae9304d497 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:36.542630 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1062/2130] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:36 2022] POST /identity/v3/projects => generated 365 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:36.546565 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee280f-a2d6-4ce3-b497-72e043f6f57c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:36.622744 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee280f-a2d6-4ce3-b497-72e043f6f57c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:36.627710 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ffe78-8ac4-4008-82f1-0b4d96de74d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:36.628493 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ffe78-8ac4-4008-82f1-0b4d96de74d2 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:36.628849 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ffe78-8ac4-4008-82f1-0b4d96de74d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:36.629525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ffe78-8ac4-4008-82f1-0b4d96de74d2 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:36.629920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ffe78-8ac4-4008-82f1-0b4d96de74d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:36.632286 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ffe78-8ac4-4008-82f1-0b4d96de74d2 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:36.684469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c0a130ea-d1a4-433e-903d-ebae9304d497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a4dfe1b3f04f02a5186b36e8fff072', 'request_id': 'req-c0a130ea-d1a4-433e-903d-ebae9304d497'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:36.694105 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c0a130ea-d1a4-433e-903d-ebae9304d497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a4dfe1b3f04f02a5186b36e8fff072', 'request_id': 'req-c0a130ea-d1a4-433e-903d-ebae9304d497'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:36.732036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1063/2131] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:36 2022] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:36.732874 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ffe78-8ac4-4008-82f1-0b4d96de74d2 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:36.746788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ffe78-8ac4-4008-82f1-0b4d96de74d2 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:36.754579 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:36.807204 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01513bd3-276b-4ae0-a73a-15b262d58533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:36.807833 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01513bd3-276b-4ae0-a73a-15b262d58533 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:36.808115 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01513bd3-276b-4ae0-a73a-15b262d58533 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:36.808389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01513bd3-276b-4ae0-a73a-15b262d58533 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:36.809070 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01513bd3-276b-4ae0-a73a-15b262d58533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:36.810394 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c0a130ea-d1a4-433e-903d-ebae9304d497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a4dfe1b3f04f02a5186b36e8fff072', 'request_id': 'req-c0a130ea-d1a4-433e-903d-ebae9304d497'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:36.811169 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01513bd3-276b-4ae0-a73a-15b262d58533 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:36.827137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c0a130ea-d1a4-433e-903d-ebae9304d497 admin admin] The token cache is being invalidate because project 77a4dfe1b3f04f02a5186b36e8fff072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:36.827593 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c0a130ea-d1a4-433e-903d-ebae9304d497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:36.828722 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c0a130ea-d1a4-433e-903d-ebae9304d497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:36.830507 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1069/2132] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:36 2022] DELETE /identity/v3/projects/77a4dfe1b3f04f02a5186b36e8fff072 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:36.831431 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a130ea-d1a4-433e-903d-ebae9304d497 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:36.833330 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c0a130ea-d1a4-433e-903d-ebae9304d497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:36.848266 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a130ea-d1a4-433e-903d-ebae9304d497 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:36.856189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4464e89-891c-4bee-8e86-bb1ee21af384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:36.856938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4464e89-891c-4bee-8e86-bb1ee21af384 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:36.857287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4464e89-891c-4bee-8e86-bb1ee21af384 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:36.857630 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4464e89-891c-4bee-8e86-bb1ee21af384 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:36.858384 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4464e89-891c-4bee-8e86-bb1ee21af384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:36.860053 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4464e89-891c-4bee-8e86-bb1ee21af384 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:36.873223 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1070/2133] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:36.874082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15221569-9a32-4554-9991-0edf5e204f0a None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:36.874395 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15221569-9a32-4554-9991-0edf5e204f0a None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:36.874736 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15221569-9a32-4554-9991-0edf5e204f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:36.910699 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-15221569-9a32-4554-9991-0edf5e204f0a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:36.912444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-15221569-9a32-4554-9991-0edf5e204f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:36.919221 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1064/2134] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:36 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:36.920155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01513bd3-276b-4ae0-a73a-15b262d58533 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:36.930049 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1071/2135] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:36.931049 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15221569-9a32-4554-9991-0edf5e204f0a None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:36.932858 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-15221569-9a32-4554-9991-0edf5e204f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:36.939840 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01513bd3-276b-4ae0-a73a-15b262d58533 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:36.947928 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15221569-9a32-4554-9991-0edf5e204f0a None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:36.949949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b44e7c-350e-42fb-8e3f-002e86350aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:36.950765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b44e7c-350e-42fb-8e3f-002e86350aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:36.951189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b44e7c-350e-42fb-8e3f-002e86350aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:36.951697 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b44e7c-350e-42fb-8e3f-002e86350aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:36.952708 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b44e7c-350e-42fb-8e3f-002e86350aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:36.953548 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945d3d8-2e00-4b5a-81f1-3dc23e315c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:36.954246 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945d3d8-2e00-4b5a-81f1-3dc23e315c54 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:36.954674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945d3d8-2e00-4b5a-81f1-3dc23e315c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:36.955018 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945d3d8-2e00-4b5a-81f1-3dc23e315c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:36.955829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945d3d8-2e00-4b5a-81f1-3dc23e315c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:36.956281 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b44e7c-350e-42fb-8e3f-002e86350aa3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:36.957705 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945d3d8-2e00-4b5a-81f1-3dc23e315c54 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:36.973028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1072/2136] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:36.974551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b989e4-f660-4f21-8a3a-e88b14c513a8 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:36.974985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b989e4-f660-4f21-8a3a-e88b14c513a8 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:36.976253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b989e4-f660-4f21-8a3a-e88b14c513a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:36.981371 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1065/2137] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:36.982666 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b44e7c-350e-42fb-8e3f-002e86350aa3 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:36.998061 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b44e7c-350e-42fb-8e3f-002e86350aa3 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:37.005449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-14b989e4-f660-4f21-8a3a-e88b14c513a8 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:37.006706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80645c3-752c-4d7f-8753-16c57c100d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:37.007235 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-14b989e4-f660-4f21-8a3a-e88b14c513a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:37.008486 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80645c3-752c-4d7f-8753-16c57c100d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:37.008948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80645c3-752c-4d7f-8753-16c57c100d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:37.011665 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80645c3-752c-4d7f-8753-16c57c100d76 admin admin] PATH_INFO: `/v3/projects/afdf98efdaeb43ddb5a183de84c440c1/users/b05166c48f2e410ca50034d6c2007418/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:37.038579 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1073/2138] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:37.038579 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b989e4-f660-4f21-8a3a-e88b14c513a8 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:37.051053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80645c3-752c-4d7f-8753-16c57c100d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afdf98efdaeb43ddb5a183de84c440c1, user_id=b05166c48f2e410ca50034d6c2007418, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:37.054098 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80645c3-752c-4d7f-8753-16c57c100d76 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:37.054223 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b989e4-f660-4f21-8a3a-e88b14c513a8 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:37.062387 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168c8b8-e470-4735-a64f-4ed43ff79a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:37.063216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168c8b8-e470-4735-a64f-4ed43ff79a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:37.063506 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168c8b8-e470-4735-a64f-4ed43ff79a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:37.063842 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168c8b8-e470-4735-a64f-4ed43ff79a7e admin admin] PATH_INFO: `/v3/projects/bd6ee49a17e949b887521d5b7630eb17/users/d884c4dd840e4e3d99f64aa1178b39b1/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:37.099487 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168c8b8-e470-4735-a64f-4ed43ff79a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd6ee49a17e949b887521d5b7630eb17, user_id=d884c4dd840e4e3d99f64aa1178b39b1, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:37.103472 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168c8b8-e470-4735-a64f-4ed43ff79a7e admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:37.138845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1066/2139] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:36 2022] PUT /identity/v3/projects/afdf98efdaeb43ddb5a183de84c440c1/users/b05166c48f2e410ca50034d6c2007418/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:37.139812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80645c3-752c-4d7f-8753-16c57c100d76 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:37.178682 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1074/2140] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:37 2022] PUT /identity/v3/projects/bd6ee49a17e949b887521d5b7630eb17/users/d884c4dd840e4e3d99f64aa1178b39b1/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:37.179359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168c8b8-e470-4735-a64f-4ed43ff79a7e admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:37.251290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80645c3-752c-4d7f-8753-16c57c100d76 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:37.262957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:37.281303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168c8b8-e470-4735-a64f-4ed43ff79a7e admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:37.287315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57480f24-d209-455f-a804-a74beed4c144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:37.288045 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57480f24-d209-455f-a804-a74beed4c144 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:37.288252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57480f24-d209-455f-a804-a74beed4c144 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:37.289417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57480f24-d209-455f-a804-a74beed4c144 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:37.290189 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57480f24-d209-455f-a804-a74beed4c144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:37.292370 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57480f24-d209-455f-a804-a74beed4c144 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:37.307095 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1075/2141] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:37.310365 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ac723-2abb-4238-8c9e-9887d0ba9fe6 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:37.310621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ac723-2abb-4238-8c9e-9887d0ba9fe6 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:37.311225 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ac723-2abb-4238-8c9e-9887d0ba9fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:37.339820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0789aa-0bc7-48e3-adda-b4c14039082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:37.343700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0789aa-0bc7-48e3-adda-b4c14039082a admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:37.343700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0789aa-0bc7-48e3-adda-b4c14039082a admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:37.343700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0789aa-0bc7-48e3-adda-b4c14039082a admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:37.343700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0789aa-0bc7-48e3-adda-b4c14039082a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:58:37.343700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0789aa-0bc7-48e3-adda-b4c14039082a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:37.344040 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0789aa-0bc7-48e3-adda-b4c14039082a admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:37.358460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1067/2142] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:58:37.359345 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0789aa-0bc7-48e3-adda-b4c14039082a admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:37.365035 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-322ac723-2abb-4238-8c9e-9887d0ba9fe6 None None] MFA Rules not processed for user `d884c4dd840e4e3d99f64aa1178b39b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:37.368067 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-322ac723-2abb-4238-8c9e-9887d0ba9fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:37.374319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0789aa-0bc7-48e3-adda-b4c14039082a admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:37.382291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e91d0-6092-45eb-8c0e-83ddb5cd42da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:37.383168 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e91d0-6092-45eb-8c0e-83ddb5cd42da admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:37.383940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e91d0-6092-45eb-8c0e-83ddb5cd42da admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:37.383940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e91d0-6092-45eb-8c0e-83ddb5cd42da admin admin] PATH_INFO: `/v3/projects/afdf98efdaeb43ddb5a183de84c440c1/users/b05166c48f2e410ca50034d6c2007418/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:37.385824 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e91d0-6092-45eb-8c0e-83ddb5cd42da admin admin] RBAC: Authorizing `identity:create_grant(project_id=afdf98efdaeb43ddb5a183de84c440c1, user_id=b05166c48f2e410ca50034d6c2007418, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:37.389762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e91d0-6092-45eb-8c0e-83ddb5cd42da admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:37.406575 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1068/2143] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:37 2022] PUT /identity/v3/projects/afdf98efdaeb43ddb5a183de84c440c1/users/b05166c48f2e410ca50034d6c2007418/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:37.407498 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e91d0-6092-45eb-8c0e-83ddb5cd42da admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:37.474291 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1076/2144] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:37.475700 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0a4d3-7626-4c41-a1bb-0e7056396d6a None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:37.477839 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0a4d3-7626-4c41-a1bb-0e7056396d6a None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:37.478473 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0a4d3-7626-4c41-a1bb-0e7056396d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:37.497159 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e91d0-6092-45eb-8c0e-83ddb5cd42da admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:37.503677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf280c3-eb9f-4cc0-b9ed-a40ab7dc6811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:37.504316 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf280c3-eb9f-4cc0-b9ed-a40ab7dc6811 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:37.504627 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf280c3-eb9f-4cc0-b9ed-a40ab7dc6811 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:37.505167 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf280c3-eb9f-4cc0-b9ed-a40ab7dc6811 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:37.505704 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf280c3-eb9f-4cc0-b9ed-a40ab7dc6811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:37.507999 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf280c3-eb9f-4cc0-b9ed-a40ab7dc6811 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:37.528186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-ddb0a4d3-7626-4c41-a1bb-0e7056396d6a None None] MFA Rules not processed for user `b05166c48f2e410ca50034d6c2007418`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:37.529858 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ddb0a4d3-7626-4c41-a1bb-0e7056396d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:37.620197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1069/2145] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:37 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:37.623535 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf280c3-eb9f-4cc0-b9ed-a40ab7dc6811 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:37.627460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0cf280c3-eb9f-4cc0-b9ed-a40ab7dc6811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:37.639453 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:37.644359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1077/2146] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:37.645825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0a4d3-7626-4c41-a1bb-0e7056396d6a None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:37.683254 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0a4d3-7626-4c41-a1bb-0e7056396d6a None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:37.761336 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf280c3-eb9f-4cc0-b9ed-a40ab7dc6811 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:37.766759 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32239dd5-5c35-4b3f-9984-b24f3833e7d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a2c1f1668814a5e9e654c6308fa0628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:37.767400 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32239dd5-5c35-4b3f-9984-b24f3833e7d8 service glance] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:37.769084 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32239dd5-5c35-4b3f-9984-b24f3833e7d8 service glance] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:37.769230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32239dd5-5c35-4b3f-9984-b24f3833e7d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:37.776587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5acf9-f27c-404c-b409-9f76a6b0af50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:37.778394 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5acf9-f27c-404c-b409-9f76a6b0af50 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:37.778817 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5acf9-f27c-404c-b409-9f76a6b0af50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:37.779186 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5acf9-f27c-404c-b409-9f76a6b0af50 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:37.779897 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5acf9-f27c-404c-b409-9f76a6b0af50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:37.796052 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5acf9-f27c-404c-b409-9f76a6b0af50 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:37.893365 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32239dd5-5c35-4b3f-9984-b24f3833e7d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:37.895204 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32239dd5-5c35-4b3f-9984-b24f3833e7d8 service glance] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:37.916987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1070/2147] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:37.918329 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32239dd5-5c35-4b3f-9984-b24f3833e7d8 service glance] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:37.920267 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-32239dd5-5c35-4b3f-9984-b24f3833e7d8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:38.010967 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32239dd5-5c35-4b3f-9984-b24f3833e7d8 service glance] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:38.029917 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c107ce-863d-4333-8352-75a960b15d93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:38.030620 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c107ce-863d-4333-8352-75a960b15d93 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:38.032579 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c107ce-863d-4333-8352-75a960b15d93 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:38.032579 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c107ce-863d-4333-8352-75a960b15d93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:38.041498 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1078/2148] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:37 2022] POST /identity/v3/users => generated 287 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:38.042449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5acf9-f27c-404c-b409-9f76a6b0af50 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:38.074220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5acf9-f27c-404c-b409-9f76a6b0af50 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:38.106351 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac1cd9-966c-4205-bf7a-64aa3dfc320b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:38.106351 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac1cd9-966c-4205-bf7a-64aa3dfc320b admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:38.106351 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac1cd9-966c-4205-bf7a-64aa3dfc320b admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:38.106351 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac1cd9-966c-4205-bf7a-64aa3dfc320b admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:38.106833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac1cd9-966c-4205-bf7a-64aa3dfc320b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:38.108621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac1cd9-966c-4205-bf7a-64aa3dfc320b admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:38.139407 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1079/2149] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:38.145738 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac1cd9-966c-4205-bf7a-64aa3dfc320b admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:38.169597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac1cd9-966c-4205-bf7a-64aa3dfc320b admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:38.194679 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:38.202624 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017156c7-a375-40e4-9cc7-1ec3c5399782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:38.203300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017156c7-a375-40e4-9cc7-1ec3c5399782 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:38.203514 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017156c7-a375-40e4-9cc7-1ec3c5399782 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:38.203786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017156c7-a375-40e4-9cc7-1ec3c5399782 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:38.204444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017156c7-a375-40e4-9cc7-1ec3c5399782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:38.206674 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c107ce-863d-4333-8352-75a960b15d93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:38.209694 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c107ce-863d-4333-8352-75a960b15d93 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:38.213803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017156c7-a375-40e4-9cc7-1ec3c5399782 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:38.224867 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1071/2150] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:38.245474 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1080/2151] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:38.249710 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c107ce-863d-4333-8352-75a960b15d93 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:38.273452 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c107ce-863d-4333-8352-75a960b15d93 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:38.288171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98b1be-2878-4079-8666-f4fa69314b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:38.290597 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98b1be-2878-4079-8666-f4fa69314b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:38.291046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98b1be-2878-4079-8666-f4fa69314b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:38.291493 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98b1be-2878-4079-8666-f4fa69314b6a admin admin] PATH_INFO: `/v3/projects/f2c8514997c845eeab55f2b989db5365/users/3e58a468789f4ae588ceb614fd22b22f/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:38.317828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98b1be-2878-4079-8666-f4fa69314b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2c8514997c845eeab55f2b989db5365, user_id=3e58a468789f4ae588ceb614fd22b22f, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:38.322340 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98b1be-2878-4079-8666-f4fa69314b6a admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:38.441632 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1072/2152] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:38 2022] PUT /identity/v3/projects/f2c8514997c845eeab55f2b989db5365/users/3e58a468789f4ae588ceb614fd22b22f/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:38.465591 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03583a9a-0fe8-4f1b-a782-dc17291b2260 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:38.465891 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03583a9a-0fe8-4f1b-a782-dc17291b2260 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:38.466442 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03583a9a-0fe8-4f1b-a782-dc17291b2260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:38.512729 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-03583a9a-0fe8-4f1b-a782-dc17291b2260 None None] MFA Rules not processed for user `3e58a468789f4ae588ceb614fd22b22f`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:38.513953 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-03583a9a-0fe8-4f1b-a782-dc17291b2260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:38.576673 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98b1be-2878-4079-8666-f4fa69314b6a admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:38.635117 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1081/2153] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:38.647852 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03583a9a-0fe8-4f1b-a782-dc17291b2260 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:38.650084 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-03583a9a-0fe8-4f1b-a782-dc17291b2260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:38.657726 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98b1be-2878-4079-8666-f4fa69314b6a admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:38.661764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c2855-e9eb-4d9c-8705-27c2cb3f2d60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:38.662436 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c2855-e9eb-4d9c-8705-27c2cb3f2d60 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:38.662720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c2855-e9eb-4d9c-8705-27c2cb3f2d60 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:38.662990 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c2855-e9eb-4d9c-8705-27c2cb3f2d60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:38.665649 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-693c2855-e9eb-4d9c-8705-27c2cb3f2d60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:38.749385 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:38.754537 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c2855-e9eb-4d9c-8705-27c2cb3f2d60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:38.755247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c2855-e9eb-4d9c-8705-27c2cb3f2d60 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:38.776036 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03583a9a-0fe8-4f1b-a782-dc17291b2260 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:38.783989 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1073/2154] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:38.784161 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb7902-31c0-4aad-9b4a-261152110669 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:38.784161 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb7902-31c0-4aad-9b4a-261152110669 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:38.784161 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb7902-31c0-4aad-9b4a-261152110669 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:38.784161 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb7902-31c0-4aad-9b4a-261152110669 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:38.796213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb7902-31c0-4aad-9b4a-261152110669 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:38.797859 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb7902-31c0-4aad-9b4a-261152110669 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:38.810891 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1082/2155] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:58:38.865691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:39.392235 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c2855-e9eb-4d9c-8705-27c2cb3f2d60 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:39.463963 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c2855-e9eb-4d9c-8705-27c2cb3f2d60 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:39.468806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84193683-f55e-4250-9d7e-4f6f69738c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:39.469449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84193683-f55e-4250-9d7e-4f6f69738c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:39.469732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84193683-f55e-4250-9d7e-4f6f69738c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:39.470007 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84193683-f55e-4250-9d7e-4f6f69738c4b admin admin] PATH_INFO: `/v3/users/3e58a468789f4ae588ceb614fd22b22f` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:39.471202 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84193683-f55e-4250-9d7e-4f6f69738c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e58a468789f4ae588ceb614fd22b22f)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:39.478484 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84193683-f55e-4250-9d7e-4f6f69738c4b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:39.699016 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-84193683-f55e-4250-9d7e-4f6f69738c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e58a468789f4ae588ceb614fd22b22f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:39.776957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-84193683-f55e-4250-9d7e-4f6f69738c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e58a468789f4ae588ceb614fd22b22f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:39.777806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-84193683-f55e-4250-9d7e-4f6f69738c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e58a468789f4ae588ceb614fd22b22f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:39.778451 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-84193683-f55e-4250-9d7e-4f6f69738c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e58a468789f4ae588ceb614fd22b22f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:39.796356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-84193683-f55e-4250-9d7e-4f6f69738c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e58a468789f4ae588ceb614fd22b22f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:39.844478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1074/2156] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:39 2022] DELETE /identity/v3/users/3e58a468789f4ae588ceb614fd22b22f => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:39.849284 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0731c-b3e2-4e47-ab1d-8e82932fe313 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:39.849803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0731c-b3e2-4e47-ab1d-8e82932fe313 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:39.849803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0731c-b3e2-4e47-ab1d-8e82932fe313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:39.887898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-2cc0731c-b3e2-4e47-ab1d-8e82932fe313 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:39.892873 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-2cc0731c-b3e2-4e47-ab1d-8e82932fe313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:39.968884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1083/2157] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:39.980801 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84193683-f55e-4250-9d7e-4f6f69738c4b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:39.985762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-84193683-f55e-4250-9d7e-4f6f69738c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:40.076955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84193683-f55e-4250-9d7e-4f6f69738c4b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:40.081429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4babf-74c7-4741-8058-56e511d50e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:40.082506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4babf-74c7-4741-8058-56e511d50e4b service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:40.083143 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4babf-74c7-4741-8058-56e511d50e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:40.088230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4babf-74c7-4741-8058-56e511d50e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:40.104740 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4babf-74c7-4741-8058-56e511d50e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:40.110214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4babf-74c7-4741-8058-56e511d50e4b service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:40.116403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1075/2158] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:40.145558 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:40.229498 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:40.725096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:40.876812 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0731c-b3e2-4e47-ab1d-8e82932fe313 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:40.878228 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-2cc0731c-b3e2-4e47-ab1d-8e82932fe313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:40.898973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0731c-b3e2-4e47-ab1d-8e82932fe313 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:40.913330 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd807f4c-151f-4351-99fd-2ec7d38be8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:40.916332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd807f4c-151f-4351-99fd-2ec7d38be8ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:40.916332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd807f4c-151f-4351-99fd-2ec7d38be8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:40.916332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd807f4c-151f-4351-99fd-2ec7d38be8ed admin admin] PATH_INFO: `/v3/projects/f2c8514997c845eeab55f2b989db5365` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:40.916332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd807f4c-151f-4351-99fd-2ec7d38be8ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2c8514997c845eeab55f2b989db5365)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:40.917941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd807f4c-151f-4351-99fd-2ec7d38be8ed admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:41.056663 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-cd807f4c-151f-4351-99fd-2ec7d38be8ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2c8514997c845eeab55f2b989db5365', 'request_id': 'req-cd807f4c-151f-4351-99fd-2ec7d38be8ed'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:41.065914 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-cd807f4c-151f-4351-99fd-2ec7d38be8ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2c8514997c845eeab55f2b989db5365', 'request_id': 'req-cd807f4c-151f-4351-99fd-2ec7d38be8ed'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:41.130924 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-cd807f4c-151f-4351-99fd-2ec7d38be8ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2c8514997c845eeab55f2b989db5365', 'request_id': 'req-cd807f4c-151f-4351-99fd-2ec7d38be8ed'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:41.150267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:41.159412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-cd807f4c-151f-4351-99fd-2ec7d38be8ed admin admin] The token cache is being invalidate because project f2c8514997c845eeab55f2b989db5365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:41.159871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-cd807f4c-151f-4351-99fd-2ec7d38be8ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:41.160843 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-cd807f4c-151f-4351-99fd-2ec7d38be8ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:41.162863 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1084/2159] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:40 2022] DELETE /identity/v3/projects/f2c8514997c845eeab55f2b989db5365 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:41.169282 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6860a75-58cf-4cdf-9782-2c3cb4297869 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:41.170248 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6860a75-58cf-4cdf-9782-2c3cb4297869 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:41.172457 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6860a75-58cf-4cdf-9782-2c3cb4297869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:41.204533 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d6860a75-58cf-4cdf-9782-2c3cb4297869 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:41.205756 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d6860a75-58cf-4cdf-9782-2c3cb4297869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:41.281085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1076/2160] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:41.291078 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19318525-aea2-44d6-ad6d-61c4fed57ec1 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:41.291294 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19318525-aea2-44d6-ad6d-61c4fed57ec1 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:41.291804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19318525-aea2-44d6-ad6d-61c4fed57ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:41.313745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-19318525-aea2-44d6-ad6d-61c4fed57ec1 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:41.317549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-19318525-aea2-44d6-ad6d-61c4fed57ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:41.324796 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1085/2161] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:41.328828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6860a75-58cf-4cdf-9782-2c3cb4297869 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:41.338448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6860a75-58cf-4cdf-9782-2c3cb4297869 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:41.355106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73dce0-373f-4c83-9a1e-34dda40ec3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:41.355106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73dce0-373f-4c83-9a1e-34dda40ec3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:41.355106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73dce0-373f-4c83-9a1e-34dda40ec3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:41.355106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73dce0-373f-4c83-9a1e-34dda40ec3b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:41.355441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73dce0-373f-4c83-9a1e-34dda40ec3b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:58:41.355441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73dce0-373f-4c83-9a1e-34dda40ec3b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:41.355441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73dce0-373f-4c83-9a1e-34dda40ec3b8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:41.364247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891563c-07a8-46e4-b168-2e99f94e2d5f None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:41.364571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891563c-07a8-46e4-b168-2e99f94e2d5f None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:41.364853 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891563c-07a8-46e4-b168-2e99f94e2d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:41.365493 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1077/2162] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:58:41.370412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73dce0-373f-4c83-9a1e-34dda40ec3b8 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:41.383850 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73dce0-373f-4c83-9a1e-34dda40ec3b8 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:41.386162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f325f-38f0-461b-a731-212b853b7d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:41.386842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f325f-38f0-461b-a731-212b853b7d38 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:41.387186 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f325f-38f0-461b-a731-212b853b7d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:41.387525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f325f-38f0-461b-a731-212b853b7d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:41.392125 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f325f-38f0-461b-a731-212b853b7d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:41.392125 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f325f-38f0-461b-a731-212b853b7d38 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:41.406236 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-6891563c-07a8-46e4-b168-2e99f94e2d5f None None] MFA Rules not processed for user `49dcf3b303e54f8ca2e45bf09381313e`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:41.407425 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-6891563c-07a8-46e4-b168-2e99f94e2d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:41.480927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1086/2163] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:41.485266 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891563c-07a8-46e4-b168-2e99f94e2d5f None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:41.486599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-6891563c-07a8-46e4-b168-2e99f94e2d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:41.492408 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1078/2164] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:41 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:41.496526 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f325f-38f0-461b-a731-212b853b7d38 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:41.501291 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891563c-07a8-46e4-b168-2e99f94e2d5f None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:41.523574 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:41.558572 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:41.564515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026afce-4a24-4103-a953-8bf13cbd43bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:41.565136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026afce-4a24-4103-a953-8bf13cbd43bb admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:41.565415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026afce-4a24-4103-a953-8bf13cbd43bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:41.565689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026afce-4a24-4103-a953-8bf13cbd43bb admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:41.566391 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026afce-4a24-4103-a953-8bf13cbd43bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:41.568627 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026afce-4a24-4103-a953-8bf13cbd43bb admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:41.575349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f325f-38f0-461b-a731-212b853b7d38 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:41.580622 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81120e2d-fad3-467f-b26c-c70b1e3bf5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:41.581382 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81120e2d-fad3-467f-b26c-c70b1e3bf5ef admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:41.581668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81120e2d-fad3-467f-b26c-c70b1e3bf5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:41.581942 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81120e2d-fad3-467f-b26c-c70b1e3bf5ef admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:41.582577 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81120e2d-fad3-467f-b26c-c70b1e3bf5ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:41.584620 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81120e2d-fad3-467f-b26c-c70b1e3bf5ef admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:41.670176 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1087/2165] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:41 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:41.673909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026afce-4a24-4103-a953-8bf13cbd43bb admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:41.694701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1079/2166] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:41 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:41.696092 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81120e2d-fad3-467f-b26c-c70b1e3bf5ef admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:41.706172 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81120e2d-fad3-467f-b26c-c70b1e3bf5ef admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:41.741254 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026afce-4a24-4103-a953-8bf13cbd43bb admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:41.745943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c57ecb-4463-4284-b2ab-120534b0854b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:41.746563 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c57ecb-4463-4284-b2ab-120534b0854b admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:41.746838 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c57ecb-4463-4284-b2ab-120534b0854b admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:41.747109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c57ecb-4463-4284-b2ab-120534b0854b admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:41.748051 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c57ecb-4463-4284-b2ab-120534b0854b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:41.749729 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c57ecb-4463-4284-b2ab-120534b0854b admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:41.771027 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eee00c-0fec-41af-8252-23131df8a83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:41.771499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eee00c-0fec-41af-8252-23131df8a83f admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:41.771842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eee00c-0fec-41af-8252-23131df8a83f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:41.772212 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eee00c-0fec-41af-8252-23131df8a83f admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:41.773660 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eee00c-0fec-41af-8252-23131df8a83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:41.775697 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eee00c-0fec-41af-8252-23131df8a83f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:41.792521 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1080/2167] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:58:41.792661 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eee00c-0fec-41af-8252-23131df8a83f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:41.806749 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eee00c-0fec-41af-8252-23131df8a83f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:41.818624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083aee35-70b8-43b2-8d3d-2eb3af2181f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:41.819692 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083aee35-70b8-43b2-8d3d-2eb3af2181f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:41.820783 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083aee35-70b8-43b2-8d3d-2eb3af2181f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:41.821114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083aee35-70b8-43b2-8d3d-2eb3af2181f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:41.821836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083aee35-70b8-43b2-8d3d-2eb3af2181f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:41.823842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083aee35-70b8-43b2-8d3d-2eb3af2181f7 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:41.838018 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1081/2168] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:41.841868 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083aee35-70b8-43b2-8d3d-2eb3af2181f7 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:41.855656 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083aee35-70b8-43b2-8d3d-2eb3af2181f7 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:41.861228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144a221-af4f-477b-92fa-a0af598216d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:41.861995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144a221-af4f-477b-92fa-a0af598216d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:41.862342 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144a221-af4f-477b-92fa-a0af598216d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:41.862616 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144a221-af4f-477b-92fa-a0af598216d1 admin admin] PATH_INFO: `/v3/projects/d27978f588e04774861eee13d8c5c2bf/users/8e10d53e065349b1b092d7178a5d9c48/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:41.869055 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1088/2169] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:41 2022] POST /identity/v3/users => generated 298 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:41.870521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c57ecb-4463-4284-b2ab-120534b0854b admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:41.888208 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144a221-af4f-477b-92fa-a0af598216d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27978f588e04774861eee13d8c5c2bf, user_id=8e10d53e065349b1b092d7178a5d9c48, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:41.891180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144a221-af4f-477b-92fa-a0af598216d1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:41.903890 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c57ecb-4463-4284-b2ab-120534b0854b admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:41.909391 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908ff5d-1d32-4c2f-956b-2b98b3479bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:41.910119 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908ff5d-1d32-4c2f-956b-2b98b3479bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:41.910465 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908ff5d-1d32-4c2f-956b-2b98b3479bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:41.910801 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908ff5d-1d32-4c2f-956b-2b98b3479bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:41.911619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908ff5d-1d32-4c2f-956b-2b98b3479bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:41.913343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908ff5d-1d32-4c2f-956b-2b98b3479bd3 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:41.931630 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1089/2170] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:58:41.932769 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908ff5d-1d32-4c2f-956b-2b98b3479bd3 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:41.955756 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908ff5d-1d32-4c2f-956b-2b98b3479bd3 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:41.978584 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b44f7a-1ed9-4d5d-b493-69267d044c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:41.980877 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b44f7a-1ed9-4d5d-b493-69267d044c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:41.980993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1082/2171] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:41 2022] PUT /identity/v3/projects/d27978f588e04774861eee13d8c5c2bf/users/8e10d53e065349b1b092d7178a5d9c48/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:41.981126 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b44f7a-1ed9-4d5d-b493-69267d044c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:41.994726 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64528e3e-4849-456e-967b-6e85e13bf9fd None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:41.994726 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64528e3e-4849-456e-967b-6e85e13bf9fd None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:41.996322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b44f7a-1ed9-4d5d-b493-69267d044c9d admin admin] PATH_INFO: `/v3/projects/ccaed869688c450eb9b49200158483b0/users/23b84c71d4a34c3aabc3eb57715127c9/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:42.001467 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64528e3e-4849-456e-967b-6e85e13bf9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:42.038349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b44f7a-1ed9-4d5d-b493-69267d044c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccaed869688c450eb9b49200158483b0, user_id=23b84c71d4a34c3aabc3eb57715127c9, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:42.041401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b44f7a-1ed9-4d5d-b493-69267d044c9d admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:42.059700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-64528e3e-4849-456e-967b-6e85e13bf9fd None None] MFA Rules not processed for user `8e10d53e065349b1b092d7178a5d9c48`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:42.061804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-64528e3e-4849-456e-967b-6e85e13bf9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:42.130726 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1090/2172] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:41 2022] PUT /identity/v3/projects/ccaed869688c450eb9b49200158483b0/users/23b84c71d4a34c3aabc3eb57715127c9/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:42.135203 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b44f7a-1ed9-4d5d-b493-69267d044c9d admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:42.143371 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:42.152147 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1083/2173] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:42.153634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64528e3e-4849-456e-967b-6e85e13bf9fd None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:42.208200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b44f7a-1ed9-4d5d-b493-69267d044c9d admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:42.215538 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d660b-e11a-4d34-b585-eb0a42adbc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:42.216164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d660b-e11a-4d34-b585-eb0a42adbc7a admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:42.216620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d660b-e11a-4d34-b585-eb0a42adbc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:42.217010 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d660b-e11a-4d34-b585-eb0a42adbc7a admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:42.217523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d660b-e11a-4d34-b585-eb0a42adbc7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:42.219248 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d660b-e11a-4d34-b585-eb0a42adbc7a admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:42.226887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64528e3e-4849-456e-967b-6e85e13bf9fd None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:42.231934 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1091/2174] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:42.232695 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0307b-7e74-4934-b507-0e2ab974b7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:42.233402 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0307b-7e74-4934-b507-0e2ab974b7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:42.233756 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0307b-7e74-4934-b507-0e2ab974b7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:42.233999 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0307b-7e74-4934-b507-0e2ab974b7d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:42.234873 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0307b-7e74-4934-b507-0e2ab974b7d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:42.235792 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d660b-e11a-4d34-b585-eb0a42adbc7a admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:42.237198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0307b-7e74-4934-b507-0e2ab974b7d2 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:42.248993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d660b-e11a-4d34-b585-eb0a42adbc7a admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:42.254825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e3e68-f86d-4305-a156-0c1661ac44ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:42.255687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e3e68-f86d-4305-a156-0c1661ac44ef admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:42.256195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e3e68-f86d-4305-a156-0c1661ac44ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:42.256624 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e3e68-f86d-4305-a156-0c1661ac44ef admin admin] PATH_INFO: `/v3/projects/ccaed869688c450eb9b49200158483b0/users/23b84c71d4a34c3aabc3eb57715127c9/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:42.259630 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e3e68-f86d-4305-a156-0c1661ac44ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccaed869688c450eb9b49200158483b0, user_id=23b84c71d4a34c3aabc3eb57715127c9, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:42.262609 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e3e68-f86d-4305-a156-0c1661ac44ef admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:42.275899 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1092/2175] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:42 2022] PUT /identity/v3/projects/ccaed869688c450eb9b49200158483b0/users/23b84c71d4a34c3aabc3eb57715127c9/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:42.333993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1084/2176] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:42 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:42.338037 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e3e68-f86d-4305-a156-0c1661ac44ef admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:42.363672 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:42.407311 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e3e68-f86d-4305-a156-0c1661ac44ef admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:42.499587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a88f84-b629-449b-92a3-17ef3497f9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:42.500224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a88f84-b629-449b-92a3-17ef3497f9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:42.500568 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a88f84-b629-449b-92a3-17ef3497f9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:42.500856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a88f84-b629-449b-92a3-17ef3497f9f7 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:42.501508 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a88f84-b629-449b-92a3-17ef3497f9f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:42.503647 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a88f84-b629-449b-92a3-17ef3497f9f7 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:42.636287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1093/2177] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:42 2022] POST /identity/v3/users => generated 295 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:42.640744 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0307b-7e74-4934-b507-0e2ab974b7d2 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:42.652282 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0307b-7e74-4934-b507-0e2ab974b7d2 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:42.659229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960e725-ae0c-4f1f-b173-661dc994a6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:42.667511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960e725-ae0c-4f1f-b173-661dc994a6ab admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:42.667511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960e725-ae0c-4f1f-b173-661dc994a6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:42.667511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960e725-ae0c-4f1f-b173-661dc994a6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:42.667511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960e725-ae0c-4f1f-b173-661dc994a6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:42.667511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960e725-ae0c-4f1f-b173-661dc994a6ab admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:42.678640 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1085/2178] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:42.681177 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a88f84-b629-449b-92a3-17ef3497f9f7 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:42.728908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a88f84-b629-449b-92a3-17ef3497f9f7 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:42.738428 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc23756-9e76-4991-86e3-fee54349a772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:42.739900 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc23756-9e76-4991-86e3-fee54349a772 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:42.740375 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc23756-9e76-4991-86e3-fee54349a772 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:42.740857 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc23756-9e76-4991-86e3-fee54349a772 admin admin] PATH_INFO: `/v3/projects/77b18b9526674d1f91bca26535181d80/users/91480265008541be954abde7bfbe1fda/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:42.771412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc23756-9e76-4991-86e3-fee54349a772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b18b9526674d1f91bca26535181d80, user_id=91480265008541be954abde7bfbe1fda, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:42.775119 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc23756-9e76-4991-86e3-fee54349a772 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:42.866228 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1094/2179] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:42 2022] PUT /identity/v3/projects/77b18b9526674d1f91bca26535181d80/users/91480265008541be954abde7bfbe1fda/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:42.871138 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960e725-ae0c-4f1f-b173-661dc994a6ab admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:42.883489 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960e725-ae0c-4f1f-b173-661dc994a6ab admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:42.958075 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dda458-8352-493e-a04a-626cdbfd2ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:42.958911 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dda458-8352-493e-a04a-626cdbfd2ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:42.959290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dda458-8352-493e-a04a-626cdbfd2ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:42.960813 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dda458-8352-493e-a04a-626cdbfd2ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:42.962011 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dda458-8352-493e-a04a-626cdbfd2ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:42.964705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dda458-8352-493e-a04a-626cdbfd2ef6 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:42.984455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1086/2180] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:58:42.987919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc23756-9e76-4991-86e3-fee54349a772 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:43.004377 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc23756-9e76-4991-86e3-fee54349a772 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:43.015789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160229ed-f5d9-4cd2-8484-b1590ca96f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:43.017084 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160229ed-f5d9-4cd2-8484-b1590ca96f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:43.017536 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160229ed-f5d9-4cd2-8484-b1590ca96f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:43.017913 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160229ed-f5d9-4cd2-8484-b1590ca96f57 admin admin] PATH_INFO: `/v3/projects/77b18b9526674d1f91bca26535181d80/users/91480265008541be954abde7bfbe1fda/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:43.020339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160229ed-f5d9-4cd2-8484-b1590ca96f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b18b9526674d1f91bca26535181d80, user_id=91480265008541be954abde7bfbe1fda, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:43.024025 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160229ed-f5d9-4cd2-8484-b1590ca96f57 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:43.036995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1095/2181] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:42 2022] PUT /identity/v3/projects/77b18b9526674d1f91bca26535181d80/users/91480265008541be954abde7bfbe1fda/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:43.047580 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d4279-7166-4360-8598-580fe13e3741 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:43.047888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d4279-7166-4360-8598-580fe13e3741 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:43.048117 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d4279-7166-4360-8598-580fe13e3741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:43.086281 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-990d4279-7166-4360-8598-580fe13e3741 None None] MFA Rules not processed for user `91480265008541be954abde7bfbe1fda`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:43.087738 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-990d4279-7166-4360-8598-580fe13e3741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:43.179409 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:43.189474 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1087/2182] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:43.208768 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160229ed-f5d9-4cd2-8484-b1590ca96f57 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:43.209801 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-160229ed-f5d9-4cd2-8484-b1590ca96f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:43.292626 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160229ed-f5d9-4cd2-8484-b1590ca96f57 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:43.299004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543cdb2-ccd9-4970-a1b9-fe24ccf6a5a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:43.300075 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543cdb2-ccd9-4970-a1b9-fe24ccf6a5a7 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:43.301049 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543cdb2-ccd9-4970-a1b9-fe24ccf6a5a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:43.301534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543cdb2-ccd9-4970-a1b9-fe24ccf6a5a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:43.352476 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:43.380723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543cdb2-ccd9-4970-a1b9-fe24ccf6a5a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:43.383640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543cdb2-ccd9-4970-a1b9-fe24ccf6a5a7 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:43.402928 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1096/2183] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:47.461280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d4279-7166-4360-8598-580fe13e3741 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:47.462866 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-990d4279-7166-4360-8598-580fe13e3741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:47.542313 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d4279-7166-4360-8598-580fe13e3741 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:47.547426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2a42f-a9e0-4e75-91ec-f34300e18691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:47.548075 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2a42f-a9e0-4e75-91ec-f34300e18691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:47.548442 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2a42f-a9e0-4e75-91ec-f34300e18691 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:47.548728 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2a42f-a9e0-4e75-91ec-f34300e18691 admin admin] PATH_INFO: `/v3/users/3aa35dbc601c4b799374f5ca885729ad` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:47.550087 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2a42f-a9e0-4e75-91ec-f34300e18691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aa35dbc601c4b799374f5ca885729ad)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:47.552283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2a42f-a9e0-4e75-91ec-f34300e18691 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:47.759693 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a4a2a42f-a9e0-4e75-91ec-f34300e18691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aa35dbc601c4b799374f5ca885729ad'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:47.833338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a4a2a42f-a9e0-4e75-91ec-f34300e18691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aa35dbc601c4b799374f5ca885729ad'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:47.839458 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a4a2a42f-a9e0-4e75-91ec-f34300e18691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aa35dbc601c4b799374f5ca885729ad'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:47.839458 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a4a2a42f-a9e0-4e75-91ec-f34300e18691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aa35dbc601c4b799374f5ca885729ad'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:47.854488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a4a2a42f-a9e0-4e75-91ec-f34300e18691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aa35dbc601c4b799374f5ca885729ad'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:47.925883 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1088/2184] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:47 2022] DELETE /identity/v3/users/3aa35dbc601c4b799374f5ca885729ad => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:47.927079 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3999fc-0e35-44be-985f-7e5deb1fe3f7 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:47.927522 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3999fc-0e35-44be-985f-7e5deb1fe3f7 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:47.927610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3999fc-0e35-44be-985f-7e5deb1fe3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:47.960540 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-7a3999fc-0e35-44be-985f-7e5deb1fe3f7 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:47.961823 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7a3999fc-0e35-44be-985f-7e5deb1fe3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:47.970468 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2a42f-a9e0-4e75-91ec-f34300e18691 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:47.972046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a4a2a42f-a9e0-4e75-91ec-f34300e18691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:48.079977 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1097/2185] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:48.081469 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3999fc-0e35-44be-985f-7e5deb1fe3f7 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:48.083226 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7a3999fc-0e35-44be-985f-7e5deb1fe3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:48.101403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2a42f-a9e0-4e75-91ec-f34300e18691 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:48.108802 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853153f-6d71-444b-b815-7189901f1870 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:48.109443 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853153f-6d71-444b-b815-7189901f1870 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:48.109728 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853153f-6d71-444b-b815-7189901f1870 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:48.110001 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853153f-6d71-444b-b815-7189901f1870 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:48.113197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3853153f-6d71-444b-b815-7189901f1870 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:48.160930 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:48.170177 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3999fc-0e35-44be-985f-7e5deb1fe3f7 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:48.174297 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb8851-8fb6-407a-b9bb-4cdceb124d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:48.175037 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb8851-8fb6-407a-b9bb-4cdceb124d16 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:48.175423 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb8851-8fb6-407a-b9bb-4cdceb124d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:48.175860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb8851-8fb6-407a-b9bb-4cdceb124d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:48.188554 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb8851-8fb6-407a-b9bb-4cdceb124d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:48.190952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb8851-8fb6-407a-b9bb-4cdceb124d16 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:48.209600 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853153f-6d71-444b-b815-7189901f1870 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:48.211691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853153f-6d71-444b-b815-7189901f1870 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:48.221034 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1098/2186] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:48.230399 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1089/2187] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:58:48.792296 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb8851-8fb6-407a-b9bb-4cdceb124d16 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:48.793046 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f1cb8851-8fb6-407a-b9bb-4cdceb124d16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:48.817879 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb8851-8fb6-407a-b9bb-4cdceb124d16 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:48.831090 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa338c-91bb-4193-a097-9ed68b18edde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:48.832330 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa338c-91bb-4193-a097-9ed68b18edde admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:48.832908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa338c-91bb-4193-a097-9ed68b18edde admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:48.833584 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa338c-91bb-4193-a097-9ed68b18edde admin admin] PATH_INFO: `/v3/projects/6a9bc424f2214d6cb22d48ece430e747` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:48.835654 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa338c-91bb-4193-a097-9ed68b18edde admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a9bc424f2214d6cb22d48ece430e747)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:48.843800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa338c-91bb-4193-a097-9ed68b18edde admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:49.036955 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-20fa338c-91bb-4193-a097-9ed68b18edde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a9bc424f2214d6cb22d48ece430e747', 'request_id': 'req-20fa338c-91bb-4193-a097-9ed68b18edde'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:49.045482 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-20fa338c-91bb-4193-a097-9ed68b18edde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a9bc424f2214d6cb22d48ece430e747', 'request_id': 'req-20fa338c-91bb-4193-a097-9ed68b18edde'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:49.101188 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c9ead-b04c-4464-9cfb-e16cfd24b300 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:49.104390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c9ead-b04c-4464-9cfb-e16cfd24b300 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:49.104390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c9ead-b04c-4464-9cfb-e16cfd24b300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:49.124377 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-20fa338c-91bb-4193-a097-9ed68b18edde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a9bc424f2214d6cb22d48ece430e747', 'request_id': 'req-20fa338c-91bb-4193-a097-9ed68b18edde'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:49.138288 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-198c9ead-b04c-4464-9cfb-e16cfd24b300 None None] MFA Rules not processed for user `23b84c71d4a34c3aabc3eb57715127c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:49.139023 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:49.139746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-198c9ead-b04c-4464-9cfb-e16cfd24b300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:49.141481 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-20fa338c-91bb-4193-a097-9ed68b18edde admin admin] The token cache is being invalidate because project 6a9bc424f2214d6cb22d48ece430e747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:49.141783 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-20fa338c-91bb-4193-a097-9ed68b18edde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:49.142429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-20fa338c-91bb-4193-a097-9ed68b18edde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:49.144362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1099/2188] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:48 2022] DELETE /identity/v3/projects/6a9bc424f2214d6cb22d48ece430e747 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:49.149099 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa338c-91bb-4193-a097-9ed68b18edde admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:49.150609 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-20fa338c-91bb-4193-a097-9ed68b18edde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:49.261955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1090/2189] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:49.271272 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa338c-91bb-4193-a097-9ed68b18edde admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:49.287021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b36b15-ee47-4d85-a240-a82f6a37a6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:49.288544 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b36b15-ee47-4d85-a240-a82f6a37a6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:49.289267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b36b15-ee47-4d85-a240-a82f6a37a6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:49.289696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b36b15-ee47-4d85-a240-a82f6a37a6aa admin admin] PATH_INFO: `/v3/users/b05166c48f2e410ca50034d6c2007418` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:49.291136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b36b15-ee47-4d85-a240-a82f6a37a6aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05166c48f2e410ca50034d6c2007418)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:49.293693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b36b15-ee47-4d85-a240-a82f6a37a6aa admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:49.525136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-73b36b15-ee47-4d85-a240-a82f6a37a6aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05166c48f2e410ca50034d6c2007418'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:49.633924 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-73b36b15-ee47-4d85-a240-a82f6a37a6aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05166c48f2e410ca50034d6c2007418'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:49.634609 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-73b36b15-ee47-4d85-a240-a82f6a37a6aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05166c48f2e410ca50034d6c2007418'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:49.652041 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-73b36b15-ee47-4d85-a240-a82f6a37a6aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05166c48f2e410ca50034d6c2007418'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:49.652889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-73b36b15-ee47-4d85-a240-a82f6a37a6aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05166c48f2e410ca50034d6c2007418'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:49.667349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1100/2190] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:49 2022] DELETE /identity/v3/users/b05166c48f2e410ca50034d6c2007418 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:58:50.099502 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c9ead-b04c-4464-9cfb-e16cfd24b300 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:50.112189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c9ead-b04c-4464-9cfb-e16cfd24b300 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:50.172727 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1ee4d-dd83-469f-8fb5-1988bc5b92ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:50.173370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1ee4d-dd83-469f-8fb5-1988bc5b92ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:50.173648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1ee4d-dd83-469f-8fb5-1988bc5b92ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:50.173959 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1ee4d-dd83-469f-8fb5-1988bc5b92ed admin admin] PATH_INFO: `/v3/projects/afdf98efdaeb43ddb5a183de84c440c1` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:50.175124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1ee4d-dd83-469f-8fb5-1988bc5b92ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=afdf98efdaeb43ddb5a183de84c440c1)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:50.177156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1ee4d-dd83-469f-8fb5-1988bc5b92ed admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:50.292521 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7ae1ee4d-dd83-469f-8fb5-1988bc5b92ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afdf98efdaeb43ddb5a183de84c440c1', 'request_id': 'req-7ae1ee4d-dd83-469f-8fb5-1988bc5b92ed'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:50.295621 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:50.299286 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7ae1ee4d-dd83-469f-8fb5-1988bc5b92ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afdf98efdaeb43ddb5a183de84c440c1', 'request_id': 'req-7ae1ee4d-dd83-469f-8fb5-1988bc5b92ed'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:50.353287 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7ae1ee4d-dd83-469f-8fb5-1988bc5b92ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afdf98efdaeb43ddb5a183de84c440c1', 'request_id': 'req-7ae1ee4d-dd83-469f-8fb5-1988bc5b92ed'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:50.365270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7ae1ee4d-dd83-469f-8fb5-1988bc5b92ed admin admin] The token cache is being invalidate because project afdf98efdaeb43ddb5a183de84c440c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:50.365491 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7ae1ee4d-dd83-469f-8fb5-1988bc5b92ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:50.366804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7ae1ee4d-dd83-469f-8fb5-1988bc5b92ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:50.368768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1091/2191] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:50 2022] DELETE /identity/v3/projects/afdf98efdaeb43ddb5a183de84c440c1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:50.373487 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8ea6d-ce0f-4a4f-867b-dd477d6aa82f None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:50.374534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8ea6d-ce0f-4a4f-867b-dd477d6aa82f None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:50.374822 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8ea6d-ce0f-4a4f-867b-dd477d6aa82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:50.395015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-3ac8ea6d-ce0f-4a4f-867b-dd477d6aa82f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:50.396244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3ac8ea6d-ce0f-4a4f-867b-dd477d6aa82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:50.476338 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1101/2192] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:50.486942 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8bcbf-5a10-478b-a77c-ba3cc645abfd None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:50.487365 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8bcbf-5a10-478b-a77c-ba3cc645abfd None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:50.487761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8bcbf-5a10-478b-a77c-ba3cc645abfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:50.517211 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9af8bcbf-5a10-478b-a77c-ba3cc645abfd None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:50.518995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9af8bcbf-5a10-478b-a77c-ba3cc645abfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:50.534972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1092/2193] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:50.539833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8ea6d-ce0f-4a4f-867b-dd477d6aa82f None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:50.550076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8ea6d-ce0f-4a4f-867b-dd477d6aa82f None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:50.554802 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df48d57-cceb-454f-a117-a94ef76902d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:50.555408 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df48d57-cceb-454f-a117-a94ef76902d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:50.555688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df48d57-cceb-454f-a117-a94ef76902d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:50.555960 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df48d57-cceb-454f-a117-a94ef76902d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:50.556641 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df48d57-cceb-454f-a117-a94ef76902d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:58:50.556945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df48d57-cceb-454f-a117-a94ef76902d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:50.558542 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df48d57-cceb-454f-a117-a94ef76902d4 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:50.570178 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1102/2194] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:58:50.574644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8bcbf-5a10-478b-a77c-ba3cc645abfd None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:50.583954 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8bcbf-5a10-478b-a77c-ba3cc645abfd None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:50.589236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2f465-4e41-48e4-98a5-cc155f12150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:50.589826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2f465-4e41-48e4-98a5-cc155f12150a admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:50.590104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2f465-4e41-48e4-98a5-cc155f12150a admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:50.590376 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2f465-4e41-48e4-98a5-cc155f12150a admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:50.591014 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2f465-4e41-48e4-98a5-cc155f12150a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:50.593022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2f465-4e41-48e4-98a5-cc155f12150a admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:50.683144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1093/2195] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:50 2022] POST /identity/v3/projects => generated 359 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:50.684328 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df48d57-cceb-454f-a117-a94ef76902d4 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:50.695299 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df48d57-cceb-454f-a117-a94ef76902d4 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:50.700733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:50.772089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adfea0-af06-4e01-9d18-27d693d15193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:50.773381 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adfea0-af06-4e01-9d18-27d693d15193 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:50.773725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adfea0-af06-4e01-9d18-27d693d15193 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:50.774068 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adfea0-af06-4e01-9d18-27d693d15193 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:50.774812 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5adfea0-af06-4e01-9d18-27d693d15193 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:50.776968 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5adfea0-af06-4e01-9d18-27d693d15193 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:50.859145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1103/2196] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:50 2022] POST /identity/v3/users => generated 280 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:58:50.864842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2f465-4e41-48e4-98a5-cc155f12150a admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:50.875169 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2f465-4e41-48e4-98a5-cc155f12150a admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:50.879746 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391c60d-9ad5-4ca3-a590-76bf96fceaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:50.880334 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391c60d-9ad5-4ca3-a590-76bf96fceaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:50.880638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391c60d-9ad5-4ca3-a590-76bf96fceaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:50.880916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391c60d-9ad5-4ca3-a590-76bf96fceaa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:50.882089 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391c60d-9ad5-4ca3-a590-76bf96fceaa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:50.883783 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391c60d-9ad5-4ca3-a590-76bf96fceaa3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:50.894163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1094/2197] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:50.898866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adfea0-af06-4e01-9d18-27d693d15193 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:50.909653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adfea0-af06-4e01-9d18-27d693d15193 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:50.915615 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ba42f-0564-48c8-acb5-a62f8b27bbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:50.916243 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ba42f-0564-48c8-acb5-a62f8b27bbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:50.916553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ba42f-0564-48c8-acb5-a62f8b27bbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:50.916832 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ba42f-0564-48c8-acb5-a62f8b27bbd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:50.917489 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ba42f-0564-48c8-acb5-a62f8b27bbd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:50.919118 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ba42f-0564-48c8-acb5-a62f8b27bbd2 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:50.931727 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1104/2198] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:50.936193 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391c60d-9ad5-4ca3-a590-76bf96fceaa3 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:50.949523 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391c60d-9ad5-4ca3-a590-76bf96fceaa3 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:50.956740 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9d90d-7496-44d6-a6fd-b0fb0b946723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:50.957428 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9d90d-7496-44d6-a6fd-b0fb0b946723 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:50.957708 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9d90d-7496-44d6-a6fd-b0fb0b946723 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:50.957984 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9d90d-7496-44d6-a6fd-b0fb0b946723 admin admin] PATH_INFO: `/v3/projects/c7d25eb42208406f96afcd2622efe668/users/79c631ab17ee4d89889c4a8a326357a1/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:50.976655 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9d90d-7496-44d6-a6fd-b0fb0b946723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d25eb42208406f96afcd2622efe668, user_id=79c631ab17ee4d89889c4a8a326357a1, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:50.979379 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9d90d-7496-44d6-a6fd-b0fb0b946723 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:51.040339 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1095/2199] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:50 2022] PUT /identity/v3/projects/c7d25eb42208406f96afcd2622efe668/users/79c631ab17ee4d89889c4a8a326357a1/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:51.054678 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f925da-4333-4302-999c-26911bb9bf85 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:51.054966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f925da-4333-4302-999c-26911bb9bf85 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:51.055249 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f925da-4333-4302-999c-26911bb9bf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:51.089978 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-b7f925da-4333-4302-999c-26911bb9bf85 None None] MFA Rules not processed for user `79c631ab17ee4d89889c4a8a326357a1`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:51.092865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b7f925da-4333-4302-999c-26911bb9bf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:51.174079 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1105/2200] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:51.212146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9d90d-7496-44d6-a6fd-b0fb0b946723 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:51.214006 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8ba9d90d-7496-44d6-a6fd-b0fb0b946723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:51.274121 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9d90d-7496-44d6-a6fd-b0fb0b946723 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:51.277883 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7de400-5c33-48f0-a229-cafdbabf60cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:51.278501 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7de400-5c33-48f0-a229-cafdbabf60cc service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:51.278785 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7de400-5c33-48f0-a229-cafdbabf60cc service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:51.279064 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7de400-5c33-48f0-a229-cafdbabf60cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:51.293614 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7de400-5c33-48f0-a229-cafdbabf60cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:51.295102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7de400-5c33-48f0-a229-cafdbabf60cc service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:51.310014 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1096/2201] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:51.326211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f925da-4333-4302-999c-26911bb9bf85 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:51.400583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f925da-4333-4302-999c-26911bb9bf85 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:51.405242 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2efb9e-b896-449c-ae1a-462835f3130e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:51.405877 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2efb9e-b896-449c-ae1a-462835f3130e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:51.406159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2efb9e-b896-449c-ae1a-462835f3130e admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:51.406434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2efb9e-b896-449c-ae1a-462835f3130e admin admin] PATH_INFO: `/v3/users/79c631ab17ee4d89889c4a8a326357a1` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:51.407596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2efb9e-b896-449c-ae1a-462835f3130e admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c631ab17ee4d89889c4a8a326357a1)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:51.409595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2efb9e-b896-449c-ae1a-462835f3130e admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:51.425751 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:51.657812 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-cc2efb9e-b896-449c-ae1a-462835f3130e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c631ab17ee4d89889c4a8a326357a1'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:51.742770 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-cc2efb9e-b896-449c-ae1a-462835f3130e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c631ab17ee4d89889c4a8a326357a1'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:51.743396 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-cc2efb9e-b896-449c-ae1a-462835f3130e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c631ab17ee4d89889c4a8a326357a1'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:51.757268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-cc2efb9e-b896-449c-ae1a-462835f3130e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c631ab17ee4d89889c4a8a326357a1'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:51.758103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-cc2efb9e-b896-449c-ae1a-462835f3130e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c631ab17ee4d89889c4a8a326357a1'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:51.771141 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1106/2202] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:58:51 2022] DELETE /identity/v3/users/79c631ab17ee4d89889c4a8a326357a1 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:51.775578 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43379b-0c70-46ae-85a5-2c93d2fc9799 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:51.775869 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43379b-0c70-46ae-85a5-2c93d2fc9799 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:51.776152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43379b-0c70-46ae-85a5-2c93d2fc9799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:51.795868 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ac43379b-0c70-46ae-85a5-2c93d2fc9799 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:51.797240 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ac43379b-0c70-46ae-85a5-2c93d2fc9799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:51.877136 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1097/2203] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:51.888802 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2efb9e-b896-449c-ae1a-462835f3130e admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:51.890332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-cc2efb9e-b896-449c-ae1a-462835f3130e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:51.992595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2efb9e-b896-449c-ae1a-462835f3130e admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:51.997056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a225048-c59b-4669-80ce-62182ff0a8a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:51.997689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a225048-c59b-4669-80ce-62182ff0a8a2 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:51.997969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a225048-c59b-4669-80ce-62182ff0a8a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:51.998240 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a225048-c59b-4669-80ce-62182ff0a8a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:52.011813 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a225048-c59b-4669-80ce-62182ff0a8a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:52.014647 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a225048-c59b-4669-80ce-62182ff0a8a2 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:52.031514 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1107/2204] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:52.521651 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43379b-0c70-46ae-85a5-2c93d2fc9799 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:52.524016 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ac43379b-0c70-46ae-85a5-2c93d2fc9799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:52.574064 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43379b-0c70-46ae-85a5-2c93d2fc9799 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:52.578952 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b6401-15bd-48e1-b7cd-8b118db6d58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:52.579707 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b6401-15bd-48e1-b7cd-8b118db6d58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:52.580117 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b6401-15bd-48e1-b7cd-8b118db6d58e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:52.580398 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b6401-15bd-48e1-b7cd-8b118db6d58e admin admin] PATH_INFO: `/v3/projects/c7d25eb42208406f96afcd2622efe668` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:52.581573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b6401-15bd-48e1-b7cd-8b118db6d58e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d25eb42208406f96afcd2622efe668)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:52.583542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b6401-15bd-48e1-b7cd-8b118db6d58e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:52.603260 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:52.723584 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bd3b6401-15bd-48e1-b7cd-8b118db6d58e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d25eb42208406f96afcd2622efe668', 'request_id': 'req-bd3b6401-15bd-48e1-b7cd-8b118db6d58e'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:52.735672 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bd3b6401-15bd-48e1-b7cd-8b118db6d58e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d25eb42208406f96afcd2622efe668', 'request_id': 'req-bd3b6401-15bd-48e1-b7cd-8b118db6d58e'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:52.815970 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bd3b6401-15bd-48e1-b7cd-8b118db6d58e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d25eb42208406f96afcd2622efe668', 'request_id': 'req-bd3b6401-15bd-48e1-b7cd-8b118db6d58e'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:52.828633 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bd3b6401-15bd-48e1-b7cd-8b118db6d58e admin admin] The token cache is being invalidate because project c7d25eb42208406f96afcd2622efe668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:58:52.829081 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bd3b6401-15bd-48e1-b7cd-8b118db6d58e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:52.829823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-bd3b6401-15bd-48e1-b7cd-8b118db6d58e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:58:52.831716 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1098/2205] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:58:52 2022] DELETE /identity/v3/projects/c7d25eb42208406f96afcd2622efe668 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:52.836592 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c18b9f-b332-4217-a244-0e9000f1845e None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:52.837067 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c18b9f-b332-4217-a244-0e9000f1845e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:52.843155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c18b9f-b332-4217-a244-0e9000f1845e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:52.857285 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-c1c18b9f-b332-4217-a244-0e9000f1845e None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:52.858574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c1c18b9f-b332-4217-a244-0e9000f1845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:52.930093 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1108/2206] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:52.931813 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ffd34-8039-4530-a095-d3db89a3d428 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:52.932098 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ffd34-8039-4530-a095-d3db89a3d428 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:52.932375 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ffd34-8039-4530-a095-d3db89a3d428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:52.953634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d67ffd34-8039-4530-a095-d3db89a3d428 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:52.954883 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d67ffd34-8039-4530-a095-d3db89a3d428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:52.968513 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1099/2207] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:52.968639 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c18b9f-b332-4217-a244-0e9000f1845e None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:52.978078 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c18b9f-b332-4217-a244-0e9000f1845e None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:52.982632 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915df374-fc7c-4b73-b9c9-c5cf4f043963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:52.983246 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915df374-fc7c-4b73-b9c9-c5cf4f043963 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:52.983525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915df374-fc7c-4b73-b9c9-c5cf4f043963 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:52.983795 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915df374-fc7c-4b73-b9c9-c5cf4f043963 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:52.984849 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915df374-fc7c-4b73-b9c9-c5cf4f043963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:58:52.985373 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915df374-fc7c-4b73-b9c9-c5cf4f043963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:52.988279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915df374-fc7c-4b73-b9c9-c5cf4f043963 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:53.003008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1109/2208] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:58:53.007681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ffd34-8039-4530-a095-d3db89a3d428 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:53.019386 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ffd34-8039-4530-a095-d3db89a3d428 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:53.024094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bace513-015c-4c8d-96f5-2597908f5654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:53.024730 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bace513-015c-4c8d-96f5-2597908f5654 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:53.025007 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bace513-015c-4c8d-96f5-2597908f5654 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:53.025277 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bace513-015c-4c8d-96f5-2597908f5654 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:53.025920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bace513-015c-4c8d-96f5-2597908f5654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:53.027835 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bace513-015c-4c8d-96f5-2597908f5654 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:53.106047 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915df374-fc7c-4b73-b9c9-c5cf4f043963 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:53.107944 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-915df374-fc7c-4b73-b9c9-c5cf4f043963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:53.145335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:53.146226 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1100/2209] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:58:53 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:53.149177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bace513-015c-4c8d-96f5-2597908f5654 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:53.192067 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915df374-fc7c-4b73-b9c9-c5cf4f043963 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:53.258096 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55b983-fcb6-4bb6-b6ad-b9049437c0be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a2c1f1668814a5e9e654c6308fa0628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:53.258918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55b983-fcb6-4bb6-b6ad-b9049437c0be service glance] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:53.259189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bace513-015c-4c8d-96f5-2597908f5654 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:53.259303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55b983-fcb6-4bb6-b6ad-b9049437c0be service glance] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:53.259560 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55b983-fcb6-4bb6-b6ad-b9049437c0be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:53.261666 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0f55b983-fcb6-4bb6-b6ad-b9049437c0be service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:53.266107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17658c-731f-491f-8c6c-57384af085f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:53.267225 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17658c-731f-491f-8c6c-57384af085f1 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:53.267744 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17658c-731f-491f-8c6c-57384af085f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:53.268948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17658c-731f-491f-8c6c-57384af085f1 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:53.269843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17658c-731f-491f-8c6c-57384af085f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:53.273046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17658c-731f-491f-8c6c-57384af085f1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:53.351003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55b983-fcb6-4bb6-b6ad-b9049437c0be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:53.352403 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55b983-fcb6-4bb6-b6ad-b9049437c0be service glance] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:53.356297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1101/2210] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:58:53 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:58:53.361244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17658c-731f-491f-8c6c-57384af085f1 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:53.368572 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1110/2211] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:58:53.376326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17658c-731f-491f-8c6c-57384af085f1 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:53.381964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe54f1-a85c-4499-b719-1d1407679fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:53.382577 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe54f1-a85c-4499-b719-1d1407679fdd admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:53.382855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe54f1-a85c-4499-b719-1d1407679fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:53.383136 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe54f1-a85c-4499-b719-1d1407679fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:53.383788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe54f1-a85c-4499-b719-1d1407679fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:53.385428 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe54f1-a85c-4499-b719-1d1407679fdd admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:53.395694 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1102/2212] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:58:53.406082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55b983-fcb6-4bb6-b6ad-b9049437c0be service glance] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:53.412410 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55b983-fcb6-4bb6-b6ad-b9049437c0be service glance] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:53.417792 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec1dd9-f3e6-4c69-84f9-d8f8647f0986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:53.418411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec1dd9-f3e6-4c69-84f9-d8f8647f0986 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:53.418695 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec1dd9-f3e6-4c69-84f9-d8f8647f0986 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:53.418990 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec1dd9-f3e6-4c69-84f9-d8f8647f0986 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:53.419673 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec1dd9-f3e6-4c69-84f9-d8f8647f0986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:53.421545 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec1dd9-f3e6-4c69-84f9-d8f8647f0986 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:53.432584 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1111/2213] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:58:53.437176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe54f1-a85c-4499-b719-1d1407679fdd admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:53.448407 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe54f1-a85c-4499-b719-1d1407679fdd admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:53.453120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933ae37-cd1a-4666-852a-b731191cb19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:53.453879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933ae37-cd1a-4666-852a-b731191cb19c admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:53.454164 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933ae37-cd1a-4666-852a-b731191cb19c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:53.454436 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933ae37-cd1a-4666-852a-b731191cb19c admin admin] PATH_INFO: `/v3/projects/73b251433ebe409eac686d418f83e499/users/95ce2e4f8df34404ad587edc9bc8af05/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:53.470851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933ae37-cd1a-4666-852a-b731191cb19c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b251433ebe409eac686d418f83e499, user_id=95ce2e4f8df34404ad587edc9bc8af05, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:53.473590 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933ae37-cd1a-4666-852a-b731191cb19c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:53.588955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1103/2214] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:58:53 2022] PUT /identity/v3/projects/73b251433ebe409eac686d418f83e499/users/95ce2e4f8df34404ad587edc9bc8af05/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:58:53.596216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9bfea-6788-4344-a187-42024a77c5f6 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:53.596216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9bfea-6788-4344-a187-42024a77c5f6 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:53.596216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9bfea-6788-4344-a187-42024a77c5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:53.628701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-93f9bfea-6788-4344-a187-42024a77c5f6 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:53.629943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-93f9bfea-6788-4344-a187-42024a77c5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:53.704970 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1112/2215] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:53.715119 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933ae37-cd1a-4666-852a-b731191cb19c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:53.716935 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5933ae37-cd1a-4666-852a-b731191cb19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:53.768041 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:53.806266 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933ae37-cd1a-4666-852a-b731191cb19c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:53.810752 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12076cd2-033d-4b3e-8d90-79b9ad22087e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:53.811264 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12076cd2-033d-4b3e-8d90-79b9ad22087e service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:53.811544 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12076cd2-033d-4b3e-8d90-79b9ad22087e service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:53.811816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12076cd2-033d-4b3e-8d90-79b9ad22087e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:53.825324 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be050a92-7e9c-4fda-9302-7bcf6cef28f7 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:53.825637 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be050a92-7e9c-4fda-9302-7bcf6cef28f7 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:53.825887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be050a92-7e9c-4fda-9302-7bcf6cef28f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:53.832900 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12076cd2-033d-4b3e-8d90-79b9ad22087e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:53.837691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12076cd2-033d-4b3e-8d90-79b9ad22087e service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:53.862808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1104/2216] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:53.872465 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-be050a92-7e9c-4fda-9302-7bcf6cef28f7 None None] MFA Rules not processed for user `642d4bef7e9c459a8d2dde636094b528`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:53.876547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-be050a92-7e9c-4fda-9302-7bcf6cef28f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:53.910991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:58:53.976626 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1113/2217] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Sep 6 22:58:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:58:54.048355 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12076cd2-033d-4b3e-8d90-79b9ad22087e service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:54.050567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-12076cd2-033d-4b3e-8d90-79b9ad22087e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:54.162295 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12076cd2-033d-4b3e-8d90-79b9ad22087e service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:54.168868 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acf509-8b5d-4bbc-a478-7edc57440473 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660248a90f524a43b143bae127e0eaa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:54.169499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acf509-8b5d-4bbc-a478-7edc57440473 service swift] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:54.169783 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acf509-8b5d-4bbc-a478-7edc57440473 service swift] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:54.170062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acf509-8b5d-4bbc-a478-7edc57440473 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:54.180018 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acf509-8b5d-4bbc-a478-7edc57440473 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:54.181705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acf509-8b5d-4bbc-a478-7edc57440473 service swift] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:54.191302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1105/2218] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Sep 6 22:58:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 22:58:56.016092 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3abc0-1465-4e66-b54d-17fc403c83ef None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:56.016751 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3abc0-1465-4e66-b54d-17fc403c83ef None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:56.016851 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3abc0-1465-4e66-b54d-17fc403c83ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:56.072730 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-d4d3abc0-1465-4e66-b54d-17fc403c83ef None None] MFA Rules not processed for user `95ce2e4f8df34404ad587edc9bc8af05`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:56.074621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d4d3abc0-1465-4e66-b54d-17fc403c83ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:56.254076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1114/2219] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:58:56.269973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acf509-8b5d-4bbc-a478-7edc57440473 service swift] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:58:56.272248 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c9acf509-8b5d-4bbc-a478-7edc57440473 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:56.343165 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acf509-8b5d-4bbc-a478-7edc57440473 service swift] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:58:56.348144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be391b-c688-4a38-916a-edd0e278476b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:58:56.349335 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be391b-c688-4a38-916a-edd0e278476b service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:56.350398 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be391b-c688-4a38-916a-edd0e278476b service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:56.350913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be391b-c688-4a38-916a-edd0e278476b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:56.361680 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be391b-c688-4a38-916a-edd0e278476b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:58:56.363612 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be391b-c688-4a38-916a-edd0e278476b service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:58:56.392277 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1106/2220] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:58:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:58:59.200882 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3b98a-3f7d-4d99-8e5c-d355e8ebe184 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:58:59.202101 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3b98a-3f7d-4d99-8e5c-d355e8ebe184 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:58:59.202576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3b98a-3f7d-4d99-8e5c-d355e8ebe184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:58:59.226611 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-c0a3b98a-3f7d-4d99-8e5c-d355e8ebe184 None None] MFA Rules not processed for user `95ce2e4f8df34404ad587edc9bc8af05`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:58:59.227852 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c0a3b98a-3f7d-4d99-8e5c-d355e8ebe184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:58:59.239263 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1115/2221] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:58:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:06.095473 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dba9a-95cb-43ec-914b-ed0d0f1347a0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:06.096453 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dba9a-95cb-43ec-914b-ed0d0f1347a0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:06.097455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dba9a-95cb-43ec-914b-ed0d0f1347a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:06.123292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-dc1dba9a-95cb-43ec-914b-ed0d0f1347a0 None None] MFA Rules not processed for user `49dcf3b303e54f8ca2e45bf09381313e`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:06.124583 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-dc1dba9a-95cb-43ec-914b-ed0d0f1347a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:06.192302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1107/2222] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:09.220300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=49 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:13.814491 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3b98a-3f7d-4d99-8e5c-d355e8ebe184 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:13.816309 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c0a3b98a-3f7d-4d99-8e5c-d355e8ebe184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:13.851654 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3b98a-3f7d-4d99-8e5c-d355e8ebe184 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:13.862601 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d74ad-b2a0-4830-ad01-43d5532bcffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:13.866170 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d74ad-b2a0-4830-ad01-43d5532bcffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:13.866170 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d74ad-b2a0-4830-ad01-43d5532bcffc admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:13.866170 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d74ad-b2a0-4830-ad01-43d5532bcffc admin admin] PATH_INFO: `/v3/users/8e10d53e065349b1b092d7178a5d9c48` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:13.868875 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d74ad-b2a0-4830-ad01-43d5532bcffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e10d53e065349b1b092d7178a5d9c48)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:13.875546 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d74ad-b2a0-4830-ad01-43d5532bcffc admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:14.153662 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0d9d74ad-b2a0-4830-ad01-43d5532bcffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e10d53e065349b1b092d7178a5d9c48'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:14.246895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e4dac-20b5-4da2-95f9-bba3bbb815c7 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:14.247408 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e4dac-20b5-4da2-95f9-bba3bbb815c7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:14.248114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e4dac-20b5-4da2-95f9-bba3bbb815c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:14.249313 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0d9d74ad-b2a0-4830-ad01-43d5532bcffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e10d53e065349b1b092d7178a5d9c48'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:14.250022 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0d9d74ad-b2a0-4830-ad01-43d5532bcffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e10d53e065349b1b092d7178a5d9c48'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:14.289372 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0d9d74ad-b2a0-4830-ad01-43d5532bcffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e10d53e065349b1b092d7178a5d9c48'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:14.290241 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0d9d74ad-b2a0-4830-ad01-43d5532bcffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e10d53e065349b1b092d7178a5d9c48'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:14.293293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-509e4dac-20b5-4da2-95f9-bba3bbb815c7 None None] MFA Rules not processed for user `642d4bef7e9c459a8d2dde636094b528`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:14.298117 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-509e4dac-20b5-4da2-95f9-bba3bbb815c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:14.309995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1108/2223] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Sep 6 22:59:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:59:14.311019 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1116/2224] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:59:13 2022] DELETE /identity/v3/users/8e10d53e065349b1b092d7178a5d9c48 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:14.324345 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef71a22-50db-401e-be5a-45bbf569c62b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:14.324743 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef71a22-50db-401e-be5a-45bbf569c62b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:14.325177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef71a22-50db-401e-be5a-45bbf569c62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:14.333888 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d74ad-b2a0-4830-ad01-43d5532bcffc admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:14.336028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:14.336507 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0d9d74ad-b2a0-4830-ad01-43d5532bcffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:14.353634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-6ef71a22-50db-401e-be5a-45bbf569c62b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:14.354852 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6ef71a22-50db-401e-be5a-45bbf569c62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:14.449801 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1109/2225] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:59:14.459374 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d74ad-b2a0-4830-ad01-43d5532bcffc admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:14.465611 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef71a22-50db-401e-be5a-45bbf569c62b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:14.467091 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6ef71a22-50db-401e-be5a-45bbf569c62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:14.469765 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253d8fa-e1bf-491c-bbb1-6677930c26bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660248a90f524a43b143bae127e0eaa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:14.470396 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253d8fa-e1bf-491c-bbb1-6677930c26bc service swift] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:14.470675 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253d8fa-e1bf-491c-bbb1-6677930c26bc service swift] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:14.470947 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253d8fa-e1bf-491c-bbb1-6677930c26bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:14.531625 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef71a22-50db-401e-be5a-45bbf569c62b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:14.538303 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3507112-4f87-4afb-aed0-e5d3e5c31ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:14.538933 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3507112-4f87-4afb-aed0-e5d3e5c31ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:14.539189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3507112-4f87-4afb-aed0-e5d3e5c31ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:14.539463 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3507112-4f87-4afb-aed0-e5d3e5c31ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:14.549961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253d8fa-e1bf-491c-bbb1-6677930c26bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:14.551372 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3507112-4f87-4afb-aed0-e5d3e5c31ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:14.552057 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253d8fa-e1bf-491c-bbb1-6677930c26bc service swift] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:14.553511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3507112-4f87-4afb-aed0-e5d3e5c31ff1 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:14.562024 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1117/2226] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Sep 6 22:59:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 22:59:14.564323 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1110/2227] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:59:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:59:15.358897 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253d8fa-e1bf-491c-bbb1-6677930c26bc service swift] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:15.358897 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f253d8fa-e1bf-491c-bbb1-6677930c26bc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:15.372917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253d8fa-e1bf-491c-bbb1-6677930c26bc service swift] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:15.380070 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fdfb1-9ecb-4bc0-a576-f9bce88f29a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:15.381203 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fdfb1-9ecb-4bc0-a576-f9bce88f29a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:15.381420 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fdfb1-9ecb-4bc0-a576-f9bce88f29a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:15.381852 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fdfb1-9ecb-4bc0-a576-f9bce88f29a2 admin admin] PATH_INFO: `/v3/projects/d27978f588e04774861eee13d8c5c2bf` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:15.383184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fdfb1-9ecb-4bc0-a576-f9bce88f29a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d27978f588e04774861eee13d8c5c2bf)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:15.390054 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fdfb1-9ecb-4bc0-a576-f9bce88f29a2 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:15.394299 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:15.558997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b89fdfb1-9ecb-4bc0-a576-f9bce88f29a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd27978f588e04774861eee13d8c5c2bf', 'request_id': 'req-b89fdfb1-9ecb-4bc0-a576-f9bce88f29a2'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:15.566509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b89fdfb1-9ecb-4bc0-a576-f9bce88f29a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd27978f588e04774861eee13d8c5c2bf', 'request_id': 'req-b89fdfb1-9ecb-4bc0-a576-f9bce88f29a2'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:15.632228 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b89fdfb1-9ecb-4bc0-a576-f9bce88f29a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd27978f588e04774861eee13d8c5c2bf', 'request_id': 'req-b89fdfb1-9ecb-4bc0-a576-f9bce88f29a2'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:15.647625 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b89fdfb1-9ecb-4bc0-a576-f9bce88f29a2 admin admin] The token cache is being invalidate because project d27978f588e04774861eee13d8c5c2bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:59:15.647929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b89fdfb1-9ecb-4bc0-a576-f9bce88f29a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:15.648999 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b89fdfb1-9ecb-4bc0-a576-f9bce88f29a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:15.652184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1118/2228] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:59:15 2022] DELETE /identity/v3/projects/d27978f588e04774861eee13d8c5c2bf => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:15.656924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3507112-4f87-4afb-aed0-e5d3e5c31ff1 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:15.677451 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3507112-4f87-4afb-aed0-e5d3e5c31ff1 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:15.753420 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5117c6-e96e-44db-b2f7-64b67a7740d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:15.754152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5117c6-e96e-44db-b2f7-64b67a7740d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:15.754501 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5117c6-e96e-44db-b2f7-64b67a7740d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:15.754871 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5117c6-e96e-44db-b2f7-64b67a7740d3 admin admin] PATH_INFO: `/v3/users/91480265008541be954abde7bfbe1fda` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:15.756675 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5117c6-e96e-44db-b2f7-64b67a7740d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91480265008541be954abde7bfbe1fda)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:15.758659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5117c6-e96e-44db-b2f7-64b67a7740d3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:15.919976 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4a5117c6-e96e-44db-b2f7-64b67a7740d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91480265008541be954abde7bfbe1fda'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:15.921688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:15.974598 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4a5117c6-e96e-44db-b2f7-64b67a7740d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91480265008541be954abde7bfbe1fda'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:15.975236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4a5117c6-e96e-44db-b2f7-64b67a7740d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91480265008541be954abde7bfbe1fda'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:15.975834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4a5117c6-e96e-44db-b2f7-64b67a7740d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91480265008541be954abde7bfbe1fda'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:15.983220 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4a5117c6-e96e-44db-b2f7-64b67a7740d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91480265008541be954abde7bfbe1fda'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:16.002422 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1111/2229] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:59:15 2022] DELETE /identity/v3/users/91480265008541be954abde7bfbe1fda => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:16.502861 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fdfb1-9ecb-4bc0-a576-f9bce88f29a2 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:16.511344 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b89fdfb1-9ecb-4bc0-a576-f9bce88f29a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:16.528045 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fdfb1-9ecb-4bc0-a576-f9bce88f29a2 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:16.603214 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48e9c7-ea05-4a1e-a0b6-916d4f6a89ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:16.603866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48e9c7-ea05-4a1e-a0b6-916d4f6a89ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:16.604146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48e9c7-ea05-4a1e-a0b6-916d4f6a89ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:16.604441 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48e9c7-ea05-4a1e-a0b6-916d4f6a89ef admin admin] PATH_INFO: `/v3/projects/77b18b9526674d1f91bca26535181d80` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:16.605619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48e9c7-ea05-4a1e-a0b6-916d4f6a89ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=77b18b9526674d1f91bca26535181d80)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:16.607640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48e9c7-ea05-4a1e-a0b6-916d4f6a89ef admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:16.759081 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ca48e9c7-ea05-4a1e-a0b6-916d4f6a89ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77b18b9526674d1f91bca26535181d80', 'request_id': 'req-ca48e9c7-ea05-4a1e-a0b6-916d4f6a89ef'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:16.767310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ca48e9c7-ea05-4a1e-a0b6-916d4f6a89ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77b18b9526674d1f91bca26535181d80', 'request_id': 'req-ca48e9c7-ea05-4a1e-a0b6-916d4f6a89ef'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:16.849441 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ca48e9c7-ea05-4a1e-a0b6-916d4f6a89ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77b18b9526674d1f91bca26535181d80', 'request_id': 'req-ca48e9c7-ea05-4a1e-a0b6-916d4f6a89ef'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:16.866266 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ca48e9c7-ea05-4a1e-a0b6-916d4f6a89ef admin admin] The token cache is being invalidate because project 77b18b9526674d1f91bca26535181d80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:59:16.866655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ca48e9c7-ea05-4a1e-a0b6-916d4f6a89ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:16.867385 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ca48e9c7-ea05-4a1e-a0b6-916d4f6a89ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:16.869019 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1119/2230] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:59:16 2022] DELETE /identity/v3/projects/77b18b9526674d1f91bca26535181d80 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:16.874208 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcc0aa-4b60-4acc-abd6-f5ea89c4b10b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:16.874687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcc0aa-4b60-4acc-abd6-f5ea89c4b10b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:16.874802 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcc0aa-4b60-4acc-abd6-f5ea89c4b10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:16.898083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f2fcc0aa-4b60-4acc-abd6-f5ea89c4b10b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:16.899702 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f2fcc0aa-4b60-4acc-abd6-f5ea89c4b10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:16.981920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1112/2231] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:16.985254 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a4206-c121-469c-a24b-122f8e15dc90 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:16.985622 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a4206-c121-469c-a24b-122f8e15dc90 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:16.985968 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a4206-c121-469c-a24b-122f8e15dc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:17.006107 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-d82a4206-c121-469c-a24b-122f8e15dc90 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:17.007312 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d82a4206-c121-469c-a24b-122f8e15dc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:17.015595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1120/2232] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:59:17.020279 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcc0aa-4b60-4acc-abd6-f5ea89c4b10b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:17.031362 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcc0aa-4b60-4acc-abd6-f5ea89c4b10b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:17.036023 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6febc8-6bd6-4091-87d9-eeb408682a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:17.036663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6febc8-6bd6-4091-87d9-eeb408682a6e admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:17.037539 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6febc8-6bd6-4091-87d9-eeb408682a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:17.037784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6febc8-6bd6-4091-87d9-eeb408682a6e admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:17.038437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6febc8-6bd6-4091-87d9-eeb408682a6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:59:17.038738 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6febc8-6bd6-4091-87d9-eeb408682a6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:17.040352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6febc8-6bd6-4091-87d9-eeb408682a6e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:17.052151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1113/2233] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:59:17.056679 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a4206-c121-469c-a24b-122f8e15dc90 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:17.066181 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a4206-c121-469c-a24b-122f8e15dc90 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:17.071368 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee46c5-5899-45f7-bbb7-1566a6450908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:17.071969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee46c5-5899-45f7-bbb7-1566a6450908 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:17.072271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee46c5-5899-45f7-bbb7-1566a6450908 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:17.072572 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee46c5-5899-45f7-bbb7-1566a6450908 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:17.073214 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee46c5-5899-45f7-bbb7-1566a6450908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:17.075127 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee46c5-5899-45f7-bbb7-1566a6450908 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:17.209782 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:17.222006 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6febc8-6bd6-4091-87d9-eeb408682a6e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:17.229052 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1121/2234] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:59:17 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:59:17.233625 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6febc8-6bd6-4091-87d9-eeb408682a6e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:17.293557 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea5a5f-9f04-4c3b-822e-50551ae8dba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:17.294116 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea5a5f-9f04-4c3b-822e-50551ae8dba3 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:17.294391 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea5a5f-9f04-4c3b-822e-50551ae8dba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:17.294661 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea5a5f-9f04-4c3b-822e-50551ae8dba3 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:17.295284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea5a5f-9f04-4c3b-822e-50551ae8dba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:17.297270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea5a5f-9f04-4c3b-822e-50551ae8dba3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:17.387874 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1114/2235] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:59:17 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:59:17.392217 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee46c5-5899-45f7-bbb7-1566a6450908 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:17.404211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee46c5-5899-45f7-bbb7-1566a6450908 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:17.410755 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ca808-810b-4f40-bb4d-0747798cea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:17.411686 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ca808-810b-4f40-bb4d-0747798cea7d admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:17.412119 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ca808-810b-4f40-bb4d-0747798cea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:17.412411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ca808-810b-4f40-bb4d-0747798cea7d admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:17.413359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ca808-810b-4f40-bb4d-0747798cea7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:17.415133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ca808-810b-4f40-bb4d-0747798cea7d admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:17.431485 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1122/2236] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:59:17.432352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea5a5f-9f04-4c3b-822e-50551ae8dba3 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:17.443592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea5a5f-9f04-4c3b-822e-50551ae8dba3 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:17.448794 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ebc92-e6ba-4ce0-8b62-8c53c8977791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:17.449408 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ebc92-e6ba-4ce0-8b62-8c53c8977791 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:17.449691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ebc92-e6ba-4ce0-8b62-8c53c8977791 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:17.449964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ebc92-e6ba-4ce0-8b62-8c53c8977791 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:17.453482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ebc92-e6ba-4ce0-8b62-8c53c8977791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:17.453482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ebc92-e6ba-4ce0-8b62-8c53c8977791 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:17.463736 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1115/2237] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:59:17.468058 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ca808-810b-4f40-bb4d-0747798cea7d admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:17.478490 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ca808-810b-4f40-bb4d-0747798cea7d admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:17.483355 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ea591-e377-4e2e-ac23-8db012957b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:17.484016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ea591-e377-4e2e-ac23-8db012957b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:17.484294 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ea591-e377-4e2e-ac23-8db012957b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:17.484627 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ea591-e377-4e2e-ac23-8db012957b10 admin admin] PATH_INFO: `/v3/projects/157f416e5f36420f879fa1ab55d2970a/users/a6e648d4cb944ef9aeab32c42ee6a817/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:17.499758 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ea591-e377-4e2e-ac23-8db012957b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=157f416e5f36420f879fa1ab55d2970a, user_id=a6e648d4cb944ef9aeab32c42ee6a817, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:17.502484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ea591-e377-4e2e-ac23-8db012957b10 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:17.609789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1123/2238] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:59:17 2022] PUT /identity/v3/projects/157f416e5f36420f879fa1ab55d2970a/users/a6e648d4cb944ef9aeab32c42ee6a817/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:17.620747 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f3ea1-3af1-4a84-a6f7-9fced14d3acb None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:17.621046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f3ea1-3af1-4a84-a6f7-9fced14d3acb None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:17.621319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f3ea1-3af1-4a84-a6f7-9fced14d3acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:17.670340 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-174f3ea1-3af1-4a84-a6f7-9fced14d3acb None None] MFA Rules not processed for user `a6e648d4cb944ef9aeab32c42ee6a817`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:17.671573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-174f3ea1-3af1-4a84-a6f7-9fced14d3acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:17.705540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:17.761573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1116/2239] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:59:17.772930 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ea591-e377-4e2e-ac23-8db012957b10 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:17.905241 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ea591-e377-4e2e-ac23-8db012957b10 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:17.910837 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b2b65-b817-4a7b-907f-2faf15d4aece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:17.911463 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b2b65-b817-4a7b-907f-2faf15d4aece admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:17.912335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b2b65-b817-4a7b-907f-2faf15d4aece admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:17.912666 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b2b65-b817-4a7b-907f-2faf15d4aece admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:17.913356 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b2b65-b817-4a7b-907f-2faf15d4aece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:17.915437 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b2b65-b817-4a7b-907f-2faf15d4aece admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:18.032153 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1124/2240] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:59:17 2022] POST /identity/v3/projects => generated 377 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:59:18.036077 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f3ea1-3af1-4a84-a6f7-9fced14d3acb None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:18.061960 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f3ea1-3af1-4a84-a6f7-9fced14d3acb None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:18.175126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc215f7b-fdd2-4f36-b1a0-462146ab7bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:18.175826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc215f7b-fdd2-4f36-b1a0-462146ab7bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:18.176107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc215f7b-fdd2-4f36-b1a0-462146ab7bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:18.176385 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc215f7b-fdd2-4f36-b1a0-462146ab7bd4 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:18.178036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc215f7b-fdd2-4f36-b1a0-462146ab7bd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:18.180317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc215f7b-fdd2-4f36-b1a0-462146ab7bd4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:18.297130 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1117/2241] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:59:18 2022] POST /identity/v3/users => generated 295 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:59:18.300651 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b2b65-b817-4a7b-907f-2faf15d4aece admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:18.321058 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b2b65-b817-4a7b-907f-2faf15d4aece admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:18.326346 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3a16f-0ee5-4140-9173-00c350811c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:18.327012 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3a16f-0ee5-4140-9173-00c350811c25 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:18.327384 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3a16f-0ee5-4140-9173-00c350811c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:18.327696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3a16f-0ee5-4140-9173-00c350811c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:18.328369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3a16f-0ee5-4140-9173-00c350811c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:18.330095 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3a16f-0ee5-4140-9173-00c350811c25 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:18.341798 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1125/2242] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:59:18.346587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc215f7b-fdd2-4f36-b1a0-462146ab7bd4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:18.357469 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc215f7b-fdd2-4f36-b1a0-462146ab7bd4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:18.378483 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b61b5-2119-47c5-89d9-eec89f342b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:18.379682 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b61b5-2119-47c5-89d9-eec89f342b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:18.379983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b61b5-2119-47c5-89d9-eec89f342b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:18.380244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b61b5-2119-47c5-89d9-eec89f342b91 admin admin] PATH_INFO: `/v3/projects/b1fd63715c6f4dbfb8d552b718d62fd8/users/52732e11ddc74f1c8666b51f6f8aa6d6/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:18.396754 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b61b5-2119-47c5-89d9-eec89f342b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1fd63715c6f4dbfb8d552b718d62fd8, user_id=52732e11ddc74f1c8666b51f6f8aa6d6, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:18.401100 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b61b5-2119-47c5-89d9-eec89f342b91 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:18.497247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1118/2243] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:59:18 2022] PUT /identity/v3/projects/b1fd63715c6f4dbfb8d552b718d62fd8/users/52732e11ddc74f1c8666b51f6f8aa6d6/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:18.501352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3a16f-0ee5-4140-9173-00c350811c25 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:18.516920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3a16f-0ee5-4140-9173-00c350811c25 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:18.576401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985c37e-17f7-4916-b147-e24545cea96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:18.577202 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985c37e-17f7-4916-b147-e24545cea96a admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:18.577486 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985c37e-17f7-4916-b147-e24545cea96a admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:18.577759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985c37e-17f7-4916-b147-e24545cea96a admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:18.578450 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985c37e-17f7-4916-b147-e24545cea96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:18.580073 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985c37e-17f7-4916-b147-e24545cea96a admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:18.591051 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1126/2244] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:59:18.595318 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b61b5-2119-47c5-89d9-eec89f342b91 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:18.605784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b61b5-2119-47c5-89d9-eec89f342b91 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:18.610332 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a1148-81cf-4f57-9cdb-c8586222ba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:18.610987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a1148-81cf-4f57-9cdb-c8586222ba79 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:18.611254 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a1148-81cf-4f57-9cdb-c8586222ba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:18.611522 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a1148-81cf-4f57-9cdb-c8586222ba79 admin admin] PATH_INFO: `/v3/projects/b1fd63715c6f4dbfb8d552b718d62fd8/users/52732e11ddc74f1c8666b51f6f8aa6d6/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:18.613553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a1148-81cf-4f57-9cdb-c8586222ba79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1fd63715c6f4dbfb8d552b718d62fd8, user_id=52732e11ddc74f1c8666b51f6f8aa6d6, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:18.616252 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a1148-81cf-4f57-9cdb-c8586222ba79 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:18.626954 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1119/2245] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:59:18 2022] PUT /identity/v3/projects/b1fd63715c6f4dbfb8d552b718d62fd8/users/52732e11ddc74f1c8666b51f6f8aa6d6/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:18.642631 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560def8f-d8eb-4c19-9bd7-73838e6234d7 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:18.643197 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560def8f-d8eb-4c19-9bd7-73838e6234d7 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:18.643622 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560def8f-d8eb-4c19-9bd7-73838e6234d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:18.694855 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-560def8f-d8eb-4c19-9bd7-73838e6234d7 None None] MFA Rules not processed for user `52732e11ddc74f1c8666b51f6f8aa6d6`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:18.694855 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-560def8f-d8eb-4c19-9bd7-73838e6234d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:18.716957 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:18.775117 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1127/2246] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:18.783176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a1148-81cf-4f57-9cdb-c8586222ba79 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:18.784982 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-948a1148-81cf-4f57-9cdb-c8586222ba79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:18.864747 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a1148-81cf-4f57-9cdb-c8586222ba79 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:18.874924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a024568-037f-469c-90ee-7cdc1c240500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:18.876085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a024568-037f-469c-90ee-7cdc1c240500 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:18.876626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a024568-037f-469c-90ee-7cdc1c240500 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:18.877127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a024568-037f-469c-90ee-7cdc1c240500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:18.917619 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:18.957008 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a024568-037f-469c-90ee-7cdc1c240500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:18.958463 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a024568-037f-469c-90ee-7cdc1c240500 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:18.968124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1120/2247] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:59:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:59:21.925433 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560def8f-d8eb-4c19-9bd7-73838e6234d7 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:21.935912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560def8f-d8eb-4c19-9bd7-73838e6234d7 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:21.941077 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0db1f-48dd-42f1-9e37-9a9fd9dfd5c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:21.941077 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0db1f-48dd-42f1-9e37-9a9fd9dfd5c4 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:21.941487 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0db1f-48dd-42f1-9e37-9a9fd9dfd5c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:21.941487 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0db1f-48dd-42f1-9e37-9a9fd9dfd5c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:21.955636 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0db1f-48dd-42f1-9e37-9a9fd9dfd5c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:21.957420 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0db1f-48dd-42f1-9e37-9a9fd9dfd5c4 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:21.969763 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1128/2248] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:59:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:59:24.314206 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a024568-037f-469c-90ee-7cdc1c240500 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:24.315981 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3a024568-037f-469c-90ee-7cdc1c240500 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:24.417671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a024568-037f-469c-90ee-7cdc1c240500 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:24.431872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fbea3-652d-4ce9-bd95-4443e10fb046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:24.431872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fbea3-652d-4ce9-bd95-4443e10fb046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:24.431872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fbea3-652d-4ce9-bd95-4443e10fb046 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:24.431872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fbea3-652d-4ce9-bd95-4443e10fb046 admin admin] PATH_INFO: `/v3/users/007f7b3dc17a4cab982514d8c7765720` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:24.432601 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fbea3-652d-4ce9-bd95-4443e10fb046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=007f7b3dc17a4cab982514d8c7765720)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:24.432601 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fbea3-652d-4ce9-bd95-4443e10fb046 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:24.613991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b03fbea3-652d-4ce9-bd95-4443e10fb046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '007f7b3dc17a4cab982514d8c7765720'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:24.670486 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b03fbea3-652d-4ce9-bd95-4443e10fb046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '007f7b3dc17a4cab982514d8c7765720'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:24.671128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b03fbea3-652d-4ce9-bd95-4443e10fb046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '007f7b3dc17a4cab982514d8c7765720'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:24.671729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b03fbea3-652d-4ce9-bd95-4443e10fb046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '007f7b3dc17a4cab982514d8c7765720'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:24.679457 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b03fbea3-652d-4ce9-bd95-4443e10fb046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '007f7b3dc17a4cab982514d8c7765720'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:24.697908 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1121/2249] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:59:24 2022] DELETE /identity/v3/users/007f7b3dc17a4cab982514d8c7765720 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:24.702370 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403424c-81ca-4ccb-a825-9cc18ba561c5 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:24.702887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403424c-81ca-4ccb-a825-9cc18ba561c5 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:24.703016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403424c-81ca-4ccb-a825-9cc18ba561c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:24.722949 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-8403424c-81ca-4ccb-a825-9cc18ba561c5 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:24.724157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-8403424c-81ca-4ccb-a825-9cc18ba561c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:24.822534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1129/2250] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:24.829339 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fbea3-652d-4ce9-bd95-4443e10fb046 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:24.831110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b03fbea3-652d-4ce9-bd95-4443e10fb046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:24.911388 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:24.916908 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fbea3-652d-4ce9-bd95-4443e10fb046 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:24.920877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111857f3-a07e-4c8f-9ed1-943320dce3b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:24.921490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111857f3-a07e-4c8f-9ed1-943320dce3b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:24.921772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111857f3-a07e-4c8f-9ed1-943320dce3b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:24.922046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111857f3-a07e-4c8f-9ed1-943320dce3b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:24.932666 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111857f3-a07e-4c8f-9ed1-943320dce3b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:24.934212 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111857f3-a07e-4c8f-9ed1-943320dce3b2 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:24.944924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1122/2251] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:59:25.406286 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403424c-81ca-4ccb-a825-9cc18ba561c5 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:25.409157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-8403424c-81ca-4ccb-a825-9cc18ba561c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:25.435009 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403424c-81ca-4ccb-a825-9cc18ba561c5 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:25.446758 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7992c1-56a1-4317-a839-774ab9121d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:25.450025 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7992c1-56a1-4317-a839-774ab9121d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:25.450334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7992c1-56a1-4317-a839-774ab9121d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:25.450615 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7992c1-56a1-4317-a839-774ab9121d99 admin admin] PATH_INFO: `/v3/projects/d54522b27e2b4215899050dda31b35a0` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:25.458629 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7992c1-56a1-4317-a839-774ab9121d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d54522b27e2b4215899050dda31b35a0)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:25.460811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7992c1-56a1-4317-a839-774ab9121d99 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:25.591980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9c7992c1-56a1-4317-a839-774ab9121d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd54522b27e2b4215899050dda31b35a0', 'request_id': 'req-9c7992c1-56a1-4317-a839-774ab9121d99'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:25.599124 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9c7992c1-56a1-4317-a839-774ab9121d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd54522b27e2b4215899050dda31b35a0', 'request_id': 'req-9c7992c1-56a1-4317-a839-774ab9121d99'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:25.677922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9c7992c1-56a1-4317-a839-774ab9121d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd54522b27e2b4215899050dda31b35a0', 'request_id': 'req-9c7992c1-56a1-4317-a839-774ab9121d99'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:25.689199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9c7992c1-56a1-4317-a839-774ab9121d99 admin admin] The token cache is being invalidate because project d54522b27e2b4215899050dda31b35a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:59:25.689491 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9c7992c1-56a1-4317-a839-774ab9121d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:25.690122 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9c7992c1-56a1-4317-a839-774ab9121d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:25.691908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1130/2252] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:59:25 2022] DELETE /identity/v3/projects/d54522b27e2b4215899050dda31b35a0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:25.697026 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115465c-9100-4b50-a303-d1de5b50cb4f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:25.697541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115465c-9100-4b50-a303-d1de5b50cb4f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:25.697711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115465c-9100-4b50-a303-d1de5b50cb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:25.726948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b115465c-9100-4b50-a303-d1de5b50cb4f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:25.728142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b115465c-9100-4b50-a303-d1de5b50cb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:25.785930 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1123/2253] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:25.795346 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db43f6b-1527-4922-99a0-e50ecbaee7c2 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:25.795807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db43f6b-1527-4922-99a0-e50ecbaee7c2 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:25.795894 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db43f6b-1527-4922-99a0-e50ecbaee7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:25.820714 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-4db43f6b-1527-4922-99a0-e50ecbaee7c2 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:25.822688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4db43f6b-1527-4922-99a0-e50ecbaee7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:25.831910 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1131/2254] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:25.837386 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115465c-9100-4b50-a303-d1de5b50cb4f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:25.848208 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115465c-9100-4b50-a303-d1de5b50cb4f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:25.854445 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b6782-f554-4ad8-bde2-43f53ec9905b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:25.855191 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b6782-f554-4ad8-bde2-43f53ec9905b admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:25.855536 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b6782-f554-4ad8-bde2-43f53ec9905b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:25.855876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b6782-f554-4ad8-bde2-43f53ec9905b admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:25.856659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b6782-f554-4ad8-bde2-43f53ec9905b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:59:25.856966 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b6782-f554-4ad8-bde2-43f53ec9905b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:25.858663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b6782-f554-4ad8-bde2-43f53ec9905b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:25.871473 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1124/2255] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:59:25.875812 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db43f6b-1527-4922-99a0-e50ecbaee7c2 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:25.885279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db43f6b-1527-4922-99a0-e50ecbaee7c2 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:25.890141 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de25f3-8ac2-40c8-b011-edc3140af1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:25.890829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de25f3-8ac2-40c8-b011-edc3140af1fc admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:25.891109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de25f3-8ac2-40c8-b011-edc3140af1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:25.891378 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de25f3-8ac2-40c8-b011-edc3140af1fc admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:25.892049 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de25f3-8ac2-40c8-b011-edc3140af1fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:25.894021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de25f3-8ac2-40c8-b011-edc3140af1fc admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:25.987224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:25.994197 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1132/2256] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:59:25 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:59:25.998311 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b6782-f554-4ad8-bde2-43f53ec9905b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:26.008487 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b6782-f554-4ad8-bde2-43f53ec9905b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:26.097604 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6bd92-6b03-49a2-b4f3-b51636dc592e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:26.098625 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6bd92-6b03-49a2-b4f3-b51636dc592e admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:26.099146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6bd92-6b03-49a2-b4f3-b51636dc592e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:26.099624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6bd92-6b03-49a2-b4f3-b51636dc592e admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:26.100725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6bd92-6b03-49a2-b4f3-b51636dc592e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:26.102934 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6bd92-6b03-49a2-b4f3-b51636dc592e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:26.192070 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1125/2257] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:59:25 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:59:26.198064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de25f3-8ac2-40c8-b011-edc3140af1fc admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:26.209002 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de25f3-8ac2-40c8-b011-edc3140af1fc admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:26.214047 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1729b-364c-4440-b257-9ceb1a2399bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:26.214654 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1729b-364c-4440-b257-9ceb1a2399bc admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:26.214960 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1729b-364c-4440-b257-9ceb1a2399bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:26.215228 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1729b-364c-4440-b257-9ceb1a2399bc admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:26.216001 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1729b-364c-4440-b257-9ceb1a2399bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:26.222206 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1729b-364c-4440-b257-9ceb1a2399bc admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:26.239040 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1133/2258] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:59:26.239292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6bd92-6b03-49a2-b4f3-b51636dc592e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:26.257981 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6bd92-6b03-49a2-b4f3-b51636dc592e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:26.269049 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3abe9-2664-43c6-ab06-806c36f1b716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:26.269888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3abe9-2664-43c6-ab06-806c36f1b716 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:26.270175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3abe9-2664-43c6-ab06-806c36f1b716 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:26.270497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3abe9-2664-43c6-ab06-806c36f1b716 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:26.271682 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3abe9-2664-43c6-ab06-806c36f1b716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:26.273500 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3abe9-2664-43c6-ab06-806c36f1b716 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:26.286548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1126/2259] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:59:26.296067 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1729b-364c-4440-b257-9ceb1a2399bc admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:26.309300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1729b-364c-4440-b257-9ceb1a2399bc admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:26.314850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dfe01-35d9-4c5d-a119-9b92143bd0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:26.316252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dfe01-35d9-4c5d-a119-9b92143bd0af admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:26.316829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dfe01-35d9-4c5d-a119-9b92143bd0af admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:26.317852 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dfe01-35d9-4c5d-a119-9b92143bd0af admin admin] PATH_INFO: `/v3/projects/2c0dbc1cd2944053b1af39d468d2bdb3/users/b90f42f4ff17423a9e9306738a98f3a8/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:26.357333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dfe01-35d9-4c5d-a119-9b92143bd0af admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0dbc1cd2944053b1af39d468d2bdb3, user_id=b90f42f4ff17423a9e9306738a98f3a8, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:26.360408 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dfe01-35d9-4c5d-a119-9b92143bd0af admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:26.445740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1134/2260] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:59:26 2022] PUT /identity/v3/projects/2c0dbc1cd2944053b1af39d468d2bdb3/users/b90f42f4ff17423a9e9306738a98f3a8/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:26.456860 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3d367-0563-4878-9bc5-33192e178d6f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:26.456860 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3d367-0563-4878-9bc5-33192e178d6f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:26.462271 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3d367-0563-4878-9bc5-33192e178d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:26.495066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f8f3d367-0563-4878-9bc5-33192e178d6f None None] MFA Rules not processed for user `b90f42f4ff17423a9e9306738a98f3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:26.496302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f8f3d367-0563-4878-9bc5-33192e178d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:26.557540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:26.580036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1127/2261] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:26.596223 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dfe01-35d9-4c5d-a119-9b92143bd0af admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:26.599828 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-2c0dfe01-35d9-4c5d-a119-9b92143bd0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:26.671985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dfe01-35d9-4c5d-a119-9b92143bd0af admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:26.675832 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d72164-af6f-458e-b3c4-c3180de863f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:26.679927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d72164-af6f-458e-b3c4-c3180de863f8 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:26.679927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d72164-af6f-458e-b3c4-c3180de863f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:26.679927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d72164-af6f-458e-b3c4-c3180de863f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:26.685776 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d72164-af6f-458e-b3c4-c3180de863f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:26.687194 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d72164-af6f-458e-b3c4-c3180de863f8 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:26.696298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1135/2262] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:59:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:59:27.725205 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3d367-0563-4878-9bc5-33192e178d6f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:27.726724 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f8f3d367-0563-4878-9bc5-33192e178d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:27.796501 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3d367-0563-4878-9bc5-33192e178d6f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:27.801326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb6445-9a1d-4ef8-827e-dd66c934a5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:27.802269 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb6445-9a1d-4ef8-827e-dd66c934a5d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:27.804926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb6445-9a1d-4ef8-827e-dd66c934a5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:27.804926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb6445-9a1d-4ef8-827e-dd66c934a5d0 admin admin] PATH_INFO: `/v3/users/a6e648d4cb944ef9aeab32c42ee6a817` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:27.804926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb6445-9a1d-4ef8-827e-dd66c934a5d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e648d4cb944ef9aeab32c42ee6a817)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:27.806013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb6445-9a1d-4ef8-827e-dd66c934a5d0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:28.002613 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f1bb6445-9a1d-4ef8-827e-dd66c934a5d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e648d4cb944ef9aeab32c42ee6a817'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:28.093479 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f1bb6445-9a1d-4ef8-827e-dd66c934a5d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e648d4cb944ef9aeab32c42ee6a817'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:28.094630 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f1bb6445-9a1d-4ef8-827e-dd66c934a5d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e648d4cb944ef9aeab32c42ee6a817'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:28.094790 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f1bb6445-9a1d-4ef8-827e-dd66c934a5d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e648d4cb944ef9aeab32c42ee6a817'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:28.103088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f1bb6445-9a1d-4ef8-827e-dd66c934a5d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e648d4cb944ef9aeab32c42ee6a817'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:28.120752 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1128/2263] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:59:27 2022] DELETE /identity/v3/users/a6e648d4cb944ef9aeab32c42ee6a817 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:28.125114 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f29614-3c91-4e75-8d14-515b1dd80d7d None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:28.125610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f29614-3c91-4e75-8d14-515b1dd80d7d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:28.125704 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f29614-3c91-4e75-8d14-515b1dd80d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:28.144409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-16f29614-3c91-4e75-8d14-515b1dd80d7d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:28.149015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-16f29614-3c91-4e75-8d14-515b1dd80d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:28.209908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1136/2264] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:28.219919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb6445-9a1d-4ef8-827e-dd66c934a5d0 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:28.221381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f1bb6445-9a1d-4ef8-827e-dd66c934a5d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:28.280000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb6445-9a1d-4ef8-827e-dd66c934a5d0 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:28.283983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf9650-a61c-4196-b10e-0bba1c04e425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:28.284622 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf9650-a61c-4196-b10e-0bba1c04e425 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:28.284906 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf9650-a61c-4196-b10e-0bba1c04e425 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:28.285176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf9650-a61c-4196-b10e-0bba1c04e425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:28.294710 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf9650-a61c-4196-b10e-0bba1c04e425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:28.296145 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf9650-a61c-4196-b10e-0bba1c04e425 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:28.305439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1129/2265] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:59:28.713224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f29614-3c91-4e75-8d14-515b1dd80d7d None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:28.715533 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-16f29614-3c91-4e75-8d14-515b1dd80d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:28.727807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f29614-3c91-4e75-8d14-515b1dd80d7d None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:28.732904 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a44a9b-9c99-4d55-bda0-eb44b8d67808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:28.733778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a44a9b-9c99-4d55-bda0-eb44b8d67808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:28.734010 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a44a9b-9c99-4d55-bda0-eb44b8d67808 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:28.734281 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a44a9b-9c99-4d55-bda0-eb44b8d67808 admin admin] PATH_INFO: `/v3/projects/157f416e5f36420f879fa1ab55d2970a` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:28.735448 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a44a9b-9c99-4d55-bda0-eb44b8d67808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=157f416e5f36420f879fa1ab55d2970a)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:28.737438 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a44a9b-9c99-4d55-bda0-eb44b8d67808 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:28.843983 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-86a44a9b-9c99-4d55-bda0-eb44b8d67808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '157f416e5f36420f879fa1ab55d2970a', 'request_id': 'req-86a44a9b-9c99-4d55-bda0-eb44b8d67808'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:28.851641 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-86a44a9b-9c99-4d55-bda0-eb44b8d67808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '157f416e5f36420f879fa1ab55d2970a', 'request_id': 'req-86a44a9b-9c99-4d55-bda0-eb44b8d67808'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:28.894126 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-86a44a9b-9c99-4d55-bda0-eb44b8d67808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '157f416e5f36420f879fa1ab55d2970a', 'request_id': 'req-86a44a9b-9c99-4d55-bda0-eb44b8d67808'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:28.896671 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:28.905999 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-86a44a9b-9c99-4d55-bda0-eb44b8d67808 admin admin] The token cache is being invalidate because project 157f416e5f36420f879fa1ab55d2970a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:59:28.906293 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-86a44a9b-9c99-4d55-bda0-eb44b8d67808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:28.906991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-86a44a9b-9c99-4d55-bda0-eb44b8d67808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:28.908521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1137/2266] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:59:28 2022] DELETE /identity/v3/projects/157f416e5f36420f879fa1ab55d2970a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:28.912542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf9650-a61c-4196-b10e-0bba1c04e425 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:28.923242 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf9650-a61c-4196-b10e-0bba1c04e425 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:28.927440 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:28.983930 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0110bb-0139-4b24-8f4c-e5af3319f3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:28.984612 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0110bb-0139-4b24-8f4c-e5af3319f3e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:28.984890 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0110bb-0139-4b24-8f4c-e5af3319f3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:28.985157 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0110bb-0139-4b24-8f4c-e5af3319f3e0 admin admin] PATH_INFO: `/v3/users/52732e11ddc74f1c8666b51f6f8aa6d6` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:28.986272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0110bb-0139-4b24-8f4c-e5af3319f3e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52732e11ddc74f1c8666b51f6f8aa6d6)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:28.988295 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0110bb-0139-4b24-8f4c-e5af3319f3e0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:29.211326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2a0110bb-0139-4b24-8f4c-e5af3319f3e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52732e11ddc74f1c8666b51f6f8aa6d6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:29.227131 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a44a9b-9c99-4d55-bda0-eb44b8d67808 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:29.228591 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-86a44a9b-9c99-4d55-bda0-eb44b8d67808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:29.241875 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a44a9b-9c99-4d55-bda0-eb44b8d67808 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:29.247345 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76088d6-f0ca-44ae-8394-f89b413e3b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:29.247969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76088d6-f0ca-44ae-8394-f89b413e3b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:29.248252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76088d6-f0ca-44ae-8394-f89b413e3b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:29.248573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76088d6-f0ca-44ae-8394-f89b413e3b60 admin admin] PATH_INFO: `/v3/users/d884c4dd840e4e3d99f64aa1178b39b1` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:29.249702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76088d6-f0ca-44ae-8394-f89b413e3b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d884c4dd840e4e3d99f64aa1178b39b1)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:29.251629 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76088d6-f0ca-44ae-8394-f89b413e3b60 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:29.282620 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2a0110bb-0139-4b24-8f4c-e5af3319f3e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52732e11ddc74f1c8666b51f6f8aa6d6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:29.283230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2a0110bb-0139-4b24-8f4c-e5af3319f3e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52732e11ddc74f1c8666b51f6f8aa6d6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:29.283827 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2a0110bb-0139-4b24-8f4c-e5af3319f3e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52732e11ddc74f1c8666b51f6f8aa6d6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:29.291658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2a0110bb-0139-4b24-8f4c-e5af3319f3e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52732e11ddc74f1c8666b51f6f8aa6d6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:29.309251 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1130/2267] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:59:28 2022] DELETE /identity/v3/users/52732e11ddc74f1c8666b51f6f8aa6d6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:29.525575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d76088d6-f0ca-44ae-8394-f89b413e3b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd884c4dd840e4e3d99f64aa1178b39b1'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:29.608142 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d76088d6-f0ca-44ae-8394-f89b413e3b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd884c4dd840e4e3d99f64aa1178b39b1'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:29.609235 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d76088d6-f0ca-44ae-8394-f89b413e3b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd884c4dd840e4e3d99f64aa1178b39b1'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:29.624630 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d76088d6-f0ca-44ae-8394-f89b413e3b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd884c4dd840e4e3d99f64aa1178b39b1'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:29.625379 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-d76088d6-f0ca-44ae-8394-f89b413e3b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd884c4dd840e4e3d99f64aa1178b39b1'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:29.639739 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1138/2268] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:59:29 2022] DELETE /identity/v3/users/d884c4dd840e4e3d99f64aa1178b39b1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:29.644226 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cdac4-c779-4675-9a83-7509e7b6f168 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:29.644542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cdac4-c779-4675-9a83-7509e7b6f168 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:29.644817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cdac4-c779-4675-9a83-7509e7b6f168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:29.667223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-835cdac4-c779-4675-9a83-7509e7b6f168 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:29.668815 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-835cdac4-c779-4675-9a83-7509e7b6f168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:29.744030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1131/2269] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:59:29.753777 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76088d6-f0ca-44ae-8394-f89b413e3b60 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:29.755234 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d76088d6-f0ca-44ae-8394-f89b413e3b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:29.808091 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cdac4-c779-4675-9a83-7509e7b6f168 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:29.809791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-835cdac4-c779-4675-9a83-7509e7b6f168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:29.823534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76088d6-f0ca-44ae-8394-f89b413e3b60 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:29.827233 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b0795-9826-4761-9db2-8327b54834b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:29.827913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cdac4-c779-4675-9a83-7509e7b6f168 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:29.828807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b0795-9826-4761-9db2-8327b54834b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:29.828807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b0795-9826-4761-9db2-8327b54834b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:29.829109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b0795-9826-4761-9db2-8327b54834b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:29.835052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b9b49-0ac6-4741-a480-2a1a174b89c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:29.836168 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b9b49-0ac6-4741-a480-2a1a174b89c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:29.836581 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b9b49-0ac6-4741-a480-2a1a174b89c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:29.837059 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b9b49-0ac6-4741-a480-2a1a174b89c7 admin admin] PATH_INFO: `/v3/projects/b1fd63715c6f4dbfb8d552b718d62fd8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:29.838508 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b9b49-0ac6-4741-a480-2a1a174b89c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1fd63715c6f4dbfb8d552b718d62fd8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:29.840280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b0795-9826-4761-9db2-8327b54834b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:29.841773 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b0795-9826-4761-9db2-8327b54834b2 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:29.842151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b9b49-0ac6-4741-a480-2a1a174b89c7 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:29.853601 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1139/2270] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:59:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:59:29.874091 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:30.021809 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d90b9b49-0ac6-4741-a480-2a1a174b89c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1fd63715c6f4dbfb8d552b718d62fd8', 'request_id': 'req-d90b9b49-0ac6-4741-a480-2a1a174b89c7'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:30.028571 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d90b9b49-0ac6-4741-a480-2a1a174b89c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1fd63715c6f4dbfb8d552b718d62fd8', 'request_id': 'req-d90b9b49-0ac6-4741-a480-2a1a174b89c7'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:30.128149 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d90b9b49-0ac6-4741-a480-2a1a174b89c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1fd63715c6f4dbfb8d552b718d62fd8', 'request_id': 'req-d90b9b49-0ac6-4741-a480-2a1a174b89c7'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:30.140661 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d90b9b49-0ac6-4741-a480-2a1a174b89c7 admin admin] The token cache is being invalidate because project b1fd63715c6f4dbfb8d552b718d62fd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:59:30.141080 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d90b9b49-0ac6-4741-a480-2a1a174b89c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:30.141851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d90b9b49-0ac6-4741-a480-2a1a174b89c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:30.144041 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1132/2271] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:59:29 2022] DELETE /identity/v3/projects/b1fd63715c6f4dbfb8d552b718d62fd8 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:59:30.149344 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613d7cc-0dac-4d43-9fa0-4bb0a8397dd1 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:30.149637 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613d7cc-0dac-4d43-9fa0-4bb0a8397dd1 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:30.149917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613d7cc-0dac-4d43-9fa0-4bb0a8397dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:30.170310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-8613d7cc-0dac-4d43-9fa0-4bb0a8397dd1 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:30.171582 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-8613d7cc-0dac-4d43-9fa0-4bb0a8397dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:30.234727 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1140/2272] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:30.243250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c3693-2898-428c-9a78-f4696c2b4316 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:30.243538 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c3693-2898-428c-9a78-f4696c2b4316 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:30.243813 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c3693-2898-428c-9a78-f4696c2b4316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:30.265558 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-147c3693-2898-428c-9a78-f4696c2b4316 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:30.266786 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-147c3693-2898-428c-9a78-f4696c2b4316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:30.278064 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1133/2273] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:30.282258 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613d7cc-0dac-4d43-9fa0-4bb0a8397dd1 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:30.292002 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613d7cc-0dac-4d43-9fa0-4bb0a8397dd1 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:30.296612 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87a220-31ed-45b6-9f07-84d31fda691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:30.297266 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87a220-31ed-45b6-9f07-84d31fda691f admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:30.297542 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87a220-31ed-45b6-9f07-84d31fda691f admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:30.297812 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87a220-31ed-45b6-9f07-84d31fda691f admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:30.298451 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87a220-31ed-45b6-9f07-84d31fda691f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:59:30.299013 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87a220-31ed-45b6-9f07-84d31fda691f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:30.300675 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87a220-31ed-45b6-9f07-84d31fda691f admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:30.302697 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:30.313505 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1141/2274] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:59:30.318888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c3693-2898-428c-9a78-f4696c2b4316 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:30.328551 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c3693-2898-428c-9a78-f4696c2b4316 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:30.340058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9830219-5c79-4a4e-beea-a63d595dd324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:30.340721 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9830219-5c79-4a4e-beea-a63d595dd324 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:30.341004 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9830219-5c79-4a4e-beea-a63d595dd324 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:30.341280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9830219-5c79-4a4e-beea-a63d595dd324 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:30.341920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9830219-5c79-4a4e-beea-a63d595dd324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:30.343863 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9830219-5c79-4a4e-beea-a63d595dd324 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:30.416591 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87a220-31ed-45b6-9f07-84d31fda691f admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:30.418464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-6d87a220-31ed-45b6-9f07-84d31fda691f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:30.445170 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1134/2275] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:59:30 2022] POST /identity/v3/projects => generated 401 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:59:30.449239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9830219-5c79-4a4e-beea-a63d595dd324 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:30.463876 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87a220-31ed-45b6-9f07-84d31fda691f admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:30.513951 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9830219-5c79-4a4e-beea-a63d595dd324 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:30.518742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6931077-301f-41ac-b24c-aee01374c165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:30.520212 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eff958-129e-480d-abee-8a2672fbff4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:30.520339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6931077-301f-41ac-b24c-aee01374c165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:30.520497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eff958-129e-480d-abee-8a2672fbff4f admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:30.520590 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6931077-301f-41ac-b24c-aee01374c165 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:30.520777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eff958-129e-480d-abee-8a2672fbff4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:30.520922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6931077-301f-41ac-b24c-aee01374c165 admin admin] PATH_INFO: `/v3/projects/bd6ee49a17e949b887521d5b7630eb17` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:30.521016 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eff958-129e-480d-abee-8a2672fbff4f admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:30.521119 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eff958-129e-480d-abee-8a2672fbff4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:30.521218 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6931077-301f-41ac-b24c-aee01374c165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd6ee49a17e949b887521d5b7630eb17)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:30.523001 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eff958-129e-480d-abee-8a2672fbff4f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:30.523134 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6931077-301f-41ac-b24c-aee01374c165 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:30.671540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1135/2276] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:59:30 2022] POST /identity/v3/users => generated 301 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:59:30.675447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eff958-129e-480d-abee-8a2672fbff4f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:30.685521 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eff958-129e-480d-abee-8a2672fbff4f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:30.686121 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f6931077-301f-41ac-b24c-aee01374c165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd6ee49a17e949b887521d5b7630eb17', 'request_id': 'req-f6931077-301f-41ac-b24c-aee01374c165'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:30.693429 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f6931077-301f-41ac-b24c-aee01374c165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd6ee49a17e949b887521d5b7630eb17', 'request_id': 'req-f6931077-301f-41ac-b24c-aee01374c165'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:30.745227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d313e-96a8-4740-be78-a618de791ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:30.745846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d313e-96a8-4740-be78-a618de791ffd admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:30.746129 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d313e-96a8-4740-be78-a618de791ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:30.746415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d313e-96a8-4740-be78-a618de791ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:30.747074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d313e-96a8-4740-be78-a618de791ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:30.748791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d313e-96a8-4740-be78-a618de791ffd admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:30.759401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1136/2277] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:59:30.763473 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d313e-96a8-4740-be78-a618de791ffd admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:30.773378 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d313e-96a8-4740-be78-a618de791ffd admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:30.778091 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677eb56d-ba81-4edf-8fa7-786f4025ec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:30.778685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eb56d-ba81-4edf-8fa7-786f4025ec8b admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:30.778961 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eb56d-ba81-4edf-8fa7-786f4025ec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:30.779233 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eb56d-ba81-4edf-8fa7-786f4025ec8b admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:30.779895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677eb56d-ba81-4edf-8fa7-786f4025ec8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:30.781570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677eb56d-ba81-4edf-8fa7-786f4025ec8b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:30.785373 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f6931077-301f-41ac-b24c-aee01374c165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd6ee49a17e949b887521d5b7630eb17', 'request_id': 'req-f6931077-301f-41ac-b24c-aee01374c165'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:30.796756 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1137/2278] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:59:30.797558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f6931077-301f-41ac-b24c-aee01374c165 admin admin] The token cache is being invalidate because project bd6ee49a17e949b887521d5b7630eb17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:59:30.797948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f6931077-301f-41ac-b24c-aee01374c165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:30.798704 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-f6931077-301f-41ac-b24c-aee01374c165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:30.800214 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1142/2279] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:59:30 2022] DELETE /identity/v3/projects/bd6ee49a17e949b887521d5b7630eb17 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:30.804262 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677eb56d-ba81-4edf-8fa7-786f4025ec8b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:30.804262 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-677eb56d-ba81-4edf-8fa7-786f4025ec8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:30.805534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cd30d-814c-42f5-a81d-20db33869dbb None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:30.805882 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cd30d-814c-42f5-a81d-20db33869dbb None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:30.806099 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cd30d-814c-42f5-a81d-20db33869dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:30.816828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677eb56d-ba81-4edf-8fa7-786f4025ec8b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:30.823605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f517cf-bccc-4a4e-954a-d96f1efdba04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:30.824499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f517cf-bccc-4a4e-954a-d96f1efdba04 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:30.825216 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f517cf-bccc-4a4e-954a-d96f1efdba04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:30.825662 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f517cf-bccc-4a4e-954a-d96f1efdba04 admin admin] PATH_INFO: `/v3/projects/bf4dc7203ec24a3b9752fc2f105464e8/users/2d8b42343a1a49228f0cf29d42d9216d/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:30.830043 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-1d4cd30d-814c-42f5-a81d-20db33869dbb None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:30.832478 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1d4cd30d-814c-42f5-a81d-20db33869dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:30.842190 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f517cf-bccc-4a4e-954a-d96f1efdba04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf4dc7203ec24a3b9752fc2f105464e8, user_id=2d8b42343a1a49228f0cf29d42d9216d, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:30.845074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f517cf-bccc-4a4e-954a-d96f1efdba04 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:30.845611 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1143/2280] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:59:30.853481 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbc3b3-c03a-4303-a5e4-e39ff2eb19d0 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:30.853764 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbc3b3-c03a-4303-a5e4-e39ff2eb19d0 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:30.854063 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbc3b3-c03a-4303-a5e4-e39ff2eb19d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:30.875422 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-0afbc3b3-c03a-4303-a5e4-e39ff2eb19d0 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:30.876638 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0afbc3b3-c03a-4303-a5e4-e39ff2eb19d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:30.884479 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1144/2281] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:59:30.888631 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbc3b3-c03a-4303-a5e4-e39ff2eb19d0 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:30.898097 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbc3b3-c03a-4303-a5e4-e39ff2eb19d0 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:30.902768 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db856c66-9928-4513-9b1e-e0b308b2ef94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:30.903385 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db856c66-9928-4513-9b1e-e0b308b2ef94 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:30.903682 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db856c66-9928-4513-9b1e-e0b308b2ef94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:30.904064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db856c66-9928-4513-9b1e-e0b308b2ef94 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:30.904753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db856c66-9928-4513-9b1e-e0b308b2ef94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:59:30.905053 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db856c66-9928-4513-9b1e-e0b308b2ef94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:30.906644 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db856c66-9928-4513-9b1e-e0b308b2ef94 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:30.911651 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1138/2282] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:59:30 2022] PUT /identity/v3/projects/bf4dc7203ec24a3b9752fc2f105464e8/users/2d8b42343a1a49228f0cf29d42d9216d/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:30.917033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:30.922789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1145/2283] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:59:30.923303 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8024576-c880-41bc-b47b-caf5fef5e474 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:30.923652 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8024576-c880-41bc-b47b-caf5fef5e474 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:30.923763 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db856c66-9928-4513-9b1e-e0b308b2ef94 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:30.924109 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8024576-c880-41bc-b47b-caf5fef5e474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:30.934647 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db856c66-9928-4513-9b1e-e0b308b2ef94 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:30.953771 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f8024576-c880-41bc-b47b-caf5fef5e474 None None] MFA Rules not processed for user `2d8b42343a1a49228f0cf29d42d9216d`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:30.955150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f8024576-c880-41bc-b47b-caf5fef5e474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:30.993286 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1df63-20aa-41b2-871d-3bf72124ae4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:30.993897 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1df63-20aa-41b2-871d-3bf72124ae4e admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:30.994179 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1df63-20aa-41b2-871d-3bf72124ae4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:30.994448 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1df63-20aa-41b2-871d-3bf72124ae4e admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:30.995070 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1df63-20aa-41b2-871d-3bf72124ae4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:30.997079 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1df63-20aa-41b2-871d-3bf72124ae4e admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:31.019937 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1139/2284] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:30 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:59:31.024775 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8024576-c880-41bc-b47b-caf5fef5e474 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:31.034634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8024576-c880-41bc-b47b-caf5fef5e474 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:31.039670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8896074-8962-407c-8031-384c31c35b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:31.040245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8896074-8962-407c-8031-384c31c35b72 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:31.040566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8896074-8962-407c-8031-384c31c35b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:31.040837 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8896074-8962-407c-8031-384c31c35b72 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:31.041454 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8896074-8962-407c-8031-384c31c35b72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:31.043341 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8896074-8962-407c-8031-384c31c35b72 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:31.084589 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1146/2285] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:59:30 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:59:31.088659 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1df63-20aa-41b2-871d-3bf72124ae4e admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:31.150904 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1df63-20aa-41b2-871d-3bf72124ae4e admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:31.157216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5705133-a1f9-4de9-8614-36e3b5a26fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:31.158027 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5705133-a1f9-4de9-8614-36e3b5a26fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:31.158312 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5705133-a1f9-4de9-8614-36e3b5a26fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:31.158452 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1140/2286] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:59:31 2022] POST /identity/v3/projects => generated 399 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:59:31.158567 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5705133-a1f9-4de9-8614-36e3b5a26fa3 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:31.159282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5705133-a1f9-4de9-8614-36e3b5a26fa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:31.162140 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5705133-a1f9-4de9-8614-36e3b5a26fa3 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:31.162835 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8896074-8962-407c-8031-384c31c35b72 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:31.175698 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:31.226095 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8896074-8962-407c-8031-384c31c35b72 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:31.230835 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04591c19-736b-4e09-b8e0-013d9df7219e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:31.231434 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04591c19-736b-4e09-b8e0-013d9df7219e admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:31.231711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04591c19-736b-4e09-b8e0-013d9df7219e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:31.231983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04591c19-736b-4e09-b8e0-013d9df7219e admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:31.232795 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04591c19-736b-4e09-b8e0-013d9df7219e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:31.234811 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04591c19-736b-4e09-b8e0-013d9df7219e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:31.282500 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1147/2287] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:59:31 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:59:31.287313 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5705133-a1f9-4de9-8614-36e3b5a26fa3 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:31.297391 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5705133-a1f9-4de9-8614-36e3b5a26fa3 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:31.302632 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cc8fb-d669-4a68-aaa1-3421d986f84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:31.303277 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cc8fb-d669-4a68-aaa1-3421d986f84c admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:31.303582 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cc8fb-d669-4a68-aaa1-3421d986f84c admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:31.303860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cc8fb-d669-4a68-aaa1-3421d986f84c admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:31.304538 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cc8fb-d669-4a68-aaa1-3421d986f84c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:31.306128 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cc8fb-d669-4a68-aaa1-3421d986f84c admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:31.316456 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1148/2288] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:59:31.320924 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cc8fb-d669-4a68-aaa1-3421d986f84c admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:31.330831 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cc8fb-d669-4a68-aaa1-3421d986f84c admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:31.336313 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592c6d3-3884-4a78-8cfb-5ff7f1733c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:31.336955 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592c6d3-3884-4a78-8cfb-5ff7f1733c73 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:31.337237 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592c6d3-3884-4a78-8cfb-5ff7f1733c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:31.337562 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592c6d3-3884-4a78-8cfb-5ff7f1733c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:31.338210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592c6d3-3884-4a78-8cfb-5ff7f1733c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:31.339845 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592c6d3-3884-4a78-8cfb-5ff7f1733c73 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:31.350960 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1149/2289] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:59:31.352112 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1141/2290] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:59:31 2022] POST /identity/v3/users => generated 306 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:59:31.355982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592c6d3-3884-4a78-8cfb-5ff7f1733c73 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:31.357573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04591c19-736b-4e09-b8e0-013d9df7219e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:31.366427 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592c6d3-3884-4a78-8cfb-5ff7f1733c73 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:31.370154 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04591c19-736b-4e09-b8e0-013d9df7219e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:31.372883 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d25f4-4947-4b2e-a8be-e6577ff01c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:31.373591 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d25f4-4947-4b2e-a8be-e6577ff01c2a admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:31.373871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d25f4-4947-4b2e-a8be-e6577ff01c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:31.374170 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d25f4-4947-4b2e-a8be-e6577ff01c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:31.374814 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d25f4-4947-4b2e-a8be-e6577ff01c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:31.380055 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597f631-22bc-4173-9ce5-0d8d24a070b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:31.380200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d25f4-4947-4b2e-a8be-e6577ff01c2a admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:31.380298 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597f631-22bc-4173-9ce5-0d8d24a070b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:31.380298 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597f631-22bc-4173-9ce5-0d8d24a070b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:31.380298 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597f631-22bc-4173-9ce5-0d8d24a070b9 admin admin] PATH_INFO: `/v3/projects/e4feb0f68896425dbe4f5c91273a138c/users/2ccde4f5d8434948b02da77f853d1041/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:31.387538 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1150/2291] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:59:31.393275 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d25f4-4947-4b2e-a8be-e6577ff01c2a admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:31.393615 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597f631-22bc-4173-9ce5-0d8d24a070b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4feb0f68896425dbe4f5c91273a138c, user_id=2ccde4f5d8434948b02da77f853d1041, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:31.397150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597f631-22bc-4173-9ce5-0d8d24a070b9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:31.406441 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d25f4-4947-4b2e-a8be-e6577ff01c2a admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:31.412028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1f929-3e92-42f2-89e4-7af59f6b892e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:31.412667 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1f929-3e92-42f2-89e4-7af59f6b892e admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:31.412972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1f929-3e92-42f2-89e4-7af59f6b892e admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:31.413247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1f929-3e92-42f2-89e4-7af59f6b892e admin admin] PATH_INFO: `/v3/projects/326e9a841dcd47b69d7d9ec61686ca13/users/6dd40a19cf8448de8f2398c0059d4428/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:31.430198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1f929-3e92-42f2-89e4-7af59f6b892e admin admin] RBAC: Authorizing `identity:create_grant(project_id=326e9a841dcd47b69d7d9ec61686ca13, user_id=6dd40a19cf8448de8f2398c0059d4428, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:31.433028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1f929-3e92-42f2-89e4-7af59f6b892e admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:31.505159 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1142/2292] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:59:31 2022] PUT /identity/v3/projects/e4feb0f68896425dbe4f5c91273a138c/users/2ccde4f5d8434948b02da77f853d1041/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:59:31.516241 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdae08-e61a-420a-b368-53d889ca0219 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:31.518403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdae08-e61a-420a-b368-53d889ca0219 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:31.518403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdae08-e61a-420a-b368-53d889ca0219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:31.523910 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1151/2293] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:59:31 2022] PUT /identity/v3/projects/326e9a841dcd47b69d7d9ec61686ca13/users/6dd40a19cf8448de8f2398c0059d4428/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:31.525634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:31.527882 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1f929-3e92-42f2-89e4-7af59f6b892e admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:31.545525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-14fdae08-e61a-420a-b368-53d889ca0219 None None] MFA Rules not processed for user `2ccde4f5d8434948b02da77f853d1041`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:31.546872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-14fdae08-e61a-420a-b368-53d889ca0219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:31.592916 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1f929-3e92-42f2-89e4-7af59f6b892e admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:31.597800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c2f49-c2ba-4f29-a77f-210acb5b2a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:31.598952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c2f49-c2ba-4f29-a77f-210acb5b2a4c admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:31.599238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c2f49-c2ba-4f29-a77f-210acb5b2a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:31.599513 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c2f49-c2ba-4f29-a77f-210acb5b2a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:31.600239 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c2f49-c2ba-4f29-a77f-210acb5b2a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:31.601910 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c2f49-c2ba-4f29-a77f-210acb5b2a4c admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:31.612060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1152/2294] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:59:31.615134 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1143/2295] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:59:31.617524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c2f49-c2ba-4f29-a77f-210acb5b2a4c admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:31.626748 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdae08-e61a-420a-b368-53d889ca0219 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:31.628031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c2f49-c2ba-4f29-a77f-210acb5b2a4c admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:31.628243 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-14fdae08-e61a-420a-b368-53d889ca0219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:31.633133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29972df6-9ecd-4e13-afb3-4498429809f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:31.633808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29972df6-9ecd-4e13-afb3-4498429809f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:31.634094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29972df6-9ecd-4e13-afb3-4498429809f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:31.634376 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29972df6-9ecd-4e13-afb3-4498429809f5 admin admin] PATH_INFO: `/v3/projects/326e9a841dcd47b69d7d9ec61686ca13/users/6dd40a19cf8448de8f2398c0059d4428/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:31.636810 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29972df6-9ecd-4e13-afb3-4498429809f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=326e9a841dcd47b69d7d9ec61686ca13, user_id=6dd40a19cf8448de8f2398c0059d4428, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:31.639522 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29972df6-9ecd-4e13-afb3-4498429809f5 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:31.645286 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:31.650669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1153/2296] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:59:31 2022] PUT /identity/v3/projects/326e9a841dcd47b69d7d9ec61686ca13/users/6dd40a19cf8448de8f2398c0059d4428/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:59:31.661436 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2327b-741f-48af-811e-639bc890ab6b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:31.661724 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2327b-741f-48af-811e-639bc890ab6b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:31.662005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2327b-741f-48af-811e-639bc890ab6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:31.687577 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdae08-e61a-420a-b368-53d889ca0219 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:31.691868 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-b5e2327b-741f-48af-811e-639bc890ab6b None None] MFA Rules not processed for user `6dd40a19cf8448de8f2398c0059d4428`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:31.693150 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b5e2327b-741f-48af-811e-639bc890ab6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:31.738569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869bd45-aae4-4683-84b2-805f61a13917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:31.739229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869bd45-aae4-4683-84b2-805f61a13917 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:31.739528 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869bd45-aae4-4683-84b2-805f61a13917 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:31.739801 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869bd45-aae4-4683-84b2-805f61a13917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:31.761416 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1154/2297] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:31 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:59:31.772700 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2327b-741f-48af-811e-639bc890ab6b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:31.774243 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b5e2327b-741f-48af-811e-639bc890ab6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:31.788711 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2327b-741f-48af-811e-639bc890ab6b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:31.792520 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429d8b6-12f6-4b20-92b4-abd6c817dbc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:31.793130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429d8b6-12f6-4b20-92b4-abd6c817dbc5 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:31.793412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429d8b6-12f6-4b20-92b4-abd6c817dbc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:31.793741 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429d8b6-12f6-4b20-92b4-abd6c817dbc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:31.800086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869bd45-aae4-4683-84b2-805f61a13917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:31.801836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869bd45-aae4-4683-84b2-805f61a13917 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:31.807336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429d8b6-12f6-4b20-92b4-abd6c817dbc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:31.808833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429d8b6-12f6-4b20-92b4-abd6c817dbc5 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:31.811454 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1144/2298] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:59:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:59:31.821859 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1155/2299] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:59:31 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:59:32.010473 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869bd45-aae4-4683-84b2-805f61a13917 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:32.016387 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:32.024095 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869bd45-aae4-4683-84b2-805f61a13917 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:32.029982 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae194cc-88ca-44d6-b91c-94c0970049d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:32.030636 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae194cc-88ca-44d6-b91c-94c0970049d8 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:32.030854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae194cc-88ca-44d6-b91c-94c0970049d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:32.031125 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae194cc-88ca-44d6-b91c-94c0970049d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:32.090314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae194cc-88ca-44d6-b91c-94c0970049d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:32.091763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae194cc-88ca-44d6-b91c-94c0970049d8 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:32.100921 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1145/2300] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:59:32 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:59:33.763033 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b109a91-d2d9-44bc-bd13-508c009244ce None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:33.763603 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b109a91-d2d9-44bc-bd13-508c009244ce None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:33.763603 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b109a91-d2d9-44bc-bd13-508c009244ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:33.784119 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-3b109a91-d2d9-44bc-bd13-508c009244ce None None] MFA Rules not processed for user `2ccde4f5d8434948b02da77f853d1041`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:33.785412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3b109a91-d2d9-44bc-bd13-508c009244ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:33.793388 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1156/2301] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:38.712968 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae194cc-88ca-44d6-b91c-94c0970049d8 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:38.800876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae194cc-88ca-44d6-b91c-94c0970049d8 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:38.807346 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118e11c-3c4c-4ffc-87d7-c33e69761bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:38.808305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118e11c-3c4c-4ffc-87d7-c33e69761bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:38.808617 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118e11c-3c4c-4ffc-87d7-c33e69761bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:38.808891 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118e11c-3c4c-4ffc-87d7-c33e69761bdf admin admin] PATH_INFO: `/v3/users/2d8b42343a1a49228f0cf29d42d9216d` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:38.810749 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118e11c-3c4c-4ffc-87d7-c33e69761bdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8b42343a1a49228f0cf29d42d9216d)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:38.813947 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118e11c-3c4c-4ffc-87d7-c33e69761bdf admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:39.056156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-9118e11c-3c4c-4ffc-87d7-c33e69761bdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8b42343a1a49228f0cf29d42d9216d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:39.139017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-9118e11c-3c4c-4ffc-87d7-c33e69761bdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8b42343a1a49228f0cf29d42d9216d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:39.139605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-9118e11c-3c4c-4ffc-87d7-c33e69761bdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8b42343a1a49228f0cf29d42d9216d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:39.140226 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-9118e11c-3c4c-4ffc-87d7-c33e69761bdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8b42343a1a49228f0cf29d42d9216d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:39.148287 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-9118e11c-3c4c-4ffc-87d7-c33e69761bdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8b42343a1a49228f0cf29d42d9216d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:39.166022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1146/2302] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:59:38 2022] DELETE /identity/v3/users/2d8b42343a1a49228f0cf29d42d9216d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:39.170542 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8efd53-aaba-4e55-8955-dc374e869a62 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:39.172835 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8efd53-aaba-4e55-8955-dc374e869a62 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:39.172835 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8efd53-aaba-4e55-8955-dc374e869a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:39.193201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-cb8efd53-aaba-4e55-8955-dc374e869a62 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:39.194417 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-cb8efd53-aaba-4e55-8955-dc374e869a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:39.273861 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1157/2303] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:59:39.283839 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118e11c-3c4c-4ffc-87d7-c33e69761bdf admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:39.285250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9118e11c-3c4c-4ffc-87d7-c33e69761bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:39.324583 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:39.366580 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118e11c-3c4c-4ffc-87d7-c33e69761bdf admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:39.372519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf615f3-c532-420a-847e-d7f12ae45500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:39.373224 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf615f3-c532-420a-847e-d7f12ae45500 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:39.374070 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf615f3-c532-420a-847e-d7f12ae45500 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:39.374070 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf615f3-c532-420a-847e-d7f12ae45500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:39.396003 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf615f3-c532-420a-847e-d7f12ae45500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:39.398636 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf615f3-c532-420a-847e-d7f12ae45500 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:39.416602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1147/2304] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:59:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:59:39.889477 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8efd53-aaba-4e55-8955-dc374e869a62 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:39.891068 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-cb8efd53-aaba-4e55-8955-dc374e869a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:39.906362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8efd53-aaba-4e55-8955-dc374e869a62 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:39.915279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ebb30-33a6-431d-84de-24399db52d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:39.915279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ebb30-33a6-431d-84de-24399db52d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:39.915279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ebb30-33a6-431d-84de-24399db52d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:39.915279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ebb30-33a6-431d-84de-24399db52d22 admin admin] PATH_INFO: `/v3/projects/bf4dc7203ec24a3b9752fc2f105464e8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:39.915838 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ebb30-33a6-431d-84de-24399db52d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf4dc7203ec24a3b9752fc2f105464e8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:39.916546 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ebb30-33a6-431d-84de-24399db52d22 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:40.039693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-045ebb30-33a6-431d-84de-24399db52d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf4dc7203ec24a3b9752fc2f105464e8', 'request_id': 'req-045ebb30-33a6-431d-84de-24399db52d22'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:40.046660 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-045ebb30-33a6-431d-84de-24399db52d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf4dc7203ec24a3b9752fc2f105464e8', 'request_id': 'req-045ebb30-33a6-431d-84de-24399db52d22'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:40.050610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:40.121853 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-045ebb30-33a6-431d-84de-24399db52d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf4dc7203ec24a3b9752fc2f105464e8', 'request_id': 'req-045ebb30-33a6-431d-84de-24399db52d22'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:40.135457 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-045ebb30-33a6-431d-84de-24399db52d22 admin admin] The token cache is being invalidate because project bf4dc7203ec24a3b9752fc2f105464e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:59:40.138771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-045ebb30-33a6-431d-84de-24399db52d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:40.138771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-045ebb30-33a6-431d-84de-24399db52d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:40.138771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1158/2305] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:59:39 2022] DELETE /identity/v3/projects/bf4dc7203ec24a3b9752fc2f105464e8 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:40.142426 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf615f3-c532-420a-847e-d7f12ae45500 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:40.153318 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf615f3-c532-420a-847e-d7f12ae45500 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:40.210772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fb5c0-ef82-4352-9e55-6e32d7bc2b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:40.211350 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fb5c0-ef82-4352-9e55-6e32d7bc2b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:40.211630 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fb5c0-ef82-4352-9e55-6e32d7bc2b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:40.211904 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fb5c0-ef82-4352-9e55-6e32d7bc2b87 admin admin] PATH_INFO: `/v3/users/6dd40a19cf8448de8f2398c0059d4428` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:40.213041 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fb5c0-ef82-4352-9e55-6e32d7bc2b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dd40a19cf8448de8f2398c0059d4428)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:40.214990 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fb5c0-ef82-4352-9e55-6e32d7bc2b87 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:40.367412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-952fb5c0-ef82-4352-9e55-6e32d7bc2b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dd40a19cf8448de8f2398c0059d4428'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:40.430084 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-952fb5c0-ef82-4352-9e55-6e32d7bc2b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dd40a19cf8448de8f2398c0059d4428'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:40.430730 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-952fb5c0-ef82-4352-9e55-6e32d7bc2b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dd40a19cf8448de8f2398c0059d4428'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:40.431338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-952fb5c0-ef82-4352-9e55-6e32d7bc2b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dd40a19cf8448de8f2398c0059d4428'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:40.439309 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-952fb5c0-ef82-4352-9e55-6e32d7bc2b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dd40a19cf8448de8f2398c0059d4428'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:40.458678 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1148/2306] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:59:40 2022] DELETE /identity/v3/users/6dd40a19cf8448de8f2398c0059d4428 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:41.020404 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ebb30-33a6-431d-84de-24399db52d22 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:41.021840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-045ebb30-33a6-431d-84de-24399db52d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:41.037786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ebb30-33a6-431d-84de-24399db52d22 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:41.102136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf9e00-e682-4feb-b233-e39031a65998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:41.102976 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf9e00-e682-4feb-b233-e39031a65998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:41.103617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf9e00-e682-4feb-b233-e39031a65998 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:41.103756 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf9e00-e682-4feb-b233-e39031a65998 admin admin] PATH_INFO: `/v3/projects/326e9a841dcd47b69d7d9ec61686ca13` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:41.105143 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf9e00-e682-4feb-b233-e39031a65998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=326e9a841dcd47b69d7d9ec61686ca13)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:41.107088 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf9e00-e682-4feb-b233-e39031a65998 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:41.243121 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-2cbf9e00-e682-4feb-b233-e39031a65998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '326e9a841dcd47b69d7d9ec61686ca13', 'request_id': 'req-2cbf9e00-e682-4feb-b233-e39031a65998'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:41.249308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-2cbf9e00-e682-4feb-b233-e39031a65998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '326e9a841dcd47b69d7d9ec61686ca13', 'request_id': 'req-2cbf9e00-e682-4feb-b233-e39031a65998'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:41.327195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-2cbf9e00-e682-4feb-b233-e39031a65998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '326e9a841dcd47b69d7d9ec61686ca13', 'request_id': 'req-2cbf9e00-e682-4feb-b233-e39031a65998'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:41.338407 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-2cbf9e00-e682-4feb-b233-e39031a65998 admin admin] The token cache is being invalidate because project 326e9a841dcd47b69d7d9ec61686ca13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:59:41.338729 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-2cbf9e00-e682-4feb-b233-e39031a65998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:41.339361 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-2cbf9e00-e682-4feb-b233-e39031a65998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:41.342909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1159/2307] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:59:41 2022] DELETE /identity/v3/projects/326e9a841dcd47b69d7d9ec61686ca13 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:41.348688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390411c5-3d84-44a3-8859-d06f2f9d105b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:41.349156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390411c5-3d84-44a3-8859-d06f2f9d105b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:41.349249 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390411c5-3d84-44a3-8859-d06f2f9d105b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:41.369472 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-390411c5-3d84-44a3-8859-d06f2f9d105b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:41.370689 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-390411c5-3d84-44a3-8859-d06f2f9d105b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:41.409724 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:41.429447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1149/2308] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:41.437010 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f050b-a23d-4aff-8b9b-ba05e2890ecc None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:41.437299 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f050b-a23d-4aff-8b9b-ba05e2890ecc None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:41.437576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f050b-a23d-4aff-8b9b-ba05e2890ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:41.458207 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-f64f050b-a23d-4aff-8b9b-ba05e2890ecc None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:41.459422 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f64f050b-a23d-4aff-8b9b-ba05e2890ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:41.468448 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1160/2309] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:41.473874 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390411c5-3d84-44a3-8859-d06f2f9d105b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:41.484678 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390411c5-3d84-44a3-8859-d06f2f9d105b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:41.489560 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a33d3-2930-4dd5-afd1-277b92ef6668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:41.490201 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a33d3-2930-4dd5-afd1-277b92ef6668 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:41.490499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a33d3-2930-4dd5-afd1-277b92ef6668 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:41.490823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a33d3-2930-4dd5-afd1-277b92ef6668 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:41.491559 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a33d3-2930-4dd5-afd1-277b92ef6668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:59:41.491865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a33d3-2930-4dd5-afd1-277b92ef6668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:41.493555 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a33d3-2930-4dd5-afd1-277b92ef6668 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:41.505708 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1150/2310] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:59:41.510167 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f050b-a23d-4aff-8b9b-ba05e2890ecc None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:41.519566 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f050b-a23d-4aff-8b9b-ba05e2890ecc None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:41.524773 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4cfbd-e0c6-4c9e-98af-bc9c1de98d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:41.525367 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4cfbd-e0c6-4c9e-98af-bc9c1de98d32 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:41.525646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4cfbd-e0c6-4c9e-98af-bc9c1de98d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:41.527061 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4cfbd-e0c6-4c9e-98af-bc9c1de98d32 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:41.527061 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4cfbd-e0c6-4c9e-98af-bc9c1de98d32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:41.528491 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4cfbd-e0c6-4c9e-98af-bc9c1de98d32 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:41.607195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1161/2311] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:59:41 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:59:41.608330 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a33d3-2930-4dd5-afd1-277b92ef6668 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:41.618737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a33d3-2930-4dd5-afd1-277b92ef6668 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:41.674529 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfdede-1947-4ab3-8b22-8d40db4ffedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:41.675136 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfdede-1947-4ab3-8b22-8d40db4ffedd admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:41.675444 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfdede-1947-4ab3-8b22-8d40db4ffedd admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:41.675723 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfdede-1947-4ab3-8b22-8d40db4ffedd admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:41.676403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfdede-1947-4ab3-8b22-8d40db4ffedd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:41.678374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfdede-1947-4ab3-8b22-8d40db4ffedd admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:41.762608 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1151/2312] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:59:41 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:59:41.763785 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4cfbd-e0c6-4c9e-98af-bc9c1de98d32 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:41.775005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4cfbd-e0c6-4c9e-98af-bc9c1de98d32 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:41.779640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48640e7c-8525-417c-b8bf-cc9ee69fe1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:41.780245 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48640e7c-8525-417c-b8bf-cc9ee69fe1bd admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:41.780553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48640e7c-8525-417c-b8bf-cc9ee69fe1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:41.780827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48640e7c-8525-417c-b8bf-cc9ee69fe1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:41.781471 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48640e7c-8525-417c-b8bf-cc9ee69fe1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:41.783178 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48640e7c-8525-417c-b8bf-cc9ee69fe1bd admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:41.796100 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1162/2313] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:59:41.800215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfdede-1947-4ab3-8b22-8d40db4ffedd admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:41.811173 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfdede-1947-4ab3-8b22-8d40db4ffedd admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:41.816133 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c5dc0-b410-4b48-87e8-af0e63e7f13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:41.817373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5dc0-b410-4b48-87e8-af0e63e7f13c admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:41.817653 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5dc0-b410-4b48-87e8-af0e63e7f13c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:41.817926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5dc0-b410-4b48-87e8-af0e63e7f13c admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:41.818570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c5dc0-b410-4b48-87e8-af0e63e7f13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:41.820211 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c5dc0-b410-4b48-87e8-af0e63e7f13c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:41.832058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1152/2314] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:59:41.836628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48640e7c-8525-417c-b8bf-cc9ee69fe1bd admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:41.846352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48640e7c-8525-417c-b8bf-cc9ee69fe1bd admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:41.851075 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cf4eb-0bbf-4d30-85cd-2c95f0d26feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:41.851717 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cf4eb-0bbf-4d30-85cd-2c95f0d26feb admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:41.853229 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cf4eb-0bbf-4d30-85cd-2c95f0d26feb admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:41.853229 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cf4eb-0bbf-4d30-85cd-2c95f0d26feb admin admin] PATH_INFO: `/v3/projects/735b453c39174397805ef51f55c931a6/users/1aaaecf8f48d459abdfc6b8a7fb59408/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:41.867690 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cf4eb-0bbf-4d30-85cd-2c95f0d26feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=735b453c39174397805ef51f55c931a6, user_id=1aaaecf8f48d459abdfc6b8a7fb59408, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:41.870571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cf4eb-0bbf-4d30-85cd-2c95f0d26feb admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:41.921830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1163/2315] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:59:41 2022] PUT /identity/v3/projects/735b453c39174397805ef51f55c931a6/users/1aaaecf8f48d459abdfc6b8a7fb59408/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:41.933839 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df386c-c31b-4b86-98e8-056973f051e3 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:41.933839 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df386c-c31b-4b86-98e8-056973f051e3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:41.933839 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df386c-c31b-4b86-98e8-056973f051e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:41.970124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-42df386c-c31b-4b86-98e8-056973f051e3 None None] MFA Rules not processed for user `1aaaecf8f48d459abdfc6b8a7fb59408`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:41.971429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-42df386c-c31b-4b86-98e8-056973f051e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:42.023330 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cf4eb-0bbf-4d30-85cd-2c95f0d26feb admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:42.025301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f50cf4eb-0bbf-4d30-85cd-2c95f0d26feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:42.040580 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1153/2316] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:42.043991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:42.045362 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df386c-c31b-4b86-98e8-056973f051e3 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:42.094879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:42.096028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cf4eb-0bbf-4d30-85cd-2c95f0d26feb admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:42.100839 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b500fb-c25a-455c-b17e-d753f24180ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:42.101472 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b500fb-c25a-455c-b17e-d753f24180ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:42.101751 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b500fb-c25a-455c-b17e-d753f24180ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:42.102040 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b500fb-c25a-455c-b17e-d753f24180ba admin admin] PATH_INFO: `/v3/users/b90f42f4ff17423a9e9306738a98f3a8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:42.103297 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b500fb-c25a-455c-b17e-d753f24180ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b90f42f4ff17423a9e9306738a98f3a8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:42.105427 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b500fb-c25a-455c-b17e-d753f24180ba admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:42.114544 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df386c-c31b-4b86-98e8-056973f051e3 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:42.119414 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668069b-38ce-4479-89cc-5dfc4995c1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:42.120023 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668069b-38ce-4479-89cc-5dfc4995c1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:42.120300 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668069b-38ce-4479-89cc-5dfc4995c1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:42.120602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668069b-38ce-4479-89cc-5dfc4995c1b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:42.121231 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668069b-38ce-4479-89cc-5dfc4995c1b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:42.123193 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668069b-38ce-4479-89cc-5dfc4995c1b3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:42.217977 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1154/2317] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:59:42 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:59:42.224677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668069b-38ce-4479-89cc-5dfc4995c1b3 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:42.282884 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668069b-38ce-4479-89cc-5dfc4995c1b3 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:42.287747 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa59f2-10d5-46f0-a8e3-8759644ff0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:42.288355 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa59f2-10d5-46f0-a8e3-8759644ff0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:42.288663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa59f2-10d5-46f0-a8e3-8759644ff0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:42.296696 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa59f2-10d5-46f0-a8e3-8759644ff0c6 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:42.296696 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa59f2-10d5-46f0-a8e3-8759644ff0c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:42.297047 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-81b500fb-c25a-455c-b17e-d753f24180ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b90f42f4ff17423a9e9306738a98f3a8'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:42.297163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa59f2-10d5-46f0-a8e3-8759644ff0c6 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:42.372866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-81b500fb-c25a-455c-b17e-d753f24180ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b90f42f4ff17423a9e9306738a98f3a8'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:42.373513 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-81b500fb-c25a-455c-b17e-d753f24180ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b90f42f4ff17423a9e9306738a98f3a8'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:42.394045 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-81b500fb-c25a-455c-b17e-d753f24180ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b90f42f4ff17423a9e9306738a98f3a8'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:42.394804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-81b500fb-c25a-455c-b17e-d753f24180ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b90f42f4ff17423a9e9306738a98f3a8'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:42.402115 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1155/2318] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:59:42 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:59:42.406035 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa59f2-10d5-46f0-a8e3-8759644ff0c6 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:42.407825 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5ffa59f2-10d5-46f0-a8e3-8759644ff0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:42.410455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1164/2319] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:59:42 2022] DELETE /identity/v3/users/b90f42f4ff17423a9e9306738a98f3a8 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:59:42.414501 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4342b78-fc0c-4919-9c5f-acf7d9ee7e8e None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:42.414791 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4342b78-fc0c-4919-9c5f-acf7d9ee7e8e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:42.415071 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4342b78-fc0c-4919-9c5f-acf7d9ee7e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:42.420094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa59f2-10d5-46f0-a8e3-8759644ff0c6 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:42.436285 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-d4342b78-fc0c-4919-9c5f-acf7d9ee7e8e None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:42.437607 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d4342b78-fc0c-4919-9c5f-acf7d9ee7e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:42.493147 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d149a18-4c4c-4399-961e-d8899da5e301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:42.493781 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d149a18-4c4c-4399-961e-d8899da5e301 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:42.494085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d149a18-4c4c-4399-961e-d8899da5e301 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:42.494412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d149a18-4c4c-4399-961e-d8899da5e301 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:42.495091 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d149a18-4c4c-4399-961e-d8899da5e301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:42.496759 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d149a18-4c4c-4399-961e-d8899da5e301 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:42.500503 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1165/2320] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:59:42.509263 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1156/2321] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:59:42.511299 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4342b78-fc0c-4919-9c5f-acf7d9ee7e8e None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:42.512766 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d4342b78-fc0c-4919-9c5f-acf7d9ee7e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:42.517699 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d149a18-4c4c-4399-961e-d8899da5e301 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:42.528788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d149a18-4c4c-4399-961e-d8899da5e301 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:42.540962 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec6b66-eee0-4776-b3e2-812eb0f1840f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:42.543593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec6b66-eee0-4776-b3e2-812eb0f1840f admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:42.543593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec6b66-eee0-4776-b3e2-812eb0f1840f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:42.543593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec6b66-eee0-4776-b3e2-812eb0f1840f admin admin] PATH_INFO: `/v3/projects/3f9ab4778a464848b2d4143fb3ab32ce/users/7e7d6d582dd44e55ac114935f62b08a3/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:42.553788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:42.565225 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec6b66-eee0-4776-b3e2-812eb0f1840f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9ab4778a464848b2d4143fb3ab32ce, user_id=7e7d6d582dd44e55ac114935f62b08a3, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:42.570136 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec6b66-eee0-4776-b3e2-812eb0f1840f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:42.580609 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4342b78-fc0c-4919-9c5f-acf7d9ee7e8e None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:42.584415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9b276-e7e6-4b84-a952-c05650e70574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:42.585126 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9b276-e7e6-4b84-a952-c05650e70574 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:42.585478 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9b276-e7e6-4b84-a952-c05650e70574 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:42.585819 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9b276-e7e6-4b84-a952-c05650e70574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:42.599229 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9b276-e7e6-4b84-a952-c05650e70574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:42.600834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9b276-e7e6-4b84-a952-c05650e70574 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:42.610967 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1166/2322] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:59:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:59:42.637745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1157/2323] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:59:42 2022] PUT /identity/v3/projects/3f9ab4778a464848b2d4143fb3ab32ce/users/7e7d6d582dd44e55ac114935f62b08a3/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:59:42.641483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9b276-e7e6-4b84-a952-c05650e70574 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:42.654676 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9b276-e7e6-4b84-a952-c05650e70574 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:42.735164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7a876-b21c-4afb-953d-2730645b4723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:42.735801 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7a876-b21c-4afb-953d-2730645b4723 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:42.736082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7a876-b21c-4afb-953d-2730645b4723 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:42.736356 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7a876-b21c-4afb-953d-2730645b4723 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:42.737034 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7a876-b21c-4afb-953d-2730645b4723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:42.739457 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7a876-b21c-4afb-953d-2730645b4723 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:42.751412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1167/2324] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:59:42.755190 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec6b66-eee0-4776-b3e2-812eb0f1840f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:42.766206 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec6b66-eee0-4776-b3e2-812eb0f1840f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:42.770944 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164d145-574a-4c8b-8f5d-e792a34e5e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:42.771532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164d145-574a-4c8b-8f5d-e792a34e5e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:42.772019 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164d145-574a-4c8b-8f5d-e792a34e5e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:42.772377 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164d145-574a-4c8b-8f5d-e792a34e5e90 admin admin] PATH_INFO: `/v3/projects/3f9ab4778a464848b2d4143fb3ab32ce/users/7e7d6d582dd44e55ac114935f62b08a3/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:42.774351 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164d145-574a-4c8b-8f5d-e792a34e5e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9ab4778a464848b2d4143fb3ab32ce, user_id=7e7d6d582dd44e55ac114935f62b08a3, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:42.777160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164d145-574a-4c8b-8f5d-e792a34e5e90 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:42.790117 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1158/2325] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:59:42 2022] PUT /identity/v3/projects/3f9ab4778a464848b2d4143fb3ab32ce/users/7e7d6d582dd44e55ac114935f62b08a3/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:59:42.800626 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eace2-15ae-42cb-a567-38a1df8283b7 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:42.802137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eace2-15ae-42cb-a567-38a1df8283b7 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:42.802414 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eace2-15ae-42cb-a567-38a1df8283b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:42.841691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-919eace2-15ae-42cb-a567-38a1df8283b7 None None] MFA Rules not processed for user `7e7d6d582dd44e55ac114935f62b08a3`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:42.844224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-919eace2-15ae-42cb-a567-38a1df8283b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:42.963309 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1168/2326] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:42.972101 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164d145-574a-4c8b-8f5d-e792a34e5e90 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:42.975364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5164d145-574a-4c8b-8f5d-e792a34e5e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:43.015920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:43.090810 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164d145-574a-4c8b-8f5d-e792a34e5e90 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:43.099364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d9a48-ee61-4ae6-92b0-4c46c06ed715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:43.100012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d9a48-ee61-4ae6-92b0-4c46c06ed715 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:43.100292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d9a48-ee61-4ae6-92b0-4c46c06ed715 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:43.100591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d9a48-ee61-4ae6-92b0-4c46c06ed715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:43.113342 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d9a48-ee61-4ae6-92b0-4c46c06ed715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:43.114966 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d9a48-ee61-4ae6-92b0-4c46c06ed715 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:43.130436 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1159/2327] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:59:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:59:43.428354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eace2-15ae-42cb-a567-38a1df8283b7 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:43.429949 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-919eace2-15ae-42cb-a567-38a1df8283b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:43.521183 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:43.525117 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eace2-15ae-42cb-a567-38a1df8283b7 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:43.530325 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620d85c-0fc9-48e3-9ffc-082651206fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:43.531161 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620d85c-0fc9-48e3-9ffc-082651206fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:43.531390 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620d85c-0fc9-48e3-9ffc-082651206fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:43.531878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620d85c-0fc9-48e3-9ffc-082651206fa2 admin admin] PATH_INFO: `/v3/projects/2c0dbc1cd2944053b1af39d468d2bdb3` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:43.533087 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620d85c-0fc9-48e3-9ffc-082651206fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c0dbc1cd2944053b1af39d468d2bdb3)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:43.535350 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620d85c-0fc9-48e3-9ffc-082651206fa2 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:43.681806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b620d85c-0fc9-48e3-9ffc-082651206fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c0dbc1cd2944053b1af39d468d2bdb3', 'request_id': 'req-b620d85c-0fc9-48e3-9ffc-082651206fa2'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:43.692606 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b620d85c-0fc9-48e3-9ffc-082651206fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c0dbc1cd2944053b1af39d468d2bdb3', 'request_id': 'req-b620d85c-0fc9-48e3-9ffc-082651206fa2'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:43.757544 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b620d85c-0fc9-48e3-9ffc-082651206fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c0dbc1cd2944053b1af39d468d2bdb3', 'request_id': 'req-b620d85c-0fc9-48e3-9ffc-082651206fa2'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:43.779362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b620d85c-0fc9-48e3-9ffc-082651206fa2 admin admin] The token cache is being invalidate because project 2c0dbc1cd2944053b1af39d468d2bdb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:59:43.780621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b620d85c-0fc9-48e3-9ffc-082651206fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:43.781876 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b620d85c-0fc9-48e3-9ffc-082651206fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:43.785697 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1169/2328] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:59:43 2022] DELETE /identity/v3/projects/2c0dbc1cd2944053b1af39d468d2bdb3 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:43.789015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d9a48-ee61-4ae6-92b0-4c46c06ed715 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:43.791238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be61ff-e342-441a-96d8-ad04ff6081db None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:43.791238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be61ff-e342-441a-96d8-ad04ff6081db None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:43.791238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be61ff-e342-441a-96d8-ad04ff6081db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:43.811390 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d9a48-ee61-4ae6-92b0-4c46c06ed715 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:43.833831 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-a2be61ff-e342-441a-96d8-ad04ff6081db None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:43.835279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-a2be61ff-e342-441a-96d8-ad04ff6081db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:43.902096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e45e3-5b2b-413c-aef1-23220acc9f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:43.902856 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e45e3-5b2b-413c-aef1-23220acc9f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:43.903177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e45e3-5b2b-413c-aef1-23220acc9f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:43.903456 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e45e3-5b2b-413c-aef1-23220acc9f74 admin admin] PATH_INFO: `/v3/users/1aaaecf8f48d459abdfc6b8a7fb59408` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:43.907440 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e45e3-5b2b-413c-aef1-23220acc9f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aaaecf8f48d459abdfc6b8a7fb59408)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:43.909785 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e45e3-5b2b-413c-aef1-23220acc9f74 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:43.928811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1170/2329] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:59:43.941015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a541e3-c307-4d3e-929a-fc6d1185455b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:43.941309 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a541e3-c307-4d3e-929a-fc6d1185455b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:43.943340 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a541e3-c307-4d3e-929a-fc6d1185455b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:43.965793 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-f2a541e3-c307-4d3e-929a-fc6d1185455b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:43.972700 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f2a541e3-c307-4d3e-929a-fc6d1185455b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:43.981213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1171/2330] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:43.985608 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a541e3-c307-4d3e-929a-fc6d1185455b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:43.995794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a541e3-c307-4d3e-929a-fc6d1185455b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:44.003342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5950e63-20fa-486e-af26-a18fce1bc927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:44.004625 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5950e63-20fa-486e-af26-a18fce1bc927 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:44.004915 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5950e63-20fa-486e-af26-a18fce1bc927 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:44.005245 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5950e63-20fa-486e-af26-a18fce1bc927 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:44.009872 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5950e63-20fa-486e-af26-a18fce1bc927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:59:44.010400 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5950e63-20fa-486e-af26-a18fce1bc927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:44.013127 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5950e63-20fa-486e-af26-a18fce1bc927 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:44.033101 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1172/2331] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 22:59:44.034587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5950e63-20fa-486e-af26-a18fce1bc927 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:44.047418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5950e63-20fa-486e-af26-a18fce1bc927 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:44.052965 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b08a2-248f-44fb-9086-b0b700cc304e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:44.053727 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b08a2-248f-44fb-9086-b0b700cc304e admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:44.054081 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b08a2-248f-44fb-9086-b0b700cc304e admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:44.054423 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b08a2-248f-44fb-9086-b0b700cc304e admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:44.055132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b08a2-248f-44fb-9086-b0b700cc304e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:44.057163 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b08a2-248f-44fb-9086-b0b700cc304e admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:44.119804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5d0e45e3-5b2b-413c-aef1-23220acc9f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aaaecf8f48d459abdfc6b8a7fb59408'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:44.192183 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1173/2332] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:59:44 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:59:44.206635 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b08a2-248f-44fb-9086-b0b700cc304e admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:44.215344 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5d0e45e3-5b2b-413c-aef1-23220acc9f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aaaecf8f48d459abdfc6b8a7fb59408'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:44.217282 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5d0e45e3-5b2b-413c-aef1-23220acc9f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aaaecf8f48d459abdfc6b8a7fb59408'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:44.218094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5d0e45e3-5b2b-413c-aef1-23220acc9f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aaaecf8f48d459abdfc6b8a7fb59408'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:44.230430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5d0e45e3-5b2b-413c-aef1-23220acc9f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aaaecf8f48d459abdfc6b8a7fb59408'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:44.263677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1160/2333] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:59:43 2022] DELETE /identity/v3/users/1aaaecf8f48d459abdfc6b8a7fb59408 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:44.269239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26800d-ae2f-4110-920c-dac5849f7a04 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:44.269770 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26800d-ae2f-4110-920c-dac5849f7a04 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:44.270144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26800d-ae2f-4110-920c-dac5849f7a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:44.313207 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2d26800d-ae2f-4110-920c-dac5849f7a04 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:44.314461 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2d26800d-ae2f-4110-920c-dac5849f7a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:44.316568 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:44.343028 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b08a2-248f-44fb-9086-b0b700cc304e admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:44.373777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:44.424086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1161/2334] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:59:44.434557 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26800d-ae2f-4110-920c-dac5849f7a04 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:44.437627 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2d26800d-ae2f-4110-920c-dac5849f7a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:44.468280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76170ad3-c6d6-4b92-af17-30ea5dd529c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:44.475594 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76170ad3-c6d6-4b92-af17-30ea5dd529c4 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:44.475594 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76170ad3-c6d6-4b92-af17-30ea5dd529c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:44.475594 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76170ad3-c6d6-4b92-af17-30ea5dd529c4 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:44.475594 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76170ad3-c6d6-4b92-af17-30ea5dd529c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:44.476040 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76170ad3-c6d6-4b92-af17-30ea5dd529c4 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:44.534757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26800d-ae2f-4110-920c-dac5849f7a04 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:44.541465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8cbfd-3a06-458e-b6f0-787baa621a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:44.542440 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8cbfd-3a06-458e-b6f0-787baa621a8e service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:44.542949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8cbfd-3a06-458e-b6f0-787baa621a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:44.543399 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8cbfd-3a06-458e-b6f0-787baa621a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:44.557468 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8cbfd-3a06-458e-b6f0-787baa621a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:44.559998 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8cbfd-3a06-458e-b6f0-787baa621a8e service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:44.578897 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1162/2335] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:59:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:59:44.584033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42b9f0-07ce-45ae-9ec6-67beb64ad7e3 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:44.584394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42b9f0-07ce-45ae-9ec6-67beb64ad7e3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:44.584780 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42b9f0-07ce-45ae-9ec6-67beb64ad7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:44.608355 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-1d42b9f0-07ce-45ae-9ec6-67beb64ad7e3 None None] MFA Rules not processed for user `95ce2e4f8df34404ad587edc9bc8af05`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:44.609603 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1d42b9f0-07ce-45ae-9ec6-67beb64ad7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:44.683699 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1163/2336] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:44.746354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1174/2337] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:59:44 2022] POST /identity/v3/users => generated 287 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:59:44.753903 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42b9f0-07ce-45ae-9ec6-67beb64ad7e3 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:44.755326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1d42b9f0-07ce-45ae-9ec6-67beb64ad7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:44.770254 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42b9f0-07ce-45ae-9ec6-67beb64ad7e3 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:44.775299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4fbe8-57a5-45f4-9ca9-63453cda3331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:44.775916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4fbe8-57a5-45f4-9ca9-63453cda3331 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:44.776248 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4fbe8-57a5-45f4-9ca9-63453cda3331 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:44.776551 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4fbe8-57a5-45f4-9ca9-63453cda3331 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:44.777194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4fbe8-57a5-45f4-9ca9-63453cda3331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:44.779002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4fbe8-57a5-45f4-9ca9-63453cda3331 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:44.793138 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1164/2338] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:59:44.796705 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76170ad3-c6d6-4b92-af17-30ea5dd529c4 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:44.808302 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76170ad3-c6d6-4b92-af17-30ea5dd529c4 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:44.814856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9778a-60b0-4686-b820-32cf54d9772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:44.815862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9778a-60b0-4686-b820-32cf54d9772a admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:44.817338 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9778a-60b0-4686-b820-32cf54d9772a admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:44.817705 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9778a-60b0-4686-b820-32cf54d9772a admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:44.818419 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9778a-60b0-4686-b820-32cf54d9772a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:44.820551 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9778a-60b0-4686-b820-32cf54d9772a admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:44.834098 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1175/2339] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:59:44.838257 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4fbe8-57a5-45f4-9ca9-63453cda3331 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:44.848857 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4fbe8-57a5-45f4-9ca9-63453cda3331 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:44.854154 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe3515-e0da-4413-96ba-4ca8dd457942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:44.854957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe3515-e0da-4413-96ba-4ca8dd457942 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:44.855216 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe3515-e0da-4413-96ba-4ca8dd457942 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:44.856087 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe3515-e0da-4413-96ba-4ca8dd457942 admin admin] PATH_INFO: `/v3/projects/02d2e8d47a504e1e98e4bd3870ab337d/users/bf5c2fcd827d46c69018a50421438cbc/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:44.879780 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe3515-e0da-4413-96ba-4ca8dd457942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d2e8d47a504e1e98e4bd3870ab337d, user_id=bf5c2fcd827d46c69018a50421438cbc, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:44.882541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe3515-e0da-4413-96ba-4ca8dd457942 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:44.946239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1165/2340] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:59:44 2022] PUT /identity/v3/projects/02d2e8d47a504e1e98e4bd3870ab337d/users/bf5c2fcd827d46c69018a50421438cbc/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:59:44.951390 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99974357-51d7-4459-a5b5-66033793c024 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:44.951678 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99974357-51d7-4459-a5b5-66033793c024 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:44.951999 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99974357-51d7-4459-a5b5-66033793c024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:44.972942 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-99974357-51d7-4459-a5b5-66033793c024 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:44.974141 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-99974357-51d7-4459-a5b5-66033793c024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:45.013624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe3515-e0da-4413-96ba-4ca8dd457942 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:45.015364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e0fe3515-e0da-4413-96ba-4ca8dd457942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:45.056168 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1176/2341] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:45.067506 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99974357-51d7-4459-a5b5-66033793c024 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:45.096472 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:45.116406 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe3515-e0da-4413-96ba-4ca8dd457942 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:45.121730 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceec870-1f02-4d19-a398-88f6b9b15a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:45.122418 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceec870-1f02-4d19-a398-88f6b9b15a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:45.122697 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceec870-1f02-4d19-a398-88f6b9b15a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:45.122978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceec870-1f02-4d19-a398-88f6b9b15a9d admin admin] PATH_INFO: `/v3/projects/735b453c39174397805ef51f55c931a6` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:45.124251 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceec870-1f02-4d19-a398-88f6b9b15a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=735b453c39174397805ef51f55c931a6)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:45.126150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceec870-1f02-4d19-a398-88f6b9b15a9d admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:45.129372 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99974357-51d7-4459-a5b5-66033793c024 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:45.133991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5f5f2-ec63-4383-b7f4-25bc84d80b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:45.134620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5f5f2-ec63-4383-b7f4-25bc84d80b92 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:45.134899 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5f5f2-ec63-4383-b7f4-25bc84d80b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:45.135185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5f5f2-ec63-4383-b7f4-25bc84d80b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:45.146801 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5f5f2-ec63-4383-b7f4-25bc84d80b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:45.148239 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5f5f2-ec63-4383-b7f4-25bc84d80b92 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:45.159865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1177/2342] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:59:45.230061 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6ceec870-1f02-4d19-a398-88f6b9b15a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735b453c39174397805ef51f55c931a6', 'request_id': 'req-6ceec870-1f02-4d19-a398-88f6b9b15a9d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:45.236332 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6ceec870-1f02-4d19-a398-88f6b9b15a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735b453c39174397805ef51f55c931a6', 'request_id': 'req-6ceec870-1f02-4d19-a398-88f6b9b15a9d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:45.340461 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6ceec870-1f02-4d19-a398-88f6b9b15a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735b453c39174397805ef51f55c931a6', 'request_id': 'req-6ceec870-1f02-4d19-a398-88f6b9b15a9d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:45.361704 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6ceec870-1f02-4d19-a398-88f6b9b15a9d admin admin] The token cache is being invalidate because project 735b453c39174397805ef51f55c931a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:59:45.362141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6ceec870-1f02-4d19-a398-88f6b9b15a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:45.362902 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-6ceec870-1f02-4d19-a398-88f6b9b15a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:45.365302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1166/2343] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:59:45 2022] DELETE /identity/v3/projects/735b453c39174397805ef51f55c931a6 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:59:45.370906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5f5f2-ec63-4383-b7f4-25bc84d80b92 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:45.381712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5f5f2-ec63-4383-b7f4-25bc84d80b92 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:45.394643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:45.448221 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8342288-1b02-4091-b860-78ceb403e785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:45.448927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8342288-1b02-4091-b860-78ceb403e785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:45.449206 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8342288-1b02-4091-b860-78ceb403e785 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:45.449671 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8342288-1b02-4091-b860-78ceb403e785 admin admin] PATH_INFO: `/v3/users/7e7d6d582dd44e55ac114935f62b08a3` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:45.451271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8342288-1b02-4091-b860-78ceb403e785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e7d6d582dd44e55ac114935f62b08a3)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:45.453961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8342288-1b02-4091-b860-78ceb403e785 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:45.720862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-a8342288-1b02-4091-b860-78ceb403e785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e7d6d582dd44e55ac114935f62b08a3'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:45.803202 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-a8342288-1b02-4091-b860-78ceb403e785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e7d6d582dd44e55ac114935f62b08a3'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:45.804172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-a8342288-1b02-4091-b860-78ceb403e785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e7d6d582dd44e55ac114935f62b08a3'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:45.835073 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-a8342288-1b02-4091-b860-78ceb403e785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e7d6d582dd44e55ac114935f62b08a3'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:45.836273 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-a8342288-1b02-4091-b860-78ceb403e785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e7d6d582dd44e55ac114935f62b08a3'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:45.851172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1178/2344] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 22:59:45 2022] DELETE /identity/v3/users/7e7d6d582dd44e55ac114935f62b08a3 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:46.621182 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceec870-1f02-4d19-a398-88f6b9b15a9d admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:46.623220 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6ceec870-1f02-4d19-a398-88f6b9b15a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:46.639367 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceec870-1f02-4d19-a398-88f6b9b15a9d admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:46.751889 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c811efe-621a-48ab-9613-21d9beb9ccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:46.752851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c811efe-621a-48ab-9613-21d9beb9ccd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:46.753128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c811efe-621a-48ab-9613-21d9beb9ccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:46.753399 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c811efe-621a-48ab-9613-21d9beb9ccd1 admin admin] PATH_INFO: `/v3/projects/3f9ab4778a464848b2d4143fb3ab32ce` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:46.758302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c811efe-621a-48ab-9613-21d9beb9ccd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f9ab4778a464848b2d4143fb3ab32ce)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:46.758302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c811efe-621a-48ab-9613-21d9beb9ccd1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:46.926464 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8c811efe-621a-48ab-9613-21d9beb9ccd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f9ab4778a464848b2d4143fb3ab32ce', 'request_id': 'req-8c811efe-621a-48ab-9613-21d9beb9ccd1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:46.945468 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8c811efe-621a-48ab-9613-21d9beb9ccd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f9ab4778a464848b2d4143fb3ab32ce', 'request_id': 'req-8c811efe-621a-48ab-9613-21d9beb9ccd1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:47.025299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8c811efe-621a-48ab-9613-21d9beb9ccd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f9ab4778a464848b2d4143fb3ab32ce', 'request_id': 'req-8c811efe-621a-48ab-9613-21d9beb9ccd1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:47.043405 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8c811efe-621a-48ab-9613-21d9beb9ccd1 admin admin] The token cache is being invalidate because project 3f9ab4778a464848b2d4143fb3ab32ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 22:59:47.043798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8c811efe-621a-48ab-9613-21d9beb9ccd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:47.044866 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8c811efe-621a-48ab-9613-21d9beb9ccd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 22:59:47.049765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1167/2345] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 22:59:46 2022] DELETE /identity/v3/projects/3f9ab4778a464848b2d4143fb3ab32ce => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:47.054144 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98321415-43d8-49a3-9c3d-f9cff28b5b8d None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:47.054594 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98321415-43d8-49a3-9c3d-f9cff28b5b8d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:47.054789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98321415-43d8-49a3-9c3d-f9cff28b5b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:47.083012 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-98321415-43d8-49a3-9c3d-f9cff28b5b8d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:47.084641 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-98321415-43d8-49a3-9c3d-f9cff28b5b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:47.165374 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1179/2346] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:47.167116 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d3098-242b-478e-95c8-7be16df4f979 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:47.167531 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d3098-242b-478e-95c8-7be16df4f979 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:47.168272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d3098-242b-478e-95c8-7be16df4f979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:47.208794 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-404d3098-242b-478e-95c8-7be16df4f979 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:47.210283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-404d3098-242b-478e-95c8-7be16df4f979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:47.226682 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1168/2347] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 22:59:47.228241 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98321415-43d8-49a3-9c3d-f9cff28b5b8d None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:47.240260 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98321415-43d8-49a3-9c3d-f9cff28b5b8d None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:47.245929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39022b7-4494-4774-b621-e50dede84ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:47.246750 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39022b7-4494-4774-b621-e50dede84ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:47.247498 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39022b7-4494-4774-b621-e50dede84ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:47.247930 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39022b7-4494-4774-b621-e50dede84ed3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:47.248800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39022b7-4494-4774-b621-e50dede84ed3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 22:59:47.249449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39022b7-4494-4774-b621-e50dede84ed3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:47.251274 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39022b7-4494-4774-b621-e50dede84ed3 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:47.273665 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1180/2348] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 22:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 22:59:47.275556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d3098-242b-478e-95c8-7be16df4f979 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:47.286263 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:47.293963 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d3098-242b-478e-95c8-7be16df4f979 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:47.303351 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b02cc-0fa6-4e5f-b415-8536701de872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:47.304691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b02cc-0fa6-4e5f-b415-8536701de872 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:47.305272 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b02cc-0fa6-4e5f-b415-8536701de872 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:47.305662 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b02cc-0fa6-4e5f-b415-8536701de872 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:47.307028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b02cc-0fa6-4e5f-b415-8536701de872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:47.311293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b02cc-0fa6-4e5f-b415-8536701de872 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:47.411684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1169/2349] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:59:47 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:59:47.424915 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39022b7-4494-4774-b621-e50dede84ed3 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:47.431640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39022b7-4494-4774-b621-e50dede84ed3 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:47.466539 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:47.507991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f8e82-b75a-4716-a158-28cacbac9720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:47.508832 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f8e82-b75a-4716-a158-28cacbac9720 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:47.509190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f8e82-b75a-4716-a158-28cacbac9720 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:47.509543 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f8e82-b75a-4716-a158-28cacbac9720 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:47.510255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f8e82-b75a-4716-a158-28cacbac9720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:47.512303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f8e82-b75a-4716-a158-28cacbac9720 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:47.628168 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1181/2350] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:59:47 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:59:47.632449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b02cc-0fa6-4e5f-b415-8536701de872 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:47.652718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b02cc-0fa6-4e5f-b415-8536701de872 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:47.657607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d548d7c-3f6f-41ee-8c8d-b47d69918b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:47.658226 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d548d7c-3f6f-41ee-8c8d-b47d69918b4c admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:47.658506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d548d7c-3f6f-41ee-8c8d-b47d69918b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:47.660797 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d548d7c-3f6f-41ee-8c8d-b47d69918b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:47.661481 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d548d7c-3f6f-41ee-8c8d-b47d69918b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:47.663113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d548d7c-3f6f-41ee-8c8d-b47d69918b4c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:47.678486 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1170/2351] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:59:47.689701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f8e82-b75a-4716-a158-28cacbac9720 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:47.711113 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f8e82-b75a-4716-a158-28cacbac9720 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:47.733147 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66673dd4-22f6-4334-902f-d93e584f08c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:47.736143 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66673dd4-22f6-4334-902f-d93e584f08c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:47.740824 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66673dd4-22f6-4334-902f-d93e584f08c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:47.741279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66673dd4-22f6-4334-902f-d93e584f08c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:47.747021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66673dd4-22f6-4334-902f-d93e584f08c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:47.753147 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66673dd4-22f6-4334-902f-d93e584f08c7 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:47.786750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d548d7c-3f6f-41ee-8c8d-b47d69918b4c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:47.787222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1182/2352] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:59:47.798084 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d548d7c-3f6f-41ee-8c8d-b47d69918b4c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:47.803333 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d617b91-9040-4cbe-8fb0-95596368157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:47.804462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d617b91-9040-4cbe-8fb0-95596368157a admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:47.804943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d617b91-9040-4cbe-8fb0-95596368157a admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:47.805227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d617b91-9040-4cbe-8fb0-95596368157a admin admin] PATH_INFO: `/v3/projects/7360ada818da47f9835f253c5df4da68/users/64ca3596c93c4629aed6e73704ef72e3/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:47.834114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d617b91-9040-4cbe-8fb0-95596368157a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7360ada818da47f9835f253c5df4da68, user_id=64ca3596c93c4629aed6e73704ef72e3, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:47.839360 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d617b91-9040-4cbe-8fb0-95596368157a admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:47.934349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1171/2353] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:59:47 2022] PUT /identity/v3/projects/7360ada818da47f9835f253c5df4da68/users/64ca3596c93c4629aed6e73704ef72e3/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:59:47.946736 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a9d9a-cb5a-463b-a4c9-be013fc114af None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:47.947031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a9d9a-cb5a-463b-a4c9-be013fc114af None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:47.947364 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a9d9a-cb5a-463b-a4c9-be013fc114af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:47.979908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-012a9d9a-cb5a-463b-a4c9-be013fc114af None None] MFA Rules not processed for user `64ca3596c93c4629aed6e73704ef72e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:47.981304 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-012a9d9a-cb5a-463b-a4c9-be013fc114af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:48.060617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1183/2354] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:48.071531 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d617b91-9040-4cbe-8fb0-95596368157a admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:48.181681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d617b91-9040-4cbe-8fb0-95596368157a admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:48.187401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2873d0f-1605-4410-9aa7-21f1dad8fb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:48.188060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2873d0f-1605-4410-9aa7-21f1dad8fb1d admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:48.188347 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2873d0f-1605-4410-9aa7-21f1dad8fb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:48.188656 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2873d0f-1605-4410-9aa7-21f1dad8fb1d admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:48.189293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2873d0f-1605-4410-9aa7-21f1dad8fb1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:48.192222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2873d0f-1605-4410-9aa7-21f1dad8fb1d admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:48.274936 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1172/2355] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:59:48 2022] POST /identity/v3/projects => generated 383 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:59:48.279011 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a9d9a-cb5a-463b-a4c9-be013fc114af None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:48.290673 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a9d9a-cb5a-463b-a4c9-be013fc114af None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:48.379731 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4002cbe-a2d6-49c0-b32c-4944dd246d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:48.380616 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4002cbe-a2d6-49c0-b32c-4944dd246d50 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:48.381255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4002cbe-a2d6-49c0-b32c-4944dd246d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:48.381671 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4002cbe-a2d6-49c0-b32c-4944dd246d50 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:48.382382 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4002cbe-a2d6-49c0-b32c-4944dd246d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:48.385852 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4002cbe-a2d6-49c0-b32c-4944dd246d50 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:48.549686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2873d0f-1605-4410-9aa7-21f1dad8fb1d admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:48.563180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1184/2356] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:59:48 2022] POST /identity/v3/users => generated 292 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:59:48.575152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2873d0f-1605-4410-9aa7-21f1dad8fb1d admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:48.609200 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b3dee-0154-4fd7-9d4c-40a8287eb188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:48.609651 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b3dee-0154-4fd7-9d4c-40a8287eb188 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:48.610046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b3dee-0154-4fd7-9d4c-40a8287eb188 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:48.610524 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b3dee-0154-4fd7-9d4c-40a8287eb188 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:48.611753 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b3dee-0154-4fd7-9d4c-40a8287eb188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:48.613564 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b3dee-0154-4fd7-9d4c-40a8287eb188 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:48.646710 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1173/2357] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:59:48.650387 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4002cbe-a2d6-49c0-b32c-4944dd246d50 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:48.663188 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4002cbe-a2d6-49c0-b32c-4944dd246d50 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:48.668658 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1ddf1-b566-4bc1-b8e0-36abcd0ce3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:48.669379 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1ddf1-b566-4bc1-b8e0-36abcd0ce3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:48.669732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1ddf1-b566-4bc1-b8e0-36abcd0ce3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:48.670078 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1ddf1-b566-4bc1-b8e0-36abcd0ce3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:48.670799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1ddf1-b566-4bc1-b8e0-36abcd0ce3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:48.673309 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1ddf1-b566-4bc1-b8e0-36abcd0ce3a8 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:48.687773 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1185/2358] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:59:48.701423 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b3dee-0154-4fd7-9d4c-40a8287eb188 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:48.719185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b3dee-0154-4fd7-9d4c-40a8287eb188 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:48.729495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67cd14-83b1-4fb6-ab39-e894d18c4075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:48.730304 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67cd14-83b1-4fb6-ab39-e894d18c4075 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:48.730651 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67cd14-83b1-4fb6-ab39-e894d18c4075 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:48.731035 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67cd14-83b1-4fb6-ab39-e894d18c4075 admin admin] PATH_INFO: `/v3/projects/241b853243b2415b9c92017ef8f29b88/users/e2644c367a26428faaf719748aef3018/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:48.768512 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67cd14-83b1-4fb6-ab39-e894d18c4075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=241b853243b2415b9c92017ef8f29b88, user_id=e2644c367a26428faaf719748aef3018, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:48.768512 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67cd14-83b1-4fb6-ab39-e894d18c4075 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:48.843101 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1174/2359] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:59:48 2022] PUT /identity/v3/projects/241b853243b2415b9c92017ef8f29b88/users/e2644c367a26428faaf719748aef3018/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:48.854827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412deeff-7bf5-4a55-97fa-ecfe244702b6 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:48.855258 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412deeff-7bf5-4a55-97fa-ecfe244702b6 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:48.855548 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412deeff-7bf5-4a55-97fa-ecfe244702b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:48.899155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-412deeff-7bf5-4a55-97fa-ecfe244702b6 None None] MFA Rules not processed for user `e2644c367a26428faaf719748aef3018`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:48.900444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-412deeff-7bf5-4a55-97fa-ecfe244702b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:48.994157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1186/2360] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:48.998417 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67cd14-83b1-4fb6-ab39-e894d18c4075 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:49.014992 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:49.103544 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:49.109230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67cd14-83b1-4fb6-ab39-e894d18c4075 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:49.115505 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa099a-0314-43f8-bbcb-b438f999517c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:49.116140 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa099a-0314-43f8-bbcb-b438f999517c admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:49.116989 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa099a-0314-43f8-bbcb-b438f999517c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:49.116989 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa099a-0314-43f8-bbcb-b438f999517c admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:49.117533 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa099a-0314-43f8-bbcb-b438f999517c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:49.119506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa099a-0314-43f8-bbcb-b438f999517c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:49.219718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1175/2361] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:59:48 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:59:49.220765 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412deeff-7bf5-4a55-97fa-ecfe244702b6 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:49.269939 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412deeff-7bf5-4a55-97fa-ecfe244702b6 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:49.460965 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce89f7-e9d7-4887-8753-d70a4a0341e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:49.461617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce89f7-e9d7-4887-8753-d70a4a0341e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:49.461906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce89f7-e9d7-4887-8753-d70a4a0341e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:49.462228 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce89f7-e9d7-4887-8753-d70a4a0341e7 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:49.463282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce89f7-e9d7-4887-8753-d70a4a0341e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:49.467402 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce89f7-e9d7-4887-8753-d70a4a0341e7 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:49.574309 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1187/2362] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:59:49 2022] POST /identity/v3/users => generated 299 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:59:49.578626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa099a-0314-43f8-bbcb-b438f999517c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:49.588957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa099a-0314-43f8-bbcb-b438f999517c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:49.596762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d20a4-8d8a-40ca-85a0-ba2c3f15efc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:49.598063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d20a4-8d8a-40ca-85a0-ba2c3f15efc7 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:49.598352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d20a4-8d8a-40ca-85a0-ba2c3f15efc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:49.598626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d20a4-8d8a-40ca-85a0-ba2c3f15efc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:49.599299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d20a4-8d8a-40ca-85a0-ba2c3f15efc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:49.600935 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d20a4-8d8a-40ca-85a0-ba2c3f15efc7 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:49.611434 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1176/2363] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:59:49.616235 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce89f7-e9d7-4887-8753-d70a4a0341e7 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:49.627157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce89f7-e9d7-4887-8753-d70a4a0341e7 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:49.631907 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698d945-b694-401a-847a-c228c8c0ee23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:49.635478 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698d945-b694-401a-847a-c228c8c0ee23 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:49.635478 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698d945-b694-401a-847a-c228c8c0ee23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:49.635478 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698d945-b694-401a-847a-c228c8c0ee23 admin admin] PATH_INFO: `/v3/projects/722f68f796fe4a72aeac8a71f7167827/users/7595e3e8f5f144b29250bd89e4507c3a/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:49.651282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698d945-b694-401a-847a-c228c8c0ee23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=722f68f796fe4a72aeac8a71f7167827, user_id=7595e3e8f5f144b29250bd89e4507c3a, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:49.654363 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698d945-b694-401a-847a-c228c8c0ee23 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:49.721406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1188/2364] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:59:49 2022] PUT /identity/v3/projects/722f68f796fe4a72aeac8a71f7167827/users/7595e3e8f5f144b29250bd89e4507c3a/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:59:49.727479 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d20a4-8d8a-40ca-85a0-ba2c3f15efc7 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:49.741233 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d20a4-8d8a-40ca-85a0-ba2c3f15efc7 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:49.805864 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489e6dd-830f-42b0-9d23-f6ea19e33f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:49.806459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489e6dd-830f-42b0-9d23-f6ea19e33f0b admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:49.806743 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489e6dd-830f-42b0-9d23-f6ea19e33f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:49.807040 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489e6dd-830f-42b0-9d23-f6ea19e33f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:49.807688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489e6dd-830f-42b0-9d23-f6ea19e33f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:49.809334 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489e6dd-830f-42b0-9d23-f6ea19e33f0b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:49.837120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1177/2365] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:59:49.842346 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698d945-b694-401a-847a-c228c8c0ee23 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:49.856630 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698d945-b694-401a-847a-c228c8c0ee23 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:49.863025 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7394a-da34-46ad-95c5-33e338598b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:49.863704 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7394a-da34-46ad-95c5-33e338598b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:49.864030 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7394a-da34-46ad-95c5-33e338598b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:49.864240 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7394a-da34-46ad-95c5-33e338598b41 admin admin] PATH_INFO: `/v3/projects/722f68f796fe4a72aeac8a71f7167827/users/7595e3e8f5f144b29250bd89e4507c3a/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:49.866569 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7394a-da34-46ad-95c5-33e338598b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=722f68f796fe4a72aeac8a71f7167827, user_id=7595e3e8f5f144b29250bd89e4507c3a, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:49.870918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7394a-da34-46ad-95c5-33e338598b41 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:49.884412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1189/2366] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:59:49 2022] PUT /identity/v3/projects/722f68f796fe4a72aeac8a71f7167827/users/7595e3e8f5f144b29250bd89e4507c3a/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:49.898763 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daf31d-d5df-477a-a3e3-a0c0b150862b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:49.899115 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daf31d-d5df-477a-a3e3-a0c0b150862b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:49.899399 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daf31d-d5df-477a-a3e3-a0c0b150862b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:49.933327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-38daf31d-d5df-477a-a3e3-a0c0b150862b None None] MFA Rules not processed for user `7595e3e8f5f144b29250bd89e4507c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:49.934646 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-38daf31d-d5df-477a-a3e3-a0c0b150862b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:50.132025 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1178/2367] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:50.139840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7394a-da34-46ad-95c5-33e338598b41 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:50.142847 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-cad7394a-da34-46ad-95c5-33e338598b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:50.254257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7394a-da34-46ad-95c5-33e338598b41 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:50.259781 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067538bc-45a2-4047-b295-917fa351d499 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:50.260623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067538bc-45a2-4047-b295-917fa351d499 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:50.261057 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067538bc-45a2-4047-b295-917fa351d499 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:50.261481 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067538bc-45a2-4047-b295-917fa351d499 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:50.272104 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:50.343808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067538bc-45a2-4047-b295-917fa351d499 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:50.346264 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067538bc-45a2-4047-b295-917fa351d499 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:50.358760 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1190/2368] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:59:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:59:52.314898 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b66c7-d20c-496f-84b1-b8e1c47caaef None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:52.315510 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b66c7-d20c-496f-84b1-b8e1c47caaef None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:52.315510 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b66c7-d20c-496f-84b1-b8e1c47caaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:52.511915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d79b66c7-d20c-496f-84b1-b8e1c47caaef None None] MFA Rules not processed for user `bf5c2fcd827d46c69018a50421438cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:52.511915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d79b66c7-d20c-496f-84b1-b8e1c47caaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:52.511915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:52.511915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1179/2369] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:52.513280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067538bc-45a2-4047-b295-917fa351d499 service cinder] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:52.513280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-067538bc-45a2-4047-b295-917fa351d499 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:52.707856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067538bc-45a2-4047-b295-917fa351d499 service cinder] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:52.707856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccbc2d-e198-4275-9fbc-b308ef75ece1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:52.707856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccbc2d-e198-4275-9fbc-b308ef75ece1 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:52.707856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccbc2d-e198-4275-9fbc-b308ef75ece1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:52.709254 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccbc2d-e198-4275-9fbc-b308ef75ece1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:52.709254 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccbc2d-e198-4275-9fbc-b308ef75ece1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:52.709254 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccbc2d-e198-4275-9fbc-b308ef75ece1 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:53.272196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1191/2370] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 22:59:52 2022] POST /identity/v3/projects => generated 373 bytes in 771 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 22:59:53.280895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b66c7-d20c-496f-84b1-b8e1c47caaef None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:53.287674 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b66c7-d20c-496f-84b1-b8e1c47caaef None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:53.346922 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e85e04-53f2-4be8-9ace-c535d5474931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:53.347548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e85e04-53f2-4be8-9ace-c535d5474931 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:53.347819 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e85e04-53f2-4be8-9ace-c535d5474931 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:53.348095 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e85e04-53f2-4be8-9ace-c535d5474931 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:53.348823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e85e04-53f2-4be8-9ace-c535d5474931 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:53.350833 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e85e04-53f2-4be8-9ace-c535d5474931 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:53.491013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1180/2371] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 22:59:53 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 22:59:53.494737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccbc2d-e198-4275-9fbc-b308ef75ece1 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:53.507154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccbc2d-e198-4275-9fbc-b308ef75ece1 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:53.513101 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29582758-1450-474e-9b2b-c9442587aa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:53.515386 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29582758-1450-474e-9b2b-c9442587aa73 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:53.515979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29582758-1450-474e-9b2b-c9442587aa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:53.516130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29582758-1450-474e-9b2b-c9442587aa73 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:53.516972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29582758-1450-474e-9b2b-c9442587aa73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:53.519105 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29582758-1450-474e-9b2b-c9442587aa73 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:53.532020 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1192/2372] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 22:59:53.539302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e85e04-53f2-4be8-9ace-c535d5474931 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:53.547797 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e85e04-53f2-4be8-9ace-c535d5474931 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:53.563464 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e408d95-a3aa-4461-a587-b4ecd6f7ca23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:53.563464 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e408d95-a3aa-4461-a587-b4ecd6f7ca23 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:53.563464 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e408d95-a3aa-4461-a587-b4ecd6f7ca23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:53.563464 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e408d95-a3aa-4461-a587-b4ecd6f7ca23 admin admin] PATH_INFO: `/v3/projects/003cbe279e594b068e2c5b334b3e9996/users/f927ce9c091d466cbf24b3b90d548868/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:53.580289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e408d95-a3aa-4461-a587-b4ecd6f7ca23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=003cbe279e594b068e2c5b334b3e9996, user_id=f927ce9c091d466cbf24b3b90d548868, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:53.583521 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e408d95-a3aa-4461-a587-b4ecd6f7ca23 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:53.706182 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1181/2373] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:59:53 2022] PUT /identity/v3/projects/003cbe279e594b068e2c5b334b3e9996/users/f927ce9c091d466cbf24b3b90d548868/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 22:59:53.710136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29582758-1450-474e-9b2b-c9442587aa73 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:53.726496 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29582758-1450-474e-9b2b-c9442587aa73 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:53.798655 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e408d95-a3aa-4461-a587-b4ecd6f7ca23 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:53.798655 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6e408d95-a3aa-4461-a587-b4ecd6f7ca23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:53.901374 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c8cf6-41b0-46bc-a639-b9ce2631d837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:53.903385 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c8cf6-41b0-46bc-a639-b9ce2631d837 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:53.903918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c8cf6-41b0-46bc-a639-b9ce2631d837 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:53.904641 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c8cf6-41b0-46bc-a639-b9ce2631d837 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:53.906629 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c8cf6-41b0-46bc-a639-b9ce2631d837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:53.918432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c8cf6-41b0-46bc-a639-b9ce2631d837 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:53.936927 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e408d95-a3aa-4461-a587-b4ecd6f7ca23 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:53.982710 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdaf6d9-9364-4f4c-995d-5b7bcb372d87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:53.982710 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdaf6d9-9364-4f4c-995d-5b7bcb372d87 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:53.982710 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdaf6d9-9364-4f4c-995d-5b7bcb372d87 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:53.983016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1193/2374] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 22:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 22:59:53.983131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdaf6d9-9364-4f4c-995d-5b7bcb372d87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:53.983524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c8cf6-41b0-46bc-a639-b9ce2631d837 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:54.030550 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c8cf6-41b0-46bc-a639-b9ce2631d837 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:54.054638 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44c110-7ed1-49ca-beb6-3a01ca7b68c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:54.055326 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44c110-7ed1-49ca-beb6-3a01ca7b68c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:54.057699 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44c110-7ed1-49ca-beb6-3a01ca7b68c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:54.058197 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44c110-7ed1-49ca-beb6-3a01ca7b68c4 admin admin] PATH_INFO: `/v3/projects/003cbe279e594b068e2c5b334b3e9996/users/f927ce9c091d466cbf24b3b90d548868/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:54.063770 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44c110-7ed1-49ca-beb6-3a01ca7b68c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=003cbe279e594b068e2c5b334b3e9996, user_id=f927ce9c091d466cbf24b3b90d548868, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:54.067298 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44c110-7ed1-49ca-beb6-3a01ca7b68c4 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:54.109317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1194/2375] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 22:59:53 2022] PUT /identity/v3/projects/003cbe279e594b068e2c5b334b3e9996/users/f927ce9c091d466cbf24b3b90d548868/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 22:59:54.164053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdaf6d9-9364-4f4c-995d-5b7bcb372d87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:54.166124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdaf6d9-9364-4f4c-995d-5b7bcb372d87 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:54.180802 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1182/2376] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:59:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 22:59:54.499618 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:56.242890 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44c110-7ed1-49ca-beb6-3a01ca7b68c4 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:56.249200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:59:56.323141 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44c110-7ed1-49ca-beb6-3a01ca7b68c4 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:56.328053 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f34a2b-46bc-44fc-af55-23c7481ad6e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:56.328701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f34a2b-46bc-44fc-af55-23c7481ad6e7 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:56.328961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f34a2b-46bc-44fc-af55-23c7481ad6e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:56.329235 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f34a2b-46bc-44fc-af55-23c7481ad6e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:56.363532 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52014fb3-cf77-4a21-b34d-ad6079a3b25b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:56.364033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52014fb3-cf77-4a21-b34d-ad6079a3b25b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:56.364214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52014fb3-cf77-4a21-b34d-ad6079a3b25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:56.392131 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-52014fb3-cf77-4a21-b34d-ad6079a3b25b None None] MFA Rules not processed for user `06d2f860bd3c4f5b955ff1671f7ce517`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 22:59:56.393959 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-52014fb3-cf77-4a21-b34d-ad6079a3b25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:56.403483 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f34a2b-46bc-44fc-af55-23c7481ad6e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:56.405836 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f34a2b-46bc-44fc-af55-23c7481ad6e7 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:56.417743 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1195/2377] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:59:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 22:59:56.476926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1183/2378] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 22:59:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 22:59:58.908938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f34a2b-46bc-44fc-af55-23c7481ad6e7 service cinder] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 22:59:58.910775 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c1f34a2b-46bc-44fc-af55-23c7481ad6e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:58.980868 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f34a2b-46bc-44fc-af55-23c7481ad6e7 service cinder] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 22:59:58.985415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574c4c7-9897-4293-a3e9-9e585bd18869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 22:59:58.986238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574c4c7-9897-4293-a3e9-9e585bd18869 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 22:59:58.986719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574c4c7-9897-4293-a3e9-9e585bd18869 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 22:59:58.987689 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574c4c7-9897-4293-a3e9-9e585bd18869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 22:59:58.989638 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-5574c4c7-9897-4293-a3e9-9e585bd18869 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 22:59:59.073877 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574c4c7-9897-4293-a3e9-9e585bd18869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 22:59:59.075889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574c4c7-9897-4293-a3e9-9e585bd18869 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 22:59:59.097159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1196/2379] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 22:59:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:00:02.646310 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52014fb3-cf77-4a21-b34d-ad6079a3b25b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:02.777149 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52014fb3-cf77-4a21-b34d-ad6079a3b25b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:02.793637 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c070c41-3315-4fbc-b94b-08d139f8d7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:02.794300 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c070c41-3315-4fbc-b94b-08d139f8d7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:02.794780 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c070c41-3315-4fbc-b94b-08d139f8d7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:02.795369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c070c41-3315-4fbc-b94b-08d139f8d7e3 admin admin] PATH_INFO: `/v3/users/64ca3596c93c4629aed6e73704ef72e3` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:02.796794 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c070c41-3315-4fbc-b94b-08d139f8d7e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ca3596c93c4629aed6e73704ef72e3)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:02.798935 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c070c41-3315-4fbc-b94b-08d139f8d7e3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:02.947191 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5090b8-a749-49a3-a6ab-0c7349f90567 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:02.949276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5090b8-a749-49a3-a6ab-0c7349f90567 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:02.949276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5090b8-a749-49a3-a6ab-0c7349f90567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:02.959941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:00:03.000214 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-bc5090b8-a749-49a3-a6ab-0c7349f90567 None None] MFA Rules not processed for user `f927ce9c091d466cbf24b3b90d548868`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:00:03.002047 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-bc5090b8-a749-49a3-a6ab-0c7349f90567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:03.053378 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4c070c41-3315-4fbc-b94b-08d139f8d7e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ca3596c93c4629aed6e73704ef72e3'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:03.138774 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4c070c41-3315-4fbc-b94b-08d139f8d7e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ca3596c93c4629aed6e73704ef72e3'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:03.139016 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4c070c41-3315-4fbc-b94b-08d139f8d7e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ca3596c93c4629aed6e73704ef72e3'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:03.139558 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4c070c41-3315-4fbc-b94b-08d139f8d7e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ca3596c93c4629aed6e73704ef72e3'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:03.161698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4c070c41-3315-4fbc-b94b-08d139f8d7e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ca3596c93c4629aed6e73704ef72e3'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:03.185555 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1184/2380] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:00:02 2022] DELETE /identity/v3/users/64ca3596c93c4629aed6e73704ef72e3 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:00:03.192555 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd8a27-3c3f-4876-a1ca-89d0b6f165cd None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:03.192938 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd8a27-3c3f-4876-a1ca-89d0b6f165cd None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:03.193228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd8a27-3c3f-4876-a1ca-89d0b6f165cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:03.217854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-fafd8a27-3c3f-4876-a1ca-89d0b6f165cd None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:00:03.219150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fafd8a27-3c3f-4876-a1ca-89d0b6f165cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:03.237724 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1197/2381] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:00:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:00:03.240506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:00:03.251294 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5090b8-a749-49a3-a6ab-0c7349f90567 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:03.253737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-bc5090b8-a749-49a3-a6ab-0c7349f90567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:03.292061 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1185/2382] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 23:00:03.303188 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd8a27-3c3f-4876-a1ca-89d0b6f165cd None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:03.304871 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fafd8a27-3c3f-4876-a1ca-89d0b6f165cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:03.389164 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd8a27-3c3f-4876-a1ca-89d0b6f165cd None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:03.398270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f0ac6-0aff-446c-8dbb-5a824c05679e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:03.399801 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f0ac6-0aff-446c-8dbb-5a824c05679e service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:03.400090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f0ac6-0aff-446c-8dbb-5a824c05679e service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:03.400473 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f0ac6-0aff-446c-8dbb-5a824c05679e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:03.416124 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5090b8-a749-49a3-a6ab-0c7349f90567 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:03.450243 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f0ac6-0aff-446c-8dbb-5a824c05679e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:03.451984 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f0ac6-0aff-446c-8dbb-5a824c05679e service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:03.476168 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1186/2383] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:00:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:00:03.538625 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b6f17-a739-4ee9-ba49-215661aaca41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:03.539334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b6f17-a739-4ee9-ba49-215661aaca41 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:03.539678 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b6f17-a739-4ee9-ba49-215661aaca41 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:03.540015 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b6f17-a739-4ee9-ba49-215661aaca41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:03.541815 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-db1b6f17-a739-4ee9-ba49-215661aaca41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:03.566343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:00:03.622305 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b6f17-a739-4ee9-ba49-215661aaca41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:03.624211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b6f17-a739-4ee9-ba49-215661aaca41 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:03.636376 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1198/2384] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:00:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:00:04.515394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f0ac6-0aff-446c-8dbb-5a824c05679e service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:04.517506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-210f0ac6-0aff-446c-8dbb-5a824c05679e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:04.539105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f0ac6-0aff-446c-8dbb-5a824c05679e service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:04.544366 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e255426-7a7b-47b5-9b42-8d4698d6dc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:04.545247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e255426-7a7b-47b5-9b42-8d4698d6dc43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:04.545673 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e255426-7a7b-47b5-9b42-8d4698d6dc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:04.546104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e255426-7a7b-47b5-9b42-8d4698d6dc43 admin admin] PATH_INFO: `/v3/projects/7360ada818da47f9835f253c5df4da68` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:04.547439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e255426-7a7b-47b5-9b42-8d4698d6dc43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7360ada818da47f9835f253c5df4da68)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:04.549721 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e255426-7a7b-47b5-9b42-8d4698d6dc43 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:04.746319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2e255426-7a7b-47b5-9b42-8d4698d6dc43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7360ada818da47f9835f253c5df4da68', 'request_id': 'req-2e255426-7a7b-47b5-9b42-8d4698d6dc43'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:04.756005 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2e255426-7a7b-47b5-9b42-8d4698d6dc43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7360ada818da47f9835f253c5df4da68', 'request_id': 'req-2e255426-7a7b-47b5-9b42-8d4698d6dc43'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:04.840553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2e255426-7a7b-47b5-9b42-8d4698d6dc43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7360ada818da47f9835f253c5df4da68', 'request_id': 'req-2e255426-7a7b-47b5-9b42-8d4698d6dc43'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:04.856692 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2e255426-7a7b-47b5-9b42-8d4698d6dc43 admin admin] The token cache is being invalidate because project 7360ada818da47f9835f253c5df4da68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:00:04.858107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2e255426-7a7b-47b5-9b42-8d4698d6dc43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:04.859747 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2e255426-7a7b-47b5-9b42-8d4698d6dc43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:04.863373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1187/2385] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:00:04 2022] DELETE /identity/v3/projects/7360ada818da47f9835f253c5df4da68 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:00:04.867890 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b6f17-a739-4ee9-ba49-215661aaca41 service nova] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:04.880387 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b6f17-a739-4ee9-ba49-215661aaca41 service nova] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:04.986488 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631ea93-02a4-4a9b-b3ff-0214ca9198c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:04.987752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631ea93-02a4-4a9b-b3ff-0214ca9198c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:04.988053 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631ea93-02a4-4a9b-b3ff-0214ca9198c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:04.988331 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631ea93-02a4-4a9b-b3ff-0214ca9198c5 admin admin] PATH_INFO: `/v3/users/e2644c367a26428faaf719748aef3018` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:04.989569 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631ea93-02a4-4a9b-b3ff-0214ca9198c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2644c367a26428faaf719748aef3018)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:04.991503 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631ea93-02a4-4a9b-b3ff-0214ca9198c5 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:05.231655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b631ea93-02a4-4a9b-b3ff-0214ca9198c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2644c367a26428faaf719748aef3018'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:05.297842 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b631ea93-02a4-4a9b-b3ff-0214ca9198c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2644c367a26428faaf719748aef3018'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:05.298743 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b631ea93-02a4-4a9b-b3ff-0214ca9198c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2644c367a26428faaf719748aef3018'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:05.325695 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b631ea93-02a4-4a9b-b3ff-0214ca9198c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2644c367a26428faaf719748aef3018'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:05.328822 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b631ea93-02a4-4a9b-b3ff-0214ca9198c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2644c367a26428faaf719748aef3018'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:05.350796 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1199/2386] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:00:04 2022] DELETE /identity/v3/users/e2644c367a26428faaf719748aef3018 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 23:00:05.930592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e255426-7a7b-47b5-9b42-8d4698d6dc43 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:05.932829 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2e255426-7a7b-47b5-9b42-8d4698d6dc43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:05.947001 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e255426-7a7b-47b5-9b42-8d4698d6dc43 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:06.074373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:00:06.089571 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95bdc5-cb3a-445f-9676-edc87c264151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:06.093179 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95bdc5-cb3a-445f-9676-edc87c264151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:06.093467 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95bdc5-cb3a-445f-9676-edc87c264151 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:06.093939 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95bdc5-cb3a-445f-9676-edc87c264151 admin admin] PATH_INFO: `/v3/projects/241b853243b2415b9c92017ef8f29b88` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:06.096025 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95bdc5-cb3a-445f-9676-edc87c264151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=241b853243b2415b9c92017ef8f29b88)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:06.098494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95bdc5-cb3a-445f-9676-edc87c264151 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:06.267357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8f95bdc5-cb3a-445f-9676-edc87c264151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '241b853243b2415b9c92017ef8f29b88', 'request_id': 'req-8f95bdc5-cb3a-445f-9676-edc87c264151'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:06.280826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8f95bdc5-cb3a-445f-9676-edc87c264151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '241b853243b2415b9c92017ef8f29b88', 'request_id': 'req-8f95bdc5-cb3a-445f-9676-edc87c264151'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:06.343940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8f95bdc5-cb3a-445f-9676-edc87c264151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '241b853243b2415b9c92017ef8f29b88', 'request_id': 'req-8f95bdc5-cb3a-445f-9676-edc87c264151'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:06.370910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8f95bdc5-cb3a-445f-9676-edc87c264151 admin admin] The token cache is being invalidate because project 241b853243b2415b9c92017ef8f29b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:00:06.371619 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8f95bdc5-cb3a-445f-9676-edc87c264151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:06.376642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8f95bdc5-cb3a-445f-9676-edc87c264151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:06.376642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1188/2387] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:00:05 2022] DELETE /identity/v3/projects/241b853243b2415b9c92017ef8f29b88 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:00:06.379917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631ea93-02a4-4a9b-b3ff-0214ca9198c5 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:06.381905 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b631ea93-02a4-4a9b-b3ff-0214ca9198c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:06.408151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631ea93-02a4-4a9b-b3ff-0214ca9198c5 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:06.489926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:00:06.518539 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd466b76-b2b4-400c-9cee-ca6412515bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:06.519563 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd466b76-b2b4-400c-9cee-ca6412515bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:06.520840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd466b76-b2b4-400c-9cee-ca6412515bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:06.521201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd466b76-b2b4-400c-9cee-ca6412515bf2 admin admin] PATH_INFO: `/v3/users/7595e3e8f5f144b29250bd89e4507c3a` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:06.523557 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd466b76-b2b4-400c-9cee-ca6412515bf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7595e3e8f5f144b29250bd89e4507c3a)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:06.526304 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd466b76-b2b4-400c-9cee-ca6412515bf2 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:06.794366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-bd466b76-b2b4-400c-9cee-ca6412515bf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7595e3e8f5f144b29250bd89e4507c3a'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:06.903888 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-bd466b76-b2b4-400c-9cee-ca6412515bf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7595e3e8f5f144b29250bd89e4507c3a'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:06.904628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-bd466b76-b2b4-400c-9cee-ca6412515bf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7595e3e8f5f144b29250bd89e4507c3a'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:06.923457 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-bd466b76-b2b4-400c-9cee-ca6412515bf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7595e3e8f5f144b29250bd89e4507c3a'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:06.925938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-bd466b76-b2b4-400c-9cee-ca6412515bf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7595e3e8f5f144b29250bd89e4507c3a'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:06.943334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1200/2388] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:00:06 2022] DELETE /identity/v3/users/7595e3e8f5f144b29250bd89e4507c3a => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 23:00:08.171842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95bdc5-cb3a-445f-9676-edc87c264151 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:08.173611 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8f95bdc5-cb3a-445f-9676-edc87c264151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:08.199456 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95bdc5-cb3a-445f-9676-edc87c264151 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:08.328923 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c395d52-8b8d-43e6-b258-6eb313145b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:08.329648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c395d52-8b8d-43e6-b258-6eb313145b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:08.330028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c395d52-8b8d-43e6-b258-6eb313145b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:08.330348 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c395d52-8b8d-43e6-b258-6eb313145b6a admin admin] PATH_INFO: `/v3/projects/722f68f796fe4a72aeac8a71f7167827` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:08.331496 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c395d52-8b8d-43e6-b258-6eb313145b6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=722f68f796fe4a72aeac8a71f7167827)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:08.333517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c395d52-8b8d-43e6-b258-6eb313145b6a admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:08.462744 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850d937-d633-48b4-8120-410bc86d97ac None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:08.463282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850d937-d633-48b4-8120-410bc86d97ac None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:08.463282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850d937-d633-48b4-8120-410bc86d97ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:08.502424 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7c395d52-8b8d-43e6-b258-6eb313145b6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '722f68f796fe4a72aeac8a71f7167827', 'request_id': 'req-7c395d52-8b8d-43e6-b258-6eb313145b6a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:08.505833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-f850d937-d633-48b4-8120-410bc86d97ac None None] MFA Rules not processed for user `bf5c2fcd827d46c69018a50421438cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:00:08.507117 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f850d937-d633-48b4-8120-410bc86d97ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:08.511209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7c395d52-8b8d-43e6-b258-6eb313145b6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '722f68f796fe4a72aeac8a71f7167827', 'request_id': 'req-7c395d52-8b8d-43e6-b258-6eb313145b6a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:08.591579 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1201/2389] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:00:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:00:08.610596 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7c395d52-8b8d-43e6-b258-6eb313145b6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '722f68f796fe4a72aeac8a71f7167827', 'request_id': 'req-7c395d52-8b8d-43e6-b258-6eb313145b6a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:08.628485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7c395d52-8b8d-43e6-b258-6eb313145b6a admin admin] The token cache is being invalidate because project 722f68f796fe4a72aeac8a71f7167827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:00:08.628784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7c395d52-8b8d-43e6-b258-6eb313145b6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:08.629465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7c395d52-8b8d-43e6-b258-6eb313145b6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:08.636184 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1189/2390] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:00:08 2022] DELETE /identity/v3/projects/722f68f796fe4a72aeac8a71f7167827 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:00:08.637959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a43eb-0a8e-4f1e-87b7-e6ac0eccbd3f None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:08.638415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a43eb-0a8e-4f1e-87b7-e6ac0eccbd3f None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:08.639598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a43eb-0a8e-4f1e-87b7-e6ac0eccbd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:08.666898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-d14a43eb-0a8e-4f1e-87b7-e6ac0eccbd3f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:00:08.668184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d14a43eb-0a8e-4f1e-87b7-e6ac0eccbd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:08.735125 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1202/2391] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:00:08.742733 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182b39d-316c-4495-9637-aa6e65c8d44d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:08.747286 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182b39d-316c-4495-9637-aa6e65c8d44d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:08.747286 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182b39d-316c-4495-9637-aa6e65c8d44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:08.764193 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2182b39d-316c-4495-9637-aa6e65c8d44d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:00:08.766105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2182b39d-316c-4495-9637-aa6e65c8d44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:08.775657 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1190/2392] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:00:08.785568 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a43eb-0a8e-4f1e-87b7-e6ac0eccbd3f None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:08.795361 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a43eb-0a8e-4f1e-87b7-e6ac0eccbd3f None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:08.799940 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8eb90-0cb4-494b-bd3e-9e3ca63c2de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:08.800571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8eb90-0cb4-494b-bd3e-9e3ca63c2de4 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:08.801190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8eb90-0cb4-494b-bd3e-9e3ca63c2de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:08.801190 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8eb90-0cb4-494b-bd3e-9e3ca63c2de4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:08.801748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8eb90-0cb4-494b-bd3e-9e3ca63c2de4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:00:08.802047 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8eb90-0cb4-494b-bd3e-9e3ca63c2de4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:08.803635 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8eb90-0cb4-494b-bd3e-9e3ca63c2de4 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:08.805728 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:00:08.816919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1203/2393] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 23:00:08.821328 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182b39d-316c-4495-9637-aa6e65c8d44d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:08.826884 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:00:08.831253 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182b39d-316c-4495-9637-aa6e65c8d44d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:08.836095 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27373d84-a392-41ca-80f3-69239313a5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:08.836806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27373d84-a392-41ca-80f3-69239313a5ed admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:08.837156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27373d84-a392-41ca-80f3-69239313a5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:08.837501 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27373d84-a392-41ca-80f3-69239313a5ed admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:08.838147 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27373d84-a392-41ca-80f3-69239313a5ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:08.840079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27373d84-a392-41ca-80f3-69239313a5ed admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:08.952321 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1191/2394] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:00:08 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:00:08.957630 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8eb90-0cb4-494b-bd3e-9e3ca63c2de4 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:08.985253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8eb90-0cb4-494b-bd3e-9e3ca63c2de4 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:09.088268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33384dde-40e3-4dee-949f-86067de3cea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:09.088268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33384dde-40e3-4dee-949f-86067de3cea2 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:09.088268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33384dde-40e3-4dee-949f-86067de3cea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:09.088268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33384dde-40e3-4dee-949f-86067de3cea2 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:09.089231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33384dde-40e3-4dee-949f-86067de3cea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:09.091571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33384dde-40e3-4dee-949f-86067de3cea2 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:09.206814 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1204/2395] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:00:08 2022] POST /identity/v3/users => generated 292 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 23:00:09.211273 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27373d84-a392-41ca-80f3-69239313a5ed admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:09.222146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27373d84-a392-41ca-80f3-69239313a5ed admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:09.228155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4d407-31f3-4f0b-8c4d-a631ee010e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:09.228808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d407-31f3-4f0b-8c4d-a631ee010e05 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:09.229090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d407-31f3-4f0b-8c4d-a631ee010e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:09.229369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d407-31f3-4f0b-8c4d-a631ee010e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:09.230027 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4d407-31f3-4f0b-8c4d-a631ee010e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:09.232023 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4d407-31f3-4f0b-8c4d-a631ee010e05 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:09.243051 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1192/2396] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:00:09.247697 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33384dde-40e3-4dee-949f-86067de3cea2 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:09.260788 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33384dde-40e3-4dee-949f-86067de3cea2 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:09.268203 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fee3c-0ad3-42fb-8518-2337b07e9769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:09.269039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fee3c-0ad3-42fb-8518-2337b07e9769 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:09.269386 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fee3c-0ad3-42fb-8518-2337b07e9769 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:09.270077 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fee3c-0ad3-42fb-8518-2337b07e9769 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:09.270468 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fee3c-0ad3-42fb-8518-2337b07e9769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:09.272154 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fee3c-0ad3-42fb-8518-2337b07e9769 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:09.284316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1205/2397] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 23:00:09.288549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4d407-31f3-4f0b-8c4d-a631ee010e05 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:09.302979 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4d407-31f3-4f0b-8c4d-a631ee010e05 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:09.307985 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8d3bf-90a8-4a2e-bc89-89826d590e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:09.308767 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8d3bf-90a8-4a2e-bc89-89826d590e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:09.309933 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8d3bf-90a8-4a2e-bc89-89826d590e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:09.309933 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8d3bf-90a8-4a2e-bc89-89826d590e67 admin admin] PATH_INFO: `/v3/projects/ef095b2dde4047598d5b88faebcaa16f/users/4234e3aa1be546d38e88d9b3a887cf33/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:09.337346 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8d3bf-90a8-4a2e-bc89-89826d590e67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef095b2dde4047598d5b88faebcaa16f, user_id=4234e3aa1be546d38e88d9b3a887cf33, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:09.341453 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8d3bf-90a8-4a2e-bc89-89826d590e67 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:09.417449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1193/2398] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:00:09 2022] PUT /identity/v3/projects/ef095b2dde4047598d5b88faebcaa16f/users/4234e3aa1be546d38e88d9b3a887cf33/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:00:09.422686 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fdd42-6468-42b1-904c-e2771b699690 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:09.423004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fdd42-6468-42b1-904c-e2771b699690 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:09.423335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fdd42-6468-42b1-904c-e2771b699690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:09.444184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-9b0fdd42-6468-42b1-904c-e2771b699690 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:00:09.445405 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9b0fdd42-6468-42b1-904c-e2771b699690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:09.525315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1206/2399] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 23:00:09.536775 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8d3bf-90a8-4a2e-bc89-89826d590e67 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:09.538594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5bb8d3bf-90a8-4a2e-bc89-89826d590e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:09.612844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8d3bf-90a8-4a2e-bc89-89826d590e67 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:09.618032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e617935-6ad3-4b46-8007-d031e2ae6929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:09.618032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e617935-6ad3-4b46-8007-d031e2ae6929 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:09.618032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e617935-6ad3-4b46-8007-d031e2ae6929 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:09.618032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e617935-6ad3-4b46-8007-d031e2ae6929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:09.630302 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e617935-6ad3-4b46-8007-d031e2ae6929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:09.632249 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e617935-6ad3-4b46-8007-d031e2ae6929 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:09.647386 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1194/2400] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:00:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 23:00:11.547232 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407e3c3-c883-4628-a085-c2eb85763c0d None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:11.547745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407e3c3-c883-4628-a085-c2eb85763c0d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:11.547976 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407e3c3-c883-4628-a085-c2eb85763c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:11.585883 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-f407e3c3-c883-4628-a085-c2eb85763c0d None None] MFA Rules not processed for user `4234e3aa1be546d38e88d9b3a887cf33`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:00:11.587613 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f407e3c3-c883-4628-a085-c2eb85763c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:11.671354 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ed782-fa42-4633-b3a3-ccf62e9a889b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:11.671921 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ed782-fa42-4633-b3a3-ccf62e9a889b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:11.672205 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ed782-fa42-4633-b3a3-ccf62e9a889b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:11.701022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b28ed782-fa42-4633-b3a3-ccf62e9a889b None None] MFA Rules not processed for user `642d4bef7e9c459a8d2dde636094b528`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:00:11.702919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b28ed782-fa42-4633-b3a3-ccf62e9a889b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:11.722867 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1207/2401] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:00:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:00:11.742130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407e3c3-c883-4628-a085-c2eb85763c0d None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:11.746510 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f407e3c3-c883-4628-a085-c2eb85763c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:11.753971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:00:11.780570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1195/2402] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Sep 6 23:00:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 23:00:11.805484 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ed782-fa42-4633-b3a3-ccf62e9a889b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:11.807073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b28ed782-fa42-4633-b3a3-ccf62e9a889b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:11.809645 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407e3c3-c883-4628-a085-c2eb85763c0d None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:11.814017 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263053e-a40c-4ed1-977e-9ba0628c928d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:11.815518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263053e-a40c-4ed1-977e-9ba0628c928d service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:11.815797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263053e-a40c-4ed1-977e-9ba0628c928d service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:11.820255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263053e-a40c-4ed1-977e-9ba0628c928d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:11.825937 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263053e-a40c-4ed1-977e-9ba0628c928d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:11.827579 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263053e-a40c-4ed1-977e-9ba0628c928d service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:11.841197 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1208/2403] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:00:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 23:00:11.870479 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:00:11.887227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ed782-fa42-4633-b3a3-ccf62e9a889b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:11.893150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb270-566f-4696-8b25-9d0e03cb1794 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660248a90f524a43b143bae127e0eaa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:11.893768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb270-566f-4696-8b25-9d0e03cb1794 service swift] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:11.894049 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb270-566f-4696-8b25-9d0e03cb1794 service swift] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:11.894327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb270-566f-4696-8b25-9d0e03cb1794 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:11.903097 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ceb270-566f-4696-8b25-9d0e03cb1794 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:11.911613 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ceb270-566f-4696-8b25-9d0e03cb1794 service swift] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:11.913517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1196/2404] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Sep 6 23:00:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 23:00:12.833456 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af67d74-0336-45fa-8a5f-4cf1ae156361 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:12.833955 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af67d74-0336-45fa-8a5f-4cf1ae156361 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:12.834144 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af67d74-0336-45fa-8a5f-4cf1ae156361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:12.854936 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-3af67d74-0336-45fa-8a5f-4cf1ae156361 None None] MFA Rules not processed for user `642d4bef7e9c459a8d2dde636094b528`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:00:12.856078 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3af67d74-0336-45fa-8a5f-4cf1ae156361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:12.864520 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1209/2405] 10.222.0.30 () {58 vars in 967 bytes} [Tue Sep 6 23:00:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:00:12.881735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb270-566f-4696-8b25-9d0e03cb1794 service swift] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:12.892922 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb270-566f-4696-8b25-9d0e03cb1794 service swift] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:12.898081 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56b4b1-3cfc-4557-bdce-2d1d0278d946 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660248a90f524a43b143bae127e0eaa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:12.898824 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56b4b1-3cfc-4557-bdce-2d1d0278d946 service swift] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:12.899104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56b4b1-3cfc-4557-bdce-2d1d0278d946 service swift] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:12.899381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56b4b1-3cfc-4557-bdce-2d1d0278d946 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:12.908701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56b4b1-3cfc-4557-bdce-2d1d0278d946 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:12.910290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56b4b1-3cfc-4557-bdce-2d1d0278d946 service swift] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:12.926073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1197/2406] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Sep 6 23:00:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 23:00:13.553296 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c6420-5abf-4c93-900f-043079ab4ba3 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:13.553631 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c6420-5abf-4c93-900f-043079ab4ba3 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:13.554221 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c6420-5abf-4c93-900f-043079ab4ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:13.575953 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-2f1c6420-5abf-4c93-900f-043079ab4ba3 None None] MFA Rules not processed for user `642d4bef7e9c459a8d2dde636094b528`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:00:13.577192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-2f1c6420-5abf-4c93-900f-043079ab4ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:13.585674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1210/2407] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Sep 6 23:00:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:00:13.597677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56b4b1-3cfc-4557-bdce-2d1d0278d946 service swift] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:13.608609 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56b4b1-3cfc-4557-bdce-2d1d0278d946 service swift] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:13.613802 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5e72b-bef9-41d9-bb7b-a098804061fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660248a90f524a43b143bae127e0eaa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:13.614392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5e72b-bef9-41d9-bb7b-a098804061fe service swift] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:13.614671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5e72b-bef9-41d9-bb7b-a098804061fe service swift] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:13.614946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5e72b-bef9-41d9-bb7b-a098804061fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:13.622965 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5e72b-bef9-41d9-bb7b-a098804061fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:13.624571 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5e72b-bef9-41d9-bb7b-a098804061fe service swift] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:13.634140 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1198/2408] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Sep 6 23:00:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 23:00:14.283800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acec28-33db-44de-8700-e80dc5b343d0 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:14.284277 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acec28-33db-44de-8700-e80dc5b343d0 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:14.284537 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acec28-33db-44de-8700-e80dc5b343d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:14.304588 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-49acec28-33db-44de-8700-e80dc5b343d0 None None] MFA Rules not processed for user `642d4bef7e9c459a8d2dde636094b528`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:00:14.305739 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-49acec28-33db-44de-8700-e80dc5b343d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:14.312807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1211/2409] 10.222.0.30 () {58 vars in 967 bytes} [Tue Sep 6 23:00:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:00:14.326519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5e72b-bef9-41d9-bb7b-a098804061fe service swift] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:14.338379 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5e72b-bef9-41d9-bb7b-a098804061fe service swift] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:14.343553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c415ea-a092-45cc-bc11-99a92901bb7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660248a90f524a43b143bae127e0eaa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:14.344195 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c415ea-a092-45cc-bc11-99a92901bb7f service swift] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:14.344517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c415ea-a092-45cc-bc11-99a92901bb7f service swift] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:14.344797 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c415ea-a092-45cc-bc11-99a92901bb7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:14.353482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c415ea-a092-45cc-bc11-99a92901bb7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:14.355074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c415ea-a092-45cc-bc11-99a92901bb7f service swift] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:14.363338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1199/2410] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Sep 6 23:00:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 23:00:14.734085 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c807b-f6b5-4c49-a2aa-a5493873d34f None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:14.734787 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c807b-f6b5-4c49-a2aa-a5493873d34f None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:14.735299 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c807b-f6b5-4c49-a2aa-a5493873d34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:14.757472 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-972c807b-f6b5-4c49-a2aa-a5493873d34f None None] MFA Rules not processed for user `4234e3aa1be546d38e88d9b3a887cf33`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:00:14.759226 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-972c807b-f6b5-4c49-a2aa-a5493873d34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:14.769379 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1212/2411] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:00:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:00:17.108251 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c415ea-a092-45cc-bc11-99a92901bb7f service swift] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:17.109826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-04c415ea-a092-45cc-bc11-99a92901bb7f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:17.128105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c415ea-a092-45cc-bc11-99a92901bb7f service swift] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:17.145121 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716b1e9-5523-42fb-bb0f-252938b57732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:17.145786 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716b1e9-5523-42fb-bb0f-252938b57732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:17.146238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716b1e9-5523-42fb-bb0f-252938b57732 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:17.146686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716b1e9-5523-42fb-bb0f-252938b57732 admin admin] PATH_INFO: `/v3/users/2ccde4f5d8434948b02da77f853d1041` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:17.148100 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716b1e9-5523-42fb-bb0f-252938b57732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ccde4f5d8434948b02da77f853d1041)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:17.150310 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716b1e9-5523-42fb-bb0f-252938b57732 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:17.359306 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7716b1e9-5523-42fb-bb0f-252938b57732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ccde4f5d8434948b02da77f853d1041'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:17.457122 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7716b1e9-5523-42fb-bb0f-252938b57732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ccde4f5d8434948b02da77f853d1041'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:17.457843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7716b1e9-5523-42fb-bb0f-252938b57732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ccde4f5d8434948b02da77f853d1041'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:17.458577 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7716b1e9-5523-42fb-bb0f-252938b57732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ccde4f5d8434948b02da77f853d1041'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:17.467541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7716b1e9-5523-42fb-bb0f-252938b57732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ccde4f5d8434948b02da77f853d1041'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:17.488163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1200/2412] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:00:17 2022] DELETE /identity/v3/users/2ccde4f5d8434948b02da77f853d1041 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:00:17.492609 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010fafa-d0ed-4db7-bb09-e9efa46818b6 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:17.493092 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010fafa-d0ed-4db7-bb09-e9efa46818b6 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:17.493175 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010fafa-d0ed-4db7-bb09-e9efa46818b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:17.503152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716b1e9-5523-42fb-bb0f-252938b57732 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:17.506318 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7716b1e9-5523-42fb-bb0f-252938b57732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:17.532225 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-2010fafa-d0ed-4db7-bb09-e9efa46818b6 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:00:17.533955 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-2010fafa-d0ed-4db7-bb09-e9efa46818b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:17.599034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716b1e9-5523-42fb-bb0f-252938b57732 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:17.607265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29f66d-acd1-4357-ae16-057b45588121 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bd5bbbf65461990c9bb2747dbe5e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:17.607890 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29f66d-acd1-4357-ae16-057b45588121 service placement] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:17.608171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29f66d-acd1-4357-ae16-057b45588121 service placement] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:17.613207 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29f66d-acd1-4357-ae16-057b45588121 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:17.613207 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0c29f66d-acd1-4357-ae16-057b45588121 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:17.620226 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1213/2413] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:00:17.627570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29f66d-acd1-4357-ae16-057b45588121 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:17.630103 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29f66d-acd1-4357-ae16-057b45588121 service placement] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:17.632757 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010fafa-d0ed-4db7-bb09-e9efa46818b6 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:17.634531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-2010fafa-d0ed-4db7-bb09-e9efa46818b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:17.650299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1201/2414] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:00:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:00:17.715366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010fafa-d0ed-4db7-bb09-e9efa46818b6 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:17.721384 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de642f2b-f0d6-4905-9beb-8710dbeb59a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:17.722433 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de642f2b-f0d6-4905-9beb-8710dbeb59a8 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:17.722817 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de642f2b-f0d6-4905-9beb-8710dbeb59a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:17.723194 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de642f2b-f0d6-4905-9beb-8710dbeb59a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:17.746231 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de642f2b-f0d6-4905-9beb-8710dbeb59a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:17.747963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de642f2b-f0d6-4905-9beb-8710dbeb59a8 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:17.768632 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1214/2415] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:00:18.187466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29f66d-acd1-4357-ae16-057b45588121 service placement] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:18.187466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0c29f66d-acd1-4357-ae16-057b45588121 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:18.203289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29f66d-acd1-4357-ae16-057b45588121 service placement] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:18.209246 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261f234-775f-476b-a2c4-2ce13a3056db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:18.210391 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261f234-775f-476b-a2c4-2ce13a3056db admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:18.210622 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261f234-775f-476b-a2c4-2ce13a3056db admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:18.211002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261f234-775f-476b-a2c4-2ce13a3056db admin admin] PATH_INFO: `/v3/projects/e4feb0f68896425dbe4f5c91273a138c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:18.212770 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261f234-775f-476b-a2c4-2ce13a3056db admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4feb0f68896425dbe4f5c91273a138c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:18.215051 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261f234-775f-476b-a2c4-2ce13a3056db admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:18.216656 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:00:18.321914 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3261f234-775f-476b-a2c4-2ce13a3056db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4feb0f68896425dbe4f5c91273a138c', 'request_id': 'req-3261f234-775f-476b-a2c4-2ce13a3056db'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:18.328555 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3261f234-775f-476b-a2c4-2ce13a3056db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4feb0f68896425dbe4f5c91273a138c', 'request_id': 'req-3261f234-775f-476b-a2c4-2ce13a3056db'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:18.394413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3261f234-775f-476b-a2c4-2ce13a3056db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4feb0f68896425dbe4f5c91273a138c', 'request_id': 'req-3261f234-775f-476b-a2c4-2ce13a3056db'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:18.412411 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3261f234-775f-476b-a2c4-2ce13a3056db admin admin] The token cache is being invalidate because project e4feb0f68896425dbe4f5c91273a138c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:00:18.412984 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3261f234-775f-476b-a2c4-2ce13a3056db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:18.413901 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3261f234-775f-476b-a2c4-2ce13a3056db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:18.428450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1202/2416] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:00:18 2022] DELETE /identity/v3/projects/e4feb0f68896425dbe4f5c91273a138c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:00:26.543968 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3698a62-c04a-4be5-b15f-71b9952cf9ac None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:26.544544 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3698a62-c04a-4be5-b15f-71b9952cf9ac None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:26.544544 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3698a62-c04a-4be5-b15f-71b9952cf9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:26.571444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-a3698a62-c04a-4be5-b15f-71b9952cf9ac None None] MFA Rules not processed for user `642d4bef7e9c459a8d2dde636094b528`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:00:26.572770 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-a3698a62-c04a-4be5-b15f-71b9952cf9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:26.594100 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:00:26.639537 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1215/2417] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Sep 6 23:00:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:00:26.654806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261f234-775f-476b-a2c4-2ce13a3056db admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:26.656324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3261f234-775f-476b-a2c4-2ce13a3056db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:26.728327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261f234-775f-476b-a2c4-2ce13a3056db admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:26.733384 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1119a3-5e26-4d81-b401-d33aad6e7175 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660248a90f524a43b143bae127e0eaa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:26.733997 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1119a3-5e26-4d81-b401-d33aad6e7175 service swift] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:26.734308 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1119a3-5e26-4d81-b401-d33aad6e7175 service swift] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:26.734582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1119a3-5e26-4d81-b401-d33aad6e7175 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:26.743223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1119a3-5e26-4d81-b401-d33aad6e7175 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:26.753674 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1119a3-5e26-4d81-b401-d33aad6e7175 service swift] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:26.753787 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1203/2418] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Sep 6 23:00:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 23:00:36.640827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=15 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:00:36.749562 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=56,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:00:47.926354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58895d8-f0b3-408e-8fcf-14f635711c48 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:47.926907 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58895d8-f0b3-408e-8fcf-14f635711c48 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:47.926907 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58895d8-f0b3-408e-8fcf-14f635711c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:47.947035 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-d58895d8-f0b3-408e-8fcf-14f635711c48 None None] MFA Rules not processed for user `642d4bef7e9c459a8d2dde636094b528`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:00:47.948606 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d58895d8-f0b3-408e-8fcf-14f635711c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:47.958135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1216/2419] 10.222.0.30 () {58 vars in 967 bytes} [Tue Sep 6 23:00:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:00:47.972770 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1119a3-5e26-4d81-b401-d33aad6e7175 service swift] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:47.983156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1119a3-5e26-4d81-b401-d33aad6e7175 service swift] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:47.988164 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e4ceb-8f30-4787-b118-dc7db9b94cec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660248a90f524a43b143bae127e0eaa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:47.988793 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e4ceb-8f30-4787-b118-dc7db9b94cec service swift] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:47.989071 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e4ceb-8f30-4787-b118-dc7db9b94cec service swift] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:47.989342 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e4ceb-8f30-4787-b118-dc7db9b94cec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:47.997229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e4ceb-8f30-4787-b118-dc7db9b94cec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:47.998806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e4ceb-8f30-4787-b118-dc7db9b94cec service swift] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:48.007155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1204/2420] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Sep 6 23:00:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 23:00:51.149174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58895d8-f0b3-408e-8fcf-14f635711c48 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:51.150873 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d58895d8-f0b3-408e-8fcf-14f635711c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:51.235745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58895d8-f0b3-408e-8fcf-14f635711c48 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:51.253326 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8280f8-539b-48e6-8a5d-c55e7acd8f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:51.254086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8280f8-539b-48e6-8a5d-c55e7acd8f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:51.254430 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8280f8-539b-48e6-8a5d-c55e7acd8f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:51.254712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8280f8-539b-48e6-8a5d-c55e7acd8f2a admin admin] PATH_INFO: `/v3/users/95ce2e4f8df34404ad587edc9bc8af05` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:51.255951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8280f8-539b-48e6-8a5d-c55e7acd8f2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ce2e4f8df34404ad587edc9bc8af05)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:51.258317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8280f8-539b-48e6-8a5d-c55e7acd8f2a admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:51.458711 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-5d8280f8-539b-48e6-8a5d-c55e7acd8f2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ce2e4f8df34404ad587edc9bc8af05'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:51.531083 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-5d8280f8-539b-48e6-8a5d-c55e7acd8f2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ce2e4f8df34404ad587edc9bc8af05'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:51.531867 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-5d8280f8-539b-48e6-8a5d-c55e7acd8f2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ce2e4f8df34404ad587edc9bc8af05'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:51.547924 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-5d8280f8-539b-48e6-8a5d-c55e7acd8f2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ce2e4f8df34404ad587edc9bc8af05'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:51.548735 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-5d8280f8-539b-48e6-8a5d-c55e7acd8f2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ce2e4f8df34404ad587edc9bc8af05'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:51.561323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1217/2421] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:00:51 2022] DELETE /identity/v3/users/95ce2e4f8df34404ad587edc9bc8af05 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:00:51.874143 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e4ceb-8f30-4787-b118-dc7db9b94cec service swift] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:51.885989 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e4ceb-8f30-4787-b118-dc7db9b94cec service swift] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:51.964199 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743a4ab-b5fa-4946-be56-440631b9307f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:51.964862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743a4ab-b5fa-4946-be56-440631b9307f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:51.965145 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743a4ab-b5fa-4946-be56-440631b9307f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:51.965417 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743a4ab-b5fa-4946-be56-440631b9307f admin admin] PATH_INFO: `/v3/projects/73b251433ebe409eac686d418f83e499` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:51.966542 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743a4ab-b5fa-4946-be56-440631b9307f admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b251433ebe409eac686d418f83e499)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:51.968492 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743a4ab-b5fa-4946-be56-440631b9307f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:52.024610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283c3cd-b679-4147-9904-486c14ca2689 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:52.024900 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283c3cd-b679-4147-9904-486c14ca2689 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:52.025203 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283c3cd-b679-4147-9904-486c14ca2689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:52.044774 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-0283c3cd-b679-4147-9904-486c14ca2689 None None] MFA Rules not processed for user `642d4bef7e9c459a8d2dde636094b528`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:00:52.045990 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0283c3cd-b679-4147-9904-486c14ca2689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:52.080477 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8743a4ab-b5fa-4946-be56-440631b9307f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b251433ebe409eac686d418f83e499', 'request_id': 'req-8743a4ab-b5fa-4946-be56-440631b9307f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:52.095182 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8743a4ab-b5fa-4946-be56-440631b9307f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b251433ebe409eac686d418f83e499', 'request_id': 'req-8743a4ab-b5fa-4946-be56-440631b9307f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:52.116350 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1218/2422] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Sep 6 23:00:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 23:00:52.130185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283c3cd-b679-4147-9904-486c14ca2689 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:52.131740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0283c3cd-b679-4147-9904-486c14ca2689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:52.152290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:00:52.165334 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8743a4ab-b5fa-4946-be56-440631b9307f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b251433ebe409eac686d418f83e499', 'request_id': 'req-8743a4ab-b5fa-4946-be56-440631b9307f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:52.189784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8743a4ab-b5fa-4946-be56-440631b9307f admin admin] The token cache is being invalidate because project 73b251433ebe409eac686d418f83e499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:00:52.190378 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8743a4ab-b5fa-4946-be56-440631b9307f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:52.191313 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-8743a4ab-b5fa-4946-be56-440631b9307f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:52.194200 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1205/2423] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:00:51 2022] DELETE /identity/v3/projects/73b251433ebe409eac686d418f83e499 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:00:52.202830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06c7b7-3cb0-4e66-bb56-4d1f8e67f544 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:52.202830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06c7b7-3cb0-4e66-bb56-4d1f8e67f544 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:52.202830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06c7b7-3cb0-4e66-bb56-4d1f8e67f544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:52.222663 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283c3cd-b679-4147-9904-486c14ca2689 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:52.223225 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-1c06c7b7-3cb0-4e66-bb56-4d1f8e67f544 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:00:52.224677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1c06c7b7-3cb0-4e66-bb56-4d1f8e67f544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:52.308442 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd47252-9b1f-47f1-b12a-f0a76cd13a33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660248a90f524a43b143bae127e0eaa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:52.309267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd47252-9b1f-47f1-b12a-f0a76cd13a33 service swift] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:52.309628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd47252-9b1f-47f1-b12a-f0a76cd13a33 service swift] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:52.309955 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd47252-9b1f-47f1-b12a-f0a76cd13a33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:52.311863 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1bd47252-9b1f-47f1-b12a-f0a76cd13a33 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:52.315700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1206/2424] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 23:00:52.322890 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f11b4e-c54f-409f-a3cc-acdec2cd7e04 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:52.323547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f11b4e-c54f-409f-a3cc-acdec2cd7e04 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:52.324022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f11b4e-c54f-409f-a3cc-acdec2cd7e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:52.349172 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-78f11b4e-c54f-409f-a3cc-acdec2cd7e04 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:00:52.350402 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-78f11b4e-c54f-409f-a3cc-acdec2cd7e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:52.359346 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1207/2425] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:00:52.364410 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f11b4e-c54f-409f-a3cc-acdec2cd7e04 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:52.374262 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f11b4e-c54f-409f-a3cc-acdec2cd7e04 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:52.379435 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0cbe9-9047-473e-8cc2-856497c638dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:52.380055 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0cbe9-9047-473e-8cc2-856497c638dc admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:52.380535 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0cbe9-9047-473e-8cc2-856497c638dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:52.380815 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0cbe9-9047-473e-8cc2-856497c638dc admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:52.381544 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0cbe9-9047-473e-8cc2-856497c638dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:00:52.381777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0cbe9-9047-473e-8cc2-856497c638dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:52.383388 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0cbe9-9047-473e-8cc2-856497c638dc admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:52.388969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd47252-9b1f-47f1-b12a-f0a76cd13a33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:52.391692 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd47252-9b1f-47f1-b12a-f0a76cd13a33 service swift] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:52.392115 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:00:52.399007 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1208/2426] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 23:00:52.402877 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1219/2427] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Sep 6 23:00:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 23:00:52.407434 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0cbe9-9047-473e-8cc2-856497c638dc admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:52.422606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0cbe9-9047-473e-8cc2-856497c638dc admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:52.428321 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fca21-55c3-40ef-9ae5-24194748c1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:52.429314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fca21-55c3-40ef-9ae5-24194748c1be admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:52.429314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fca21-55c3-40ef-9ae5-24194748c1be admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:52.429646 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fca21-55c3-40ef-9ae5-24194748c1be admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:52.430348 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fca21-55c3-40ef-9ae5-24194748c1be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:52.432380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fca21-55c3-40ef-9ae5-24194748c1be admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:52.520403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1209/2428] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:00:52 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:00:52.524554 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd47252-9b1f-47f1-b12a-f0a76cd13a33 service swift] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:52.543470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd47252-9b1f-47f1-b12a-f0a76cd13a33 service swift] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:52.622894 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665e092-be9a-4d70-853f-37b2c8a36382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:52.623519 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665e092-be9a-4d70-853f-37b2c8a36382 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:52.624337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665e092-be9a-4d70-853f-37b2c8a36382 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:52.624337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665e092-be9a-4d70-853f-37b2c8a36382 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:52.625315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665e092-be9a-4d70-853f-37b2c8a36382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:52.626753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665e092-be9a-4d70-853f-37b2c8a36382 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:52.636764 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:00:52.735873 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1220/2429] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:00:52 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 23:00:52.737108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fca21-55c3-40ef-9ae5-24194748c1be admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:52.748590 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fca21-55c3-40ef-9ae5-24194748c1be admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:52.753969 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5613a45-5e08-467b-962a-9669edf764ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:52.754623 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5613a45-5e08-467b-962a-9669edf764ec admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:52.755074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5613a45-5e08-467b-962a-9669edf764ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:52.755340 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5613a45-5e08-467b-962a-9669edf764ec admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:52.756016 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5613a45-5e08-467b-962a-9669edf764ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:52.757692 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5613a45-5e08-467b-962a-9669edf764ec admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:52.772303 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1210/2430] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:00:52.773261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665e092-be9a-4d70-853f-37b2c8a36382 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:52.784567 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665e092-be9a-4d70-853f-37b2c8a36382 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:52.791680 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488316d8-b8ce-4eb9-b107-aa0e5258871d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:52.792872 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488316d8-b8ce-4eb9-b107-aa0e5258871d admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:52.793264 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488316d8-b8ce-4eb9-b107-aa0e5258871d admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:52.793615 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488316d8-b8ce-4eb9-b107-aa0e5258871d admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:52.794800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488316d8-b8ce-4eb9-b107-aa0e5258871d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:52.798062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488316d8-b8ce-4eb9-b107-aa0e5258871d admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:52.811706 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1221/2431] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:00:52.816139 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5613a45-5e08-467b-962a-9669edf764ec admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:52.828094 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5613a45-5e08-467b-962a-9669edf764ec admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:52.834723 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed700b2-fe68-4747-a197-fcfa2dff801f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:52.834723 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed700b2-fe68-4747-a197-fcfa2dff801f admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:52.834723 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed700b2-fe68-4747-a197-fcfa2dff801f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:52.834723 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed700b2-fe68-4747-a197-fcfa2dff801f admin admin] PATH_INFO: `/v3/projects/19f4a762c97242b0927adbabc0f670ba/users/2977cf1f8a3c45078a890b105ac4a3eb/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:52.854470 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed700b2-fe68-4747-a197-fcfa2dff801f admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f4a762c97242b0927adbabc0f670ba, user_id=2977cf1f8a3c45078a890b105ac4a3eb, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:52.859217 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed700b2-fe68-4747-a197-fcfa2dff801f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:52.948792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1211/2432] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:00:52 2022] PUT /identity/v3/projects/19f4a762c97242b0927adbabc0f670ba/users/2977cf1f8a3c45078a890b105ac4a3eb/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:00:52.950238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4feeda-3ea2-4c56-97ba-fe6ce8172bde None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:52.950238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4feeda-3ea2-4c56-97ba-fe6ce8172bde None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:52.950238 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4feeda-3ea2-4c56-97ba-fe6ce8172bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:52.989089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-6d4feeda-3ea2-4c56-97ba-fe6ce8172bde None None] MFA Rules not processed for user `2977cf1f8a3c45078a890b105ac4a3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:00:52.991296 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-6d4feeda-3ea2-4c56-97ba-fe6ce8172bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:53.060969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1222/2433] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:00:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 23:00:53.073998 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed700b2-fe68-4747-a197-fcfa2dff801f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:53.076158 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5ed700b2-fe68-4747-a197-fcfa2dff801f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:53.144279 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed700b2-fe68-4747-a197-fcfa2dff801f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:53.148848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a6557-42dc-4ff6-8a54-79c14f07de76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:53.149468 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a6557-42dc-4ff6-8a54-79c14f07de76 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:53.149744 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a6557-42dc-4ff6-8a54-79c14f07de76 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:53.150016 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a6557-42dc-4ff6-8a54-79c14f07de76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:53.159703 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a6557-42dc-4ff6-8a54-79c14f07de76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:53.161216 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a6557-42dc-4ff6-8a54-79c14f07de76 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:53.172363 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1212/2434] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:00:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 23:00:53.199389 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4feeda-3ea2-4c56-97ba-fe6ce8172bde None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:53.284504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4feeda-3ea2-4c56-97ba-fe6ce8172bde None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:53.289624 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee4819-2695-40f2-955b-26c209a09ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:53.290372 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee4819-2695-40f2-955b-26c209a09ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:53.290781 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee4819-2695-40f2-955b-26c209a09ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:53.291084 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee4819-2695-40f2-955b-26c209a09ebc admin admin] PATH_INFO: `/v3/users/2977cf1f8a3c45078a890b105ac4a3eb` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:53.292306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee4819-2695-40f2-955b-26c209a09ebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2977cf1f8a3c45078a890b105ac4a3eb)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:53.294892 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee4819-2695-40f2-955b-26c209a09ebc admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:53.435781 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-3bee4819-2695-40f2-955b-26c209a09ebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2977cf1f8a3c45078a890b105ac4a3eb'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:53.495909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-3bee4819-2695-40f2-955b-26c209a09ebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2977cf1f8a3c45078a890b105ac4a3eb'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:53.496898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-3bee4819-2695-40f2-955b-26c209a09ebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2977cf1f8a3c45078a890b105ac4a3eb'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:53.519222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-3bee4819-2695-40f2-955b-26c209a09ebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2977cf1f8a3c45078a890b105ac4a3eb'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:53.519966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-3bee4819-2695-40f2-955b-26c209a09ebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2977cf1f8a3c45078a890b105ac4a3eb'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:53.521339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:00:53.547711 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1223/2435] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:00:53 2022] DELETE /identity/v3/users/2977cf1f8a3c45078a890b105ac4a3eb => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:00:53.547877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57674ab0-e2b4-46f6-8bb1-8b90c218f08b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:53.547877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57674ab0-e2b4-46f6-8bb1-8b90c218f08b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:53.547877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57674ab0-e2b4-46f6-8bb1-8b90c218f08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:53.600366 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-57674ab0-e2b4-46f6-8bb1-8b90c218f08b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:00:53.601637 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-57674ab0-e2b4-46f6-8bb1-8b90c218f08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:53.702139 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1213/2436] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:00:53.713002 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee4819-2695-40f2-955b-26c209a09ebc admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:53.714979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3bee4819-2695-40f2-955b-26c209a09ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:53.776196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee4819-2695-40f2-955b-26c209a09ebc admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:53.780139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10a8a3-144b-41a9-99c4-f05a3894fa2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:53.780720 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a8a3-144b-41a9-99c4-f05a3894fa2d service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:53.781063 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a8a3-144b-41a9-99c4-f05a3894fa2d service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:53.781378 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a8a3-144b-41a9-99c4-f05a3894fa2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:53.792813 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10a8a3-144b-41a9-99c4-f05a3894fa2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:53.794666 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10a8a3-144b-41a9-99c4-f05a3894fa2d service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:53.805537 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1224/2437] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:00:54.326089 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57674ab0-e2b4-46f6-8bb1-8b90c218f08b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:54.328185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-57674ab0-e2b4-46f6-8bb1-8b90c218f08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:54.343360 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57674ab0-e2b4-46f6-8bb1-8b90c218f08b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:54.350099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b371a-85cd-47f2-a603-65be91825f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:54.350799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b371a-85cd-47f2-a603-65be91825f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:54.351009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b371a-85cd-47f2-a603-65be91825f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:54.351279 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b371a-85cd-47f2-a603-65be91825f5d admin admin] PATH_INFO: `/v3/projects/19f4a762c97242b0927adbabc0f670ba` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:54.352406 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b371a-85cd-47f2-a603-65be91825f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f4a762c97242b0927adbabc0f670ba)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:54.354809 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b371a-85cd-47f2-a603-65be91825f5d admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:54.488129 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:00:54.495783 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1e7b371a-85cd-47f2-a603-65be91825f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f4a762c97242b0927adbabc0f670ba', 'request_id': 'req-1e7b371a-85cd-47f2-a603-65be91825f5d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:54.502519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1e7b371a-85cd-47f2-a603-65be91825f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f4a762c97242b0927adbabc0f670ba', 'request_id': 'req-1e7b371a-85cd-47f2-a603-65be91825f5d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:54.598353 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1e7b371a-85cd-47f2-a603-65be91825f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f4a762c97242b0927adbabc0f670ba', 'request_id': 'req-1e7b371a-85cd-47f2-a603-65be91825f5d'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:54.612281 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1e7b371a-85cd-47f2-a603-65be91825f5d admin admin] The token cache is being invalidate because project 19f4a762c97242b0927adbabc0f670ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:00:54.612749 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1e7b371a-85cd-47f2-a603-65be91825f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:54.613512 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1e7b371a-85cd-47f2-a603-65be91825f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:00:54.616076 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1214/2438] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:00:54 2022] DELETE /identity/v3/projects/19f4a762c97242b0927adbabc0f670ba => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:00:55.121742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10a8a3-144b-41a9-99c4-f05a3894fa2d service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:00:55.123273 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1e10a8a3-144b-41a9-99c4-f05a3894fa2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:55.136153 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10a8a3-144b-41a9-99c4-f05a3894fa2d service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:00:55.191547 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f5143-dd67-4812-b5b9-650e0d9395dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:00:55.192972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f5143-dd67-4812-b5b9-650e0d9395dd service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:00:55.193262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f5143-dd67-4812-b5b9-650e0d9395dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:00:55.193535 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f5143-dd67-4812-b5b9-650e0d9395dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:00:55.195546 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-196f5143-dd67-4812-b5b9-650e0d9395dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:00:55.269276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f5143-dd67-4812-b5b9-650e0d9395dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:00:55.271153 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f5143-dd67-4812-b5b9-650e0d9395dd service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:00:55.288758 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1225/2439] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:00:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:01:04.690156 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=10,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:01:05.277034 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=81 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:01:08.099414 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0b1cb-642d-47ff-a4c4-7fe90003202a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:08.099913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0b1cb-642d-47ff-a4c4-7fe90003202a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:08.100057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0b1cb-642d-47ff-a4c4-7fe90003202a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:08.121671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-dbf0b1cb-642d-47ff-a4c4-7fe90003202a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:01:08.122884 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-dbf0b1cb-642d-47ff-a4c4-7fe90003202a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:01:08.182042 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1215/2440] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 6 23:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:01:08.202718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f5143-dd67-4812-b5b9-650e0d9395dd service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:01:08.204253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-196f5143-dd67-4812-b5b9-650e0d9395dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:01:08.279684 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f5143-dd67-4812-b5b9-650e0d9395dd service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:01:08.285204 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605b4b8-5ddb-4576-8efd-25ee2f1ebc38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:01:08.285934 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605b4b8-5ddb-4576-8efd-25ee2f1ebc38 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:08.286218 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605b4b8-5ddb-4576-8efd-25ee2f1ebc38 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:08.286491 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605b4b8-5ddb-4576-8efd-25ee2f1ebc38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:08.295045 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605b4b8-5ddb-4576-8efd-25ee2f1ebc38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:01:08.296772 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605b4b8-5ddb-4576-8efd-25ee2f1ebc38 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:01:08.306969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1226/2441] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:01:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 23:01:13.929611 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2cd5f-0683-4956-b5e6-817b08e9ce53 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:13.930209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2cd5f-0683-4956-b5e6-817b08e9ce53 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:13.930209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2cd5f-0683-4956-b5e6-817b08e9ce53 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:13.931648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1216/2442] 10.222.0.30 () {54 vars in 921 bytes} [Tue Sep 6 23:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 23:01:13.938679 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08bdbe-7b57-4919-b483-9a8d91096fc5 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:13.939237 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08bdbe-7b57-4919-b483-9a8d91096fc5 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:13.939345 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08bdbe-7b57-4919-b483-9a8d91096fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:13.959969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-de08bdbe-7b57-4919-b483-9a8d91096fc5 None None] MFA Rules not processed for user `b18fd296138349408613004929144e70`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:01:13.961407 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-de08bdbe-7b57-4919-b483-9a8d91096fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:01:13.971434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1227/2443] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Sep 6 23:01:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:01:13.983303 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2cd5f-0683-4956-b5e6-817b08e9ce53 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:01:13.985436 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5ea2cd5f-0683-4956-b5e6-817b08e9ce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:01:14.048929 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2cd5f-0683-4956-b5e6-817b08e9ce53 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:01:14.052838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd717941-68ef-4537-b321-a42be8d97d02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a2c1f1668814a5e9e654c6308fa0628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:01:14.053462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd717941-68ef-4537-b321-a42be8d97d02 service glance] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:14.053738 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd717941-68ef-4537-b321-a42be8d97d02 service glance] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:14.054011 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd717941-68ef-4537-b321-a42be8d97d02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:14.065135 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd717941-68ef-4537-b321-a42be8d97d02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:01:14.066580 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd717941-68ef-4537-b321-a42be8d97d02 service glance] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:01:14.078808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1217/2444] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:01:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 23:01:14.236854 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd0572-b5f4-4043-b5fe-c796d185db32 None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:14.237085 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd0572-b5f4-4043-b5fe-c796d185db32 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:14.237332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd0572-b5f4-4043-b5fe-c796d185db32 None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:14.238714 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1228/2445] 10.222.0.30 () {54 vars in 921 bytes} [Tue Sep 6 23:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 23:01:14.243676 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba82e0d-b1be-4f39-aedd-06fdaf81cf0d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:14.243973 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba82e0d-b1be-4f39-aedd-06fdaf81cf0d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:14.244776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba82e0d-b1be-4f39-aedd-06fdaf81cf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:14.264728 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-dba82e0d-b1be-4f39-aedd-06fdaf81cf0d None None] MFA Rules not processed for user `314bb14d5fa1414a832efb6d37c0446d`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:01:14.265931 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-dba82e0d-b1be-4f39-aedd-06fdaf81cf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:01:14.272337 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1218/2446] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Sep 6 23:01:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:01:14.283914 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd0572-b5f4-4043-b5fe-c796d185db32 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:01:14.285614 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e5cd0572-b5f4-4043-b5fe-c796d185db32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:01:14.298332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd0572-b5f4-4043-b5fe-c796d185db32 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:01:14.301792 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d11001-1b83-4713-86bd-6d674f917b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:01:14.302381 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d11001-1b83-4713-86bd-6d674f917b3e service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:14.302658 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d11001-1b83-4713-86bd-6d674f917b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:14.302930 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d11001-1b83-4713-86bd-6d674f917b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:14.310430 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d11001-1b83-4713-86bd-6d674f917b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:01:14.311840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d11001-1b83-4713-86bd-6d674f917b3e service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:01:14.319637 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1229/2447] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:01:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:01:14.402918 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701f0a2-a4d4-4d09-a922-947eea39c16b None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:14.403208 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701f0a2-a4d4-4d09-a922-947eea39c16b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:14.403482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701f0a2-a4d4-4d09-a922-947eea39c16b None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:14.404875 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1219/2448] 10.222.0.30 () {54 vars in 921 bytes} [Tue Sep 6 23:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 23:01:14.409625 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ee633-5bc1-4d22-8705-1669689d58d2 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:14.409911 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ee633-5bc1-4d22-8705-1669689d58d2 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:14.410211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ee633-5bc1-4d22-8705-1669689d58d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:14.430148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-f08ee633-5bc1-4d22-8705-1669689d58d2 None None] MFA Rules not processed for user `b18fd296138349408613004929144e70`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:01:14.431352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f08ee633-5bc1-4d22-8705-1669689d58d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:01:14.441223 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1230/2449] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Sep 6 23:01:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:01:14.452098 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701f0a2-a4d4-4d09-a922-947eea39c16b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:01:14.462976 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701f0a2-a4d4-4d09-a922-947eea39c16b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:01:14.466507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aadbe4-f053-4931-b576-37685790af7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:01:14.467120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aadbe4-f053-4931-b576-37685790af7a service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:14.467396 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aadbe4-f053-4931-b576-37685790af7a service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:14.467661 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aadbe4-f053-4931-b576-37685790af7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:14.477907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aadbe4-f053-4931-b576-37685790af7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:01:14.479868 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aadbe4-f053-4931-b576-37685790af7a service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:01:14.490486 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1220/2450] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:01:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:01:15.358681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6b838-8e37-4658-bc25-bc17b6580bed None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:15.359254 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6b838-8e37-4658-bc25-bc17b6580bed None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:15.359254 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6b838-8e37-4658-bc25-bc17b6580bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:15.379658 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-1ea6b838-8e37-4658-bc25-bc17b6580bed None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:01:15.380906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1ea6b838-8e37-4658-bc25-bc17b6580bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:01:15.389317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1231/2451] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 6 23:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:01:15.407126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aadbe4-f053-4931-b576-37685790af7a service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:01:15.419087 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aadbe4-f053-4931-b576-37685790af7a service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:01:15.424771 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2344141-02c8-4e9e-a411-2ac124031416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:01:15.425363 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2344141-02c8-4e9e-a411-2ac124031416 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:15.425642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2344141-02c8-4e9e-a411-2ac124031416 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:15.425998 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2344141-02c8-4e9e-a411-2ac124031416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:15.435246 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2344141-02c8-4e9e-a411-2ac124031416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:01:15.436870 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2344141-02c8-4e9e-a411-2ac124031416 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:01:15.447152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1221/2452] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:01:19.596287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc3ada-f644-4a82-b265-f8ea8265c473 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:19.596797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc3ada-f644-4a82-b265-f8ea8265c473 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:19.596899 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc3ada-f644-4a82-b265-f8ea8265c473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:19.616691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-51bc3ada-f644-4a82-b265-f8ea8265c473 None None] MFA Rules not processed for user `642d4bef7e9c459a8d2dde636094b528`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:01:19.617961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-51bc3ada-f644-4a82-b265-f8ea8265c473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:01:19.673607 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1232/2453] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Sep 6 23:01:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:01:19.695440 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2344141-02c8-4e9e-a411-2ac124031416 service nova] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:01:19.696894 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f2344141-02c8-4e9e-a411-2ac124031416 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:01:19.767010 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2344141-02c8-4e9e-a411-2ac124031416 service nova] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:01:19.772360 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1cc4e-1226-4d04-9561-1ca7337ea530 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660248a90f524a43b143bae127e0eaa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:01:19.773011 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1cc4e-1226-4d04-9561-1ca7337ea530 service swift] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:19.773261 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1cc4e-1226-4d04-9561-1ca7337ea530 service swift] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:19.773533 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1cc4e-1226-4d04-9561-1ca7337ea530 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:19.782070 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1cc4e-1226-4d04-9561-1ca7337ea530 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:01:19.783691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1cc4e-1226-4d04-9561-1ca7337ea530 service swift] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:01:19.788625 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:01:19.792671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1222/2454] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Sep 6 23:01:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 23:01:19.892031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bba82-82ea-4b11-bb36-495e63ed0c61 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:19.892538 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bba82-82ea-4b11-bb36-495e63ed0c61 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:19.892768 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bba82-82ea-4b11-bb36-495e63ed0c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:19.915669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-fe2bba82-82ea-4b11-bb36-495e63ed0c61 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:01:19.918852 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-fe2bba82-82ea-4b11-bb36-495e63ed0c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:01:19.927656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1233/2455] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 6 23:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:01:19.953610 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1cc4e-1226-4d04-9561-1ca7337ea530 service swift] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:01:19.955456 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d0b1cc4e-1226-4d04-9561-1ca7337ea530 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:01:19.975474 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1cc4e-1226-4d04-9561-1ca7337ea530 service swift] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:01:19.990947 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced24364-20f1-4c6a-8c6f-0cf4e46a7579 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:01:19.992388 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced24364-20f1-4c6a-8c6f-0cf4e46a7579 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:19.992964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced24364-20f1-4c6a-8c6f-0cf4e46a7579 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:19.993242 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced24364-20f1-4c6a-8c6f-0cf4e46a7579 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:20.005242 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced24364-20f1-4c6a-8c6f-0cf4e46a7579 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:01:20.006880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced24364-20f1-4c6a-8c6f-0cf4e46a7579 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:01:20.021322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1223/2456] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:01:29.908515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=77 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:01:30.014930 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=6 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:01:45.665817 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92b7f1-343d-45de-a1d0-4fb8ebd9e6a0 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:45.666337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92b7f1-343d-45de-a1d0-4fb8ebd9e6a0 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:45.666337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92b7f1-343d-45de-a1d0-4fb8ebd9e6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:45.685804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-6c92b7f1-343d-45de-a1d0-4fb8ebd9e6a0 None None] MFA Rules not processed for user `642d4bef7e9c459a8d2dde636094b528`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:01:45.686986 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-6c92b7f1-343d-45de-a1d0-4fb8ebd9e6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:01:45.694341 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1234/2457] 10.222.0.30 () {58 vars in 967 bytes} [Tue Sep 6 23:01:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:01:45.706656 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced24364-20f1-4c6a-8c6f-0cf4e46a7579 service nova] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:01:45.718188 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced24364-20f1-4c6a-8c6f-0cf4e46a7579 service nova] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:01:45.723720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198a0cc-928c-47cf-9b32-a9fb65a0cba8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660248a90f524a43b143bae127e0eaa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:01:45.724315 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198a0cc-928c-47cf-9b32-a9fb65a0cba8 service swift] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:45.724623 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198a0cc-928c-47cf-9b32-a9fb65a0cba8 service swift] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:45.724893 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198a0cc-928c-47cf-9b32-a9fb65a0cba8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:45.733903 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198a0cc-928c-47cf-9b32-a9fb65a0cba8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:01:45.736150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198a0cc-928c-47cf-9b32-a9fb65a0cba8 service swift] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:01:45.744022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1224/2458] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Sep 6 23:01:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 23:01:47.514599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8b858-8fe1-43d5-abe5-d65ed454d323 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:47.515116 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8b858-8fe1-43d5-abe5-d65ed454d323 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:47.515236 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8b858-8fe1-43d5-abe5-d65ed454d323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:47.534338 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-a1d8b858-8fe1-43d5-abe5-d65ed454d323 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:01:47.535673 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-a1d8b858-8fe1-43d5-abe5-d65ed454d323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:01:47.543300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1235/2459] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 6 23:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:01:47.562171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198a0cc-928c-47cf-9b32-a9fb65a0cba8 service swift] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:01:47.574520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198a0cc-928c-47cf-9b32-a9fb65a0cba8 service swift] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:01:47.580234 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d37d01-c969-4456-a306-0c4fa8201953 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:01:47.580862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d37d01-c969-4456-a306-0c4fa8201953 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:47.581143 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d37d01-c969-4456-a306-0c4fa8201953 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:47.581430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d37d01-c969-4456-a306-0c4fa8201953 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:47.589592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d37d01-c969-4456-a306-0c4fa8201953 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:01:47.591188 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d37d01-c969-4456-a306-0c4fa8201953 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:01:47.600632 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1225/2460] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:01:52.825723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde26ce-9d07-4aac-85f9-31e45783dfdd None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:52.826197 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde26ce-9d07-4aac-85f9-31e45783dfdd None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:52.826326 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde26ce-9d07-4aac-85f9-31e45783dfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:52.846532 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-3bde26ce-9d07-4aac-85f9-31e45783dfdd None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:01:52.848353 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3bde26ce-9d07-4aac-85f9-31e45783dfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:01:52.856499 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1236/2461] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 6 23:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:01:52.878400 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d37d01-c969-4456-a306-0c4fa8201953 service nova] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:01:52.890145 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d37d01-c969-4456-a306-0c4fa8201953 service nova] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:01:52.896257 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198a311-6b84-4f8c-8407-16868d3a3ce4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:01:52.896894 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198a311-6b84-4f8c-8407-16868d3a3ce4 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:52.897176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198a311-6b84-4f8c-8407-16868d3a3ce4 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:52.897451 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198a311-6b84-4f8c-8407-16868d3a3ce4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:52.906179 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198a311-6b84-4f8c-8407-16868d3a3ce4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:01:52.907773 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198a311-6b84-4f8c-8407-16868d3a3ce4 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:01:52.917735 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1226/2462] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:01:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:01:57.122163 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8c200-0b66-4db3-8666-75942f0e982c None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:57.122667 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8c200-0b66-4db3-8666-75942f0e982c None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:57.122766 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8c200-0b66-4db3-8666-75942f0e982c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:57.141977 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-86c8c200-0b66-4db3-8666-75942f0e982c None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:01:57.143139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-86c8c200-0b66-4db3-8666-75942f0e982c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:01:57.151399 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1237/2463] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 6 23:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:01:57.169997 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198a311-6b84-4f8c-8407-16868d3a3ce4 service nova] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:01:57.180970 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198a311-6b84-4f8c-8407-16868d3a3ce4 service nova] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:01:57.186374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58731018-ba87-4830-93eb-8ffb48d34dcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:01:57.186959 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58731018-ba87-4830-93eb-8ffb48d34dcb service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:01:57.187236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58731018-ba87-4830-93eb-8ffb48d34dcb service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:01:57.187506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58731018-ba87-4830-93eb-8ffb48d34dcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:01:57.195406 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58731018-ba87-4830-93eb-8ffb48d34dcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:01:57.197022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58731018-ba87-4830-93eb-8ffb48d34dcb service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:01:57.206376 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1227/2464] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:01:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:02:07.137077 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=12 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:02:07.202006 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=24 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:02:17.630584 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2befa-3bb8-4dfe-83b5-a7333bf8aae6 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:02:17.631095 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2befa-3bb8-4dfe-83b5-a7333bf8aae6 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:02:17.631202 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2befa-3bb8-4dfe-83b5-a7333bf8aae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:02:17.650439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-6af2befa-3bb8-4dfe-83b5-a7333bf8aae6 None None] MFA Rules not processed for user `4234e3aa1be546d38e88d9b3a887cf33`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:02:17.652226 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-6af2befa-3bb8-4dfe-83b5-a7333bf8aae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:02:17.705280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1238/2465] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:02:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:02:25.001281 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58731018-ba87-4830-93eb-8ffb48d34dcb service nova] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:02:25.002821 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-58731018-ba87-4830-93eb-8ffb48d34dcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:02:25.014736 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58731018-ba87-4830-93eb-8ffb48d34dcb service nova] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:02:25.018336 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6db18f-bf5e-49e7-884e-634f783fd2f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:02:25.018937 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6db18f-bf5e-49e7-884e-634f783fd2f9 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:02:25.019386 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6db18f-bf5e-49e7-884e-634f783fd2f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:02:25.019662 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6db18f-bf5e-49e7-884e-634f783fd2f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:02:25.021387 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3b6db18f-bf5e-49e7-884e-634f783fd2f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:02:25.035241 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6db18f-bf5e-49e7-884e-634f783fd2f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:02:25.036705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6db18f-bf5e-49e7-884e-634f783fd2f9 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:02:25.048179 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1228/2466] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:02:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:02:27.698800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=25 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:02:29.762247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2befa-3bb8-4dfe-83b5-a7333bf8aae6 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:02:29.775131 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2befa-3bb8-4dfe-83b5-a7333bf8aae6 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:02:29.780652 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969994b-c752-45aa-b0d5-dc105f398328 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:02:29.781263 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969994b-c752-45aa-b0d5-dc105f398328 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:02:29.781549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969994b-c752-45aa-b0d5-dc105f398328 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:02:29.781832 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969994b-c752-45aa-b0d5-dc105f398328 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:02:29.783592 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d969994b-c752-45aa-b0d5-dc105f398328 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:02:29.846470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969994b-c752-45aa-b0d5-dc105f398328 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:02:29.848070 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969994b-c752-45aa-b0d5-dc105f398328 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:02:29.857733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1239/2467] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:02:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:02:30.021061 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6db18f-bf5e-49e7-884e-634f783fd2f9 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:02:30.030454 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6db18f-bf5e-49e7-884e-634f783fd2f9 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:02:30.034194 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ba835-3e28-46d6-9487-579072c73e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:02:30.034807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ba835-3e28-46d6-9487-579072c73e9a service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:02:30.035210 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ba835-3e28-46d6-9487-579072c73e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:02:30.035361 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ba835-3e28-46d6-9487-579072c73e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:02:30.037484 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-421ba835-3e28-46d6-9487-579072c73e9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:02:30.052342 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ba835-3e28-46d6-9487-579072c73e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:02:30.053832 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ba835-3e28-46d6-9487-579072c73e9a service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:02:30.065035 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1229/2468] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:02:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:02:30.995188 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969994b-c752-45aa-b0d5-dc105f398328 service nova] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:02:31.007272 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969994b-c752-45aa-b0d5-dc105f398328 service nova] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:02:31.013797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cd801-11fa-429f-8bbe-0f7cac9dc32e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:02:31.014418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cd801-11fa-429f-8bbe-0f7cac9dc32e service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:02:31.014702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cd801-11fa-429f-8bbe-0f7cac9dc32e service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:02:31.014979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cd801-11fa-429f-8bbe-0f7cac9dc32e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:02:31.016884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-719cd801-11fa-429f-8bbe-0f7cac9dc32e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:02:31.083146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cd801-11fa-429f-8bbe-0f7cac9dc32e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:02:31.085215 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cd801-11fa-429f-8bbe-0f7cac9dc32e service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:02:31.100767 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1240/2469] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:02:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:02:38.689916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9db83-2de2-4ecb-a6df-ace6b277926f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:02:38.690468 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9db83-2de2-4ecb-a6df-ace6b277926f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:02:38.690468 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9db83-2de2-4ecb-a6df-ace6b277926f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:02:38.712152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-38c9db83-2de2-4ecb-a6df-ace6b277926f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:02:38.714146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-38c9db83-2de2-4ecb-a6df-ace6b277926f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:02:38.722554 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1230/2470] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 6 23:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:02:38.959010 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cd801-11fa-429f-8bbe-0f7cac9dc32e service nova] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:02:38.971724 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cd801-11fa-429f-8bbe-0f7cac9dc32e service nova] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:02:38.978589 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52807d5b-2af3-4be3-b91b-da5dd04dc3b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:02:38.979201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52807d5b-2af3-4be3-b91b-da5dd04dc3b9 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:02:38.979484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52807d5b-2af3-4be3-b91b-da5dd04dc3b9 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:02:38.979760 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52807d5b-2af3-4be3-b91b-da5dd04dc3b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:02:38.989353 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52807d5b-2af3-4be3-b91b-da5dd04dc3b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:02:38.990967 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52807d5b-2af3-4be3-b91b-da5dd04dc3b9 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:02:39.001476 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1241/2471] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 23:02:44.152009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9db83-2de2-4ecb-a6df-ace6b277926f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:02:44.162806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9db83-2de2-4ecb-a6df-ace6b277926f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:02:44.166370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a44bba-31cf-46a8-986a-deb714daceff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:02:44.167080 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a44bba-31cf-46a8-986a-deb714daceff service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:02:44.167368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a44bba-31cf-46a8-986a-deb714daceff service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:02:44.167642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a44bba-31cf-46a8-986a-deb714daceff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:02:44.170080 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c3a44bba-31cf-46a8-986a-deb714daceff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:02:44.179710 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a44bba-31cf-46a8-986a-deb714daceff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:02:44.181178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a44bba-31cf-46a8-986a-deb714daceff service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:02:44.189322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1231/2472] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:02:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:02:44.305107 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d2c85-7915-4168-acdd-8c6bc1fa3c16 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:02:44.305674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d2c85-7915-4168-acdd-8c6bc1fa3c16 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:02:44.305674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d2c85-7915-4168-acdd-8c6bc1fa3c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:02:44.325376 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-f41d2c85-7915-4168-acdd-8c6bc1fa3c16 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:02:44.327780 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f41d2c85-7915-4168-acdd-8c6bc1fa3c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:02:44.334588 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1242/2473] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 6 23:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:02:44.361072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a44bba-31cf-46a8-986a-deb714daceff service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:02:44.374436 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a44bba-31cf-46a8-986a-deb714daceff service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:02:44.380191 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5943042-e2de-4aba-aa14-281e3a53adf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:02:44.380832 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5943042-e2de-4aba-aa14-281e3a53adf1 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:02:44.381115 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5943042-e2de-4aba-aa14-281e3a53adf1 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:02:44.381386 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5943042-e2de-4aba-aa14-281e3a53adf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:02:44.389698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5943042-e2de-4aba-aa14-281e3a53adf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:02:44.391409 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5943042-e2de-4aba-aa14-281e3a53adf1 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:02:44.401100 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1232/2474] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:02:47.531299 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc7de5-d39c-4fd1-9476-180a8f52a75d None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:02:47.531865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc7de5-d39c-4fd1-9476-180a8f52a75d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:02:47.531865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc7de5-d39c-4fd1-9476-180a8f52a75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:02:47.555041 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-29bc7de5-d39c-4fd1-9476-180a8f52a75d None None] MFA Rules not processed for user `06d2f860bd3c4f5b955ff1671f7ce517`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:02:47.556361 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-29bc7de5-d39c-4fd1-9476-180a8f52a75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:02:47.564162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1243/2475] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:02:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:02:49.253231 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd95c1-f920-4190-b975-403991681241 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:02:49.254204 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd95c1-f920-4190-b975-403991681241 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:02:49.254204 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd95c1-f920-4190-b975-403991681241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:02:49.261394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=28 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:02:49.273296 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-bcdd95c1-f920-4190-b975-403991681241 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:02:49.274526 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bcdd95c1-f920-4190-b975-403991681241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:02:49.286263 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1233/2476] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 6 23:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:02:49.301969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc7de5-d39c-4fd1-9476-180a8f52a75d None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:02:49.315672 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc7de5-d39c-4fd1-9476-180a8f52a75d None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:02:49.321012 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86abbd-a79b-48a7-88d7-3ae3e3871d64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:02:49.321607 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86abbd-a79b-48a7-88d7-3ae3e3871d64 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:02:49.321884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86abbd-a79b-48a7-88d7-3ae3e3871d64 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:02:49.322256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86abbd-a79b-48a7-88d7-3ae3e3871d64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:02:49.330389 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86abbd-a79b-48a7-88d7-3ae3e3871d64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:02:49.331963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86abbd-a79b-48a7-88d7-3ae3e3871d64 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:02:49.341890 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1244/2477] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:02:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:02:55.015979 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd95c1-f920-4190-b975-403991681241 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:02:55.030307 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd95c1-f920-4190-b975-403991681241 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:02:55.035994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e85dda-d300-4f91-919d-77ae2efc4a5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:02:55.036711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e85dda-d300-4f91-919d-77ae2efc4a5e service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:02:55.037110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e85dda-d300-4f91-919d-77ae2efc4a5e service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:02:55.037455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e85dda-d300-4f91-919d-77ae2efc4a5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:02:55.039240 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-09e85dda-d300-4f91-919d-77ae2efc4a5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:02:55.052159 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e85dda-d300-4f91-919d-77ae2efc4a5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:02:55.053789 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e85dda-d300-4f91-919d-77ae2efc4a5e service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:02:55.066312 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1234/2478] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:02:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:02:56.609663 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe555e7b-7475-4aa8-a1ed-22a9c8c7b41d None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:02:56.610160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe555e7b-7475-4aa8-a1ed-22a9c8c7b41d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:02:56.610282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe555e7b-7475-4aa8-a1ed-22a9c8c7b41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:02:56.630637 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-fe555e7b-7475-4aa8-a1ed-22a9c8c7b41d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:02:56.631827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-fe555e7b-7475-4aa8-a1ed-22a9c8c7b41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:02:56.640170 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1245/2479] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 6 23:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:02:56.659657 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e85dda-d300-4f91-919d-77ae2efc4a5e service nova] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:02:56.670841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e85dda-d300-4f91-919d-77ae2efc4a5e service nova] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:02:56.676162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828fdb1-d389-411c-a963-85bd6647afe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:02:56.676801 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828fdb1-d389-411c-a963-85bd6647afe8 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:02:56.677078 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828fdb1-d389-411c-a963-85bd6647afe8 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:02:56.677350 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828fdb1-d389-411c-a963-85bd6647afe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:02:56.685330 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828fdb1-d389-411c-a963-85bd6647afe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:02:56.686907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828fdb1-d389-411c-a963-85bd6647afe8 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:02:56.696144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1235/2480] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:02:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:03:00.872412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c63e6-8f64-48b7-9c29-f971da4bbdaf None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:03:00.872934 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c63e6-8f64-48b7-9c29-f971da4bbdaf None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:03:00.873054 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c63e6-8f64-48b7-9c29-f971da4bbdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:03:00.881275 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=78 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:03:00.893816 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-829c63e6-8f64-48b7-9c29-f971da4bbdaf None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:03:00.895013 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-829c63e6-8f64-48b7-9c29-f971da4bbdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:03:00.902791 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1246/2481] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Sep 6 23:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:03:00.941443 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828fdb1-d389-411c-a963-85bd6647afe8 service nova] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:03:00.953042 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828fdb1-d389-411c-a963-85bd6647afe8 service nova] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:03:00.958745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e14b2-0f8c-42ed-a43e-382dba38a731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:03:00.959337 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e14b2-0f8c-42ed-a43e-382dba38a731 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:03:00.959619 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e14b2-0f8c-42ed-a43e-382dba38a731 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:03:00.959896 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e14b2-0f8c-42ed-a43e-382dba38a731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:03:00.968192 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e14b2-0f8c-42ed-a43e-382dba38a731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:03:00.969811 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e14b2-0f8c-42ed-a43e-382dba38a731 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:03:00.979187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1236/2482] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:03:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:03:04.167573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c63e6-8f64-48b7-9c29-f971da4bbdaf None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:03:04.180481 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c63e6-8f64-48b7-9c29-f971da4bbdaf None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:03:04.185925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740c19b-fb5c-4ed4-bfff-9b8381c3d096 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:03:04.187164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740c19b-fb5c-4ed4-bfff-9b8381c3d096 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:03:04.187445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740c19b-fb5c-4ed4-bfff-9b8381c3d096 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:03:04.187744 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740c19b-fb5c-4ed4-bfff-9b8381c3d096 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:03:04.189619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4740c19b-fb5c-4ed4-bfff-9b8381c3d096 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:03:04.247296 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740c19b-fb5c-4ed4-bfff-9b8381c3d096 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:03:04.249575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740c19b-fb5c-4ed4-bfff-9b8381c3d096 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:03:04.258913 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1247/2483] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:03:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:03:10.975043 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=20 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:03:14.254671 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=30 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:03:14.967804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e14b2-0f8c-42ed-a43e-382dba38a731 service nova] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:03:14.979644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e14b2-0f8c-42ed-a43e-382dba38a731 service nova] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:03:14.985562 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c37d45-9ce4-4e5b-b6f1-6281fc38d385 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:03:14.988250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c37d45-9ce4-4e5b-b6f1-6281fc38d385 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:03:14.988250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c37d45-9ce4-4e5b-b6f1-6281fc38d385 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:03:14.988250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c37d45-9ce4-4e5b-b6f1-6281fc38d385 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:03:14.988725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-80c37d45-9ce4-4e5b-b6f1-6281fc38d385 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:03:15.002082 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c37d45-9ce4-4e5b-b6f1-6281fc38d385 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:03:15.003682 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c37d45-9ce4-4e5b-b6f1-6281fc38d385 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:03:15.015989 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1237/2484] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:03:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:03:20.101561 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2ed7f-4d54-4627-be8f-77b5b8c8a32e None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:03:20.102064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2ed7f-4d54-4627-be8f-77b5b8c8a32e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:03:20.102173 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2ed7f-4d54-4627-be8f-77b5b8c8a32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:03:20.126022 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-45e2ed7f-4d54-4627-be8f-77b5b8c8a32e None None] MFA Rules not processed for user `07a7969f07564904bc69fe0d026c6fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:03:20.126022 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-45e2ed7f-4d54-4627-be8f-77b5b8c8a32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:03:20.130326 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1248/2485] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:03:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:03:20.435248 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c37d45-9ce4-4e5b-b6f1-6281fc38d385 service nova] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:03:20.445154 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c37d45-9ce4-4e5b-b6f1-6281fc38d385 service nova] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:03:20.448760 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6fb9d-ac94-4e05-ba1c-669d7168bd2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:03:20.449358 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6fb9d-ac94-4e05-ba1c-669d7168bd2c service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:03:20.449633 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6fb9d-ac94-4e05-ba1c-669d7168bd2c service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:03:20.449904 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6fb9d-ac94-4e05-ba1c-669d7168bd2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:03:20.451663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e9b6fb9d-ac94-4e05-ba1c-669d7168bd2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:03:20.461730 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6fb9d-ac94-4e05-ba1c-669d7168bd2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:03:20.463162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6fb9d-ac94-4e05-ba1c-669d7168bd2c service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:03:20.471437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1238/2486] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:03:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:03:20.881122 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2ed7f-4d54-4627-be8f-77b5b8c8a32e None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:03:20.882526 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-45e2ed7f-4d54-4627-be8f-77b5b8c8a32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:03:20.956964 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2ed7f-4d54-4627-be8f-77b5b8c8a32e None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:03:20.961938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e50834-1a96-491b-b444-951748ef479b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bd5bbbf65461990c9bb2747dbe5e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:03:20.962548 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e50834-1a96-491b-b444-951748ef479b service placement] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:03:20.962830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e50834-1a96-491b-b444-951748ef479b service placement] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:03:20.963106 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e50834-1a96-491b-b444-951748ef479b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:03:20.965159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d2e50834-1a96-491b-b444-951748ef479b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:03:20.977220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e50834-1a96-491b-b444-951748ef479b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:03:20.978814 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e50834-1a96-491b-b444-951748ef479b service placement] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:03:20.990302 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1249/2487] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:03:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:03:30.467942 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=12 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:03:30.984649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=35 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:03:32.767926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6fb9d-ac94-4e05-ba1c-669d7168bd2c service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:03:32.785293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6fb9d-ac94-4e05-ba1c-669d7168bd2c service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:03:32.788019 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e1908-3c42-4b8c-b84d-52a6d27ae655 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:03:32.788664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e1908-3c42-4b8c-b84d-52a6d27ae655 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:03:32.788947 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e1908-3c42-4b8c-b84d-52a6d27ae655 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:03:32.789221 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e1908-3c42-4b8c-b84d-52a6d27ae655 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:03:32.790993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-361e1908-3c42-4b8c-b84d-52a6d27ae655 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:03:32.822290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e1908-3c42-4b8c-b84d-52a6d27ae655 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:03:32.825526 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e1908-3c42-4b8c-b84d-52a6d27ae655 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:03:32.842502 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1239/2488] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:03:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:03:42.834141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=6 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:03:42.841152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e50834-1a96-491b-b444-951748ef479b service placement] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:03:42.852046 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e50834-1a96-491b-b444-951748ef479b service placement] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:03:42.857119 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38635bb9-f9d5-4e96-9ce1-0c48cba5a718 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bd5bbbf65461990c9bb2747dbe5e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:03:42.857720 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38635bb9-f9d5-4e96-9ce1-0c48cba5a718 service placement] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:03:42.857997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38635bb9-f9d5-4e96-9ce1-0c48cba5a718 service placement] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:03:42.858266 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38635bb9-f9d5-4e96-9ce1-0c48cba5a718 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:03:42.859958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-38635bb9-f9d5-4e96-9ce1-0c48cba5a718 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:03:42.871999 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38635bb9-f9d5-4e96-9ce1-0c48cba5a718 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:03:42.873867 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38635bb9-f9d5-4e96-9ce1-0c48cba5a718 service placement] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:03:42.884702 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1250/2489] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:03:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:03:42.971392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e1908-3c42-4b8c-b84d-52a6d27ae655 service nova] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:03:42.972904 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-361e1908-3c42-4b8c-b84d-52a6d27ae655 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:03:42.986096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e1908-3c42-4b8c-b84d-52a6d27ae655 service nova] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:03:42.991179 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54688d-416f-489a-a35d-b7cac2c78f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:03:42.991799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54688d-416f-489a-a35d-b7cac2c78f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:03:42.992075 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54688d-416f-489a-a35d-b7cac2c78f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:03:42.992391 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54688d-416f-489a-a35d-b7cac2c78f21 admin admin] PATH_INFO: `/v3/users/4234e3aa1be546d38e88d9b3a887cf33` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:03:42.993531 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54688d-416f-489a-a35d-b7cac2c78f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4234e3aa1be546d38e88d9b3a887cf33)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:03:42.995454 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54688d-416f-489a-a35d-b7cac2c78f21 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:03:43.196479 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fc54688d-416f-489a-a35d-b7cac2c78f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4234e3aa1be546d38e88d9b3a887cf33'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:43.209425 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc8a58-2052-472b-b413-3643acdbbbe2 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:03:43.210647 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc8a58-2052-472b-b413-3643acdbbbe2 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:03:43.210647 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc8a58-2052-472b-b413-3643acdbbbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:03:43.229688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-55bc8a58-2052-472b-b413-3643acdbbbe2 None None] MFA Rules not processed for user `642d4bef7e9c459a8d2dde636094b528`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:03:43.230870 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-55bc8a58-2052-472b-b413-3643acdbbbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:03:43.238463 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1251/2490] 10.222.0.30 () {58 vars in 967 bytes} [Tue Sep 6 23:03:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 23:03:43.256460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fc54688d-416f-489a-a35d-b7cac2c78f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4234e3aa1be546d38e88d9b3a887cf33'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:43.257108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fc54688d-416f-489a-a35d-b7cac2c78f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4234e3aa1be546d38e88d9b3a887cf33'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:43.258292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fc54688d-416f-489a-a35d-b7cac2c78f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4234e3aa1be546d38e88d9b3a887cf33'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:43.265972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-fc54688d-416f-489a-a35d-b7cac2c78f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4234e3aa1be546d38e88d9b3a887cf33'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:43.284731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1240/2491] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:03:42 2022] DELETE /identity/v3/users/4234e3aa1be546d38e88d9b3a887cf33 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 23:03:43.415458 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc8a58-2052-472b-b413-3643acdbbbe2 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:03:43.428404 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc8a58-2052-472b-b413-3643acdbbbe2 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:03:43.488720 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc19cf8-3056-4d4a-95a1-8a031e83fbbd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660248a90f524a43b143bae127e0eaa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:03:43.489346 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc19cf8-3056-4d4a-95a1-8a031e83fbbd service swift] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:03:43.489625 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc19cf8-3056-4d4a-95a1-8a031e83fbbd service swift] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:03:43.489897 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc19cf8-3056-4d4a-95a1-8a031e83fbbd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:03:43.491690 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ebc19cf8-3056-4d4a-95a1-8a031e83fbbd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:03:43.537555 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54688d-416f-489a-a35d-b7cac2c78f21 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:03:43.541733 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-fc54688d-416f-489a-a35d-b7cac2c78f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:03:43.551460 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc19cf8-3056-4d4a-95a1-8a031e83fbbd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:03:43.553210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc19cf8-3056-4d4a-95a1-8a031e83fbbd service swift] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:03:43.562388 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1252/2492] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Sep 6 23:03:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 23:03:43.625799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54688d-416f-489a-a35d-b7cac2c78f21 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:03:43.630608 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf06b4-8df9-41fd-a9f6-5cc4ef0a1b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:03:43.636177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf06b4-8df9-41fd-a9f6-5cc4ef0a1b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:03:43.636177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf06b4-8df9-41fd-a9f6-5cc4ef0a1b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:03:43.636177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf06b4-8df9-41fd-a9f6-5cc4ef0a1b8f admin admin] PATH_INFO: `/v3/projects/ef095b2dde4047598d5b88faebcaa16f` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:03:43.636177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf06b4-8df9-41fd-a9f6-5cc4ef0a1b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef095b2dde4047598d5b88faebcaa16f)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:03:43.636177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf06b4-8df9-41fd-a9f6-5cc4ef0a1b8f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:03:43.782076 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a1cf06b4-8df9-41fd-a9f6-5cc4ef0a1b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef095b2dde4047598d5b88faebcaa16f', 'request_id': 'req-a1cf06b4-8df9-41fd-a9f6-5cc4ef0a1b8f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:43.789295 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a1cf06b4-8df9-41fd-a9f6-5cc4ef0a1b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef095b2dde4047598d5b88faebcaa16f', 'request_id': 'req-a1cf06b4-8df9-41fd-a9f6-5cc4ef0a1b8f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:43.856567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a1cf06b4-8df9-41fd-a9f6-5cc4ef0a1b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef095b2dde4047598d5b88faebcaa16f', 'request_id': 'req-a1cf06b4-8df9-41fd-a9f6-5cc4ef0a1b8f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:43.867757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a1cf06b4-8df9-41fd-a9f6-5cc4ef0a1b8f admin admin] The token cache is being invalidate because project ef095b2dde4047598d5b88faebcaa16f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:03:43.868725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a1cf06b4-8df9-41fd-a9f6-5cc4ef0a1b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:43.868725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a1cf06b4-8df9-41fd-a9f6-5cc4ef0a1b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:43.870292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1241/2493] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:03:43 2022] DELETE /identity/v3/projects/ef095b2dde4047598d5b88faebcaa16f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:03:44.489623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc19cf8-3056-4d4a-95a1-8a031e83fbbd service swift] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:03:44.492993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ebc19cf8-3056-4d4a-95a1-8a031e83fbbd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:03:44.547145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc19cf8-3056-4d4a-95a1-8a031e83fbbd service swift] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:03:44.579289 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:03:44.595176 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdac5f-371d-4153-9858-a2dc225d8c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:03:44.595784 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdac5f-371d-4153-9858-a2dc225d8c04 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:03:44.596064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdac5f-371d-4153-9858-a2dc225d8c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:03:44.596364 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdac5f-371d-4153-9858-a2dc225d8c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:03:44.598164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-bacdac5f-371d-4153-9858-a2dc225d8c04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:03:44.663406 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdac5f-371d-4153-9858-a2dc225d8c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:03:44.664878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdac5f-371d-4153-9858-a2dc225d8c04 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:03:44.674533 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1253/2494] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:03:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:03:48.276482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf06b4-8df9-41fd-a9f6-5cc4ef0a1b8f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:03:48.278325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a1cf06b4-8df9-41fd-a9f6-5cc4ef0a1b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:03:48.283378 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:03:48.350734 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf06b4-8df9-41fd-a9f6-5cc4ef0a1b8f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:03:48.355639 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7179e15-6be3-49c9-aded-77c8ac84457b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bd5bbbf65461990c9bb2747dbe5e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:03:48.356295 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7179e15-6be3-49c9-aded-77c8ac84457b service placement] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:03:48.356616 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7179e15-6be3-49c9-aded-77c8ac84457b service placement] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:03:48.356911 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7179e15-6be3-49c9-aded-77c8ac84457b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:03:48.358649 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a7179e15-6be3-49c9-aded-77c8ac84457b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:03:48.370078 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7179e15-6be3-49c9-aded-77c8ac84457b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:03:48.375963 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7179e15-6be3-49c9-aded-77c8ac84457b service placement] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:03:48.381885 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1242/2495] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:03:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:03:52.108380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdac5f-371d-4153-9858-a2dc225d8c04 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:03:52.109839 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-bacdac5f-371d-4153-9858-a2dc225d8c04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:03:52.123792 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdac5f-371d-4153-9858-a2dc225d8c04 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:03:52.128480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d04fb-4f04-45c8-bf06-6c9e20683e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:03:52.129115 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d04fb-4f04-45c8-bf06-6c9e20683e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:03:52.129526 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d04fb-4f04-45c8-bf06-6c9e20683e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:03:52.129692 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d04fb-4f04-45c8-bf06-6c9e20683e63 admin admin] PATH_INFO: `/v3/users/49dcf3b303e54f8ca2e45bf09381313e` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:03:52.131405 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d04fb-4f04-45c8-bf06-6c9e20683e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49dcf3b303e54f8ca2e45bf09381313e)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:03:52.133420 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d04fb-4f04-45c8-bf06-6c9e20683e63 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:03:52.302326 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-bb4d04fb-4f04-45c8-bf06-6c9e20683e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49dcf3b303e54f8ca2e45bf09381313e'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:52.363315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-bb4d04fb-4f04-45c8-bf06-6c9e20683e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49dcf3b303e54f8ca2e45bf09381313e'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:52.363946 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-bb4d04fb-4f04-45c8-bf06-6c9e20683e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49dcf3b303e54f8ca2e45bf09381313e'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:52.376880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-bb4d04fb-4f04-45c8-bf06-6c9e20683e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49dcf3b303e54f8ca2e45bf09381313e'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:52.379779 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-bb4d04fb-4f04-45c8-bf06-6c9e20683e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49dcf3b303e54f8ca2e45bf09381313e'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:52.389422 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1254/2496] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:03:52 2022] DELETE /identity/v3/users/49dcf3b303e54f8ca2e45bf09381313e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:03:52.658738 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7179e15-6be3-49c9-aded-77c8ac84457b service placement] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:03:52.670002 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7179e15-6be3-49c9-aded-77c8ac84457b service placement] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:03:52.727713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aeaafd-f769-4254-8250-66133a910ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:03:52.728364 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeaafd-f769-4254-8250-66133a910ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:03:52.728674 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeaafd-f769-4254-8250-66133a910ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:03:52.728945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeaafd-f769-4254-8250-66133a910ed8 admin admin] PATH_INFO: `/v3/projects/31567bd8432241c6ba85d49b989fa006` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:03:52.730046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aeaafd-f769-4254-8250-66133a910ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31567bd8432241c6ba85d49b989fa006)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:03:52.731961 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aeaafd-f769-4254-8250-66133a910ed8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:03:52.834600 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b3aeaafd-f769-4254-8250-66133a910ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31567bd8432241c6ba85d49b989fa006', 'request_id': 'req-b3aeaafd-f769-4254-8250-66133a910ed8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:52.840755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b3aeaafd-f769-4254-8250-66133a910ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31567bd8432241c6ba85d49b989fa006', 'request_id': 'req-b3aeaafd-f769-4254-8250-66133a910ed8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:52.954108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b3aeaafd-f769-4254-8250-66133a910ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31567bd8432241c6ba85d49b989fa006', 'request_id': 'req-b3aeaafd-f769-4254-8250-66133a910ed8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:52.965127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b3aeaafd-f769-4254-8250-66133a910ed8 admin admin] The token cache is being invalidate because project 31567bd8432241c6ba85d49b989fa006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:03:52.965393 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b3aeaafd-f769-4254-8250-66133a910ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:52.966011 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b3aeaafd-f769-4254-8250-66133a910ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:52.967732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1243/2497] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:03:52 2022] DELETE /identity/v3/projects/31567bd8432241c6ba85d49b989fa006 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:03:52.971871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d04fb-4f04-45c8-bf06-6c9e20683e63 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:03:52.973284 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-bb4d04fb-4f04-45c8-bf06-6c9e20683e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:03:52.986906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d04fb-4f04-45c8-bf06-6c9e20683e63 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:03:53.043400 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62addf9-b670-43e6-a243-2c4e7784af50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:03:53.044038 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62addf9-b670-43e6-a243-2c4e7784af50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:03:53.044545 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62addf9-b670-43e6-a243-2c4e7784af50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:03:53.044906 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62addf9-b670-43e6-a243-2c4e7784af50 admin admin] PATH_INFO: `/v3/users/23b84c71d4a34c3aabc3eb57715127c9` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:03:53.046038 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62addf9-b670-43e6-a243-2c4e7784af50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b84c71d4a34c3aabc3eb57715127c9)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:03:53.048958 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62addf9-b670-43e6-a243-2c4e7784af50 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:03:53.050555 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:03:53.219459 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c62addf9-b670-43e6-a243-2c4e7784af50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b84c71d4a34c3aabc3eb57715127c9'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:53.296895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c62addf9-b670-43e6-a243-2c4e7784af50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b84c71d4a34c3aabc3eb57715127c9'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:53.297542 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c62addf9-b670-43e6-a243-2c4e7784af50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b84c71d4a34c3aabc3eb57715127c9'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:53.309612 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c62addf9-b670-43e6-a243-2c4e7784af50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b84c71d4a34c3aabc3eb57715127c9'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:53.310245 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c62addf9-b670-43e6-a243-2c4e7784af50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b84c71d4a34c3aabc3eb57715127c9'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:53.322911 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1255/2498] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:03:52 2022] DELETE /identity/v3/users/23b84c71d4a34c3aabc3eb57715127c9 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:03:53.596146 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aeaafd-f769-4254-8250-66133a910ed8 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:03:53.597640 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b3aeaafd-f769-4254-8250-66133a910ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:03:53.611036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aeaafd-f769-4254-8250-66133a910ed8 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:03:53.632414 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:03:53.670319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eceb0-8544-4718-a760-6d9c0ba447da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:03:53.670950 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eceb0-8544-4718-a760-6d9c0ba447da admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:03:53.671228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eceb0-8544-4718-a760-6d9c0ba447da admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:03:53.671497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eceb0-8544-4718-a760-6d9c0ba447da admin admin] PATH_INFO: `/v3/projects/ccaed869688c450eb9b49200158483b0` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:03:53.672731 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124eceb0-8544-4718-a760-6d9c0ba447da admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccaed869688c450eb9b49200158483b0)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:03:53.674806 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124eceb0-8544-4718-a760-6d9c0ba447da admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:03:53.800591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-124eceb0-8544-4718-a760-6d9c0ba447da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccaed869688c450eb9b49200158483b0', 'request_id': 'req-124eceb0-8544-4718-a760-6d9c0ba447da'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:53.807414 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-124eceb0-8544-4718-a760-6d9c0ba447da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccaed869688c450eb9b49200158483b0', 'request_id': 'req-124eceb0-8544-4718-a760-6d9c0ba447da'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:53.856808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-124eceb0-8544-4718-a760-6d9c0ba447da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccaed869688c450eb9b49200158483b0', 'request_id': 'req-124eceb0-8544-4718-a760-6d9c0ba447da'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:53.867666 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-124eceb0-8544-4718-a760-6d9c0ba447da admin admin] The token cache is being invalidate because project ccaed869688c450eb9b49200158483b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:03:53.867946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-124eceb0-8544-4718-a760-6d9c0ba447da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:53.868606 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-124eceb0-8544-4718-a760-6d9c0ba447da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:03:53.870079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1244/2499] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:03:53 2022] DELETE /identity/v3/projects/ccaed869688c450eb9b49200158483b0 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:04:03.319270 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=26,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:04:03.864072 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:04:18.212680 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c910662-7cfc-4666-9e2f-3e9dad2504b4 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:18.213738 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c910662-7cfc-4666-9e2f-3e9dad2504b4 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:18.213738 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c910662-7cfc-4666-9e2f-3e9dad2504b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:18.233615 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-7c910662-7cfc-4666-9e2f-3e9dad2504b4 None None] MFA Rules not processed for user `5655757c28a446ed8f7468a4146aa09c`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:04:18.236703 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7c910662-7cfc-4666-9e2f-3e9dad2504b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:04:18.293692 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1256/2500] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:04:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:04:28.285035 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=25 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:04:40.475051 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eceb0-8544-4718-a760-6d9c0ba447da admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:40.476557 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-124eceb0-8544-4718-a760-6d9c0ba447da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:04:40.537232 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eceb0-8544-4718-a760-6d9c0ba447da admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:40.540807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32846d7-7e07-478f-9e4a-fbf2bb552b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:40.541411 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32846d7-7e07-478f-9e4a-fbf2bb552b9f service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:40.541685 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32846d7-7e07-478f-9e4a-fbf2bb552b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:40.541954 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32846d7-7e07-478f-9e4a-fbf2bb552b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:40.544254 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a32846d7-7e07-478f-9e4a-fbf2bb552b9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:04:40.616867 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32846d7-7e07-478f-9e4a-fbf2bb552b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:40.618566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32846d7-7e07-478f-9e4a-fbf2bb552b9f service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:40.629095 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1245/2501] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:04:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:04:44.461848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c910662-7cfc-4666-9e2f-3e9dad2504b4 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:44.462704 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7c910662-7cfc-4666-9e2f-3e9dad2504b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:04:44.477517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c910662-7cfc-4666-9e2f-3e9dad2504b4 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:44.482816 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2226e3-2914-41ff-b001-6448121ceda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:44.483444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2226e3-2914-41ff-b001-6448121ceda8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:44.483722 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2226e3-2914-41ff-b001-6448121ceda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:44.483991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2226e3-2914-41ff-b001-6448121ceda8 admin admin] PATH_INFO: `/v3/users/06d2f860bd3c4f5b955ff1671f7ce517` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:44.485145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2226e3-2914-41ff-b001-6448121ceda8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d2f860bd3c4f5b955ff1671f7ce517)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:44.487062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2226e3-2914-41ff-b001-6448121ceda8 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:44.650599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4e2226e3-2914-41ff-b001-6448121ceda8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d2f860bd3c4f5b955ff1671f7ce517'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:04:44.720396 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4e2226e3-2914-41ff-b001-6448121ceda8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d2f860bd3c4f5b955ff1671f7ce517'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:04:44.721001 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4e2226e3-2914-41ff-b001-6448121ceda8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d2f860bd3c4f5b955ff1671f7ce517'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:04:44.733375 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4e2226e3-2914-41ff-b001-6448121ceda8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d2f860bd3c4f5b955ff1671f7ce517'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:04:44.734001 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4e2226e3-2914-41ff-b001-6448121ceda8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d2f860bd3c4f5b955ff1671f7ce517'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:04:44.745843 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1257/2502] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:04:44 2022] DELETE /identity/v3/users/06d2f860bd3c4f5b955ff1671f7ce517 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:04:44.998456 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32846d7-7e07-478f-9e4a-fbf2bb552b9f service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:45.008588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32846d7-7e07-478f-9e4a-fbf2bb552b9f service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:45.066985 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51530b7e-e385-4db2-a004-3c65aaa51b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:45.067622 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51530b7e-e385-4db2-a004-3c65aaa51b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:45.067897 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51530b7e-e385-4db2-a004-3c65aaa51b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:45.068167 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51530b7e-e385-4db2-a004-3c65aaa51b08 admin admin] PATH_INFO: `/v3/projects/231688be9b6547999252977eaa6b475d` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:45.069305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51530b7e-e385-4db2-a004-3c65aaa51b08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=231688be9b6547999252977eaa6b475d)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:45.071242 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51530b7e-e385-4db2-a004-3c65aaa51b08 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:45.150452 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-51530b7e-e385-4db2-a004-3c65aaa51b08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '231688be9b6547999252977eaa6b475d', 'request_id': 'req-51530b7e-e385-4db2-a004-3c65aaa51b08'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:04:45.152869 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:04:45.157373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-51530b7e-e385-4db2-a004-3c65aaa51b08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '231688be9b6547999252977eaa6b475d', 'request_id': 'req-51530b7e-e385-4db2-a004-3c65aaa51b08'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:04:45.219744 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-51530b7e-e385-4db2-a004-3c65aaa51b08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '231688be9b6547999252977eaa6b475d', 'request_id': 'req-51530b7e-e385-4db2-a004-3c65aaa51b08'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:04:45.231301 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-51530b7e-e385-4db2-a004-3c65aaa51b08 admin admin] The token cache is being invalidate because project 231688be9b6547999252977eaa6b475d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:04:45.232247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-51530b7e-e385-4db2-a004-3c65aaa51b08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:04:45.232247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-51530b7e-e385-4db2-a004-3c65aaa51b08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:04:45.233738 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1246/2503] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:04:44 2022] DELETE /identity/v3/projects/231688be9b6547999252977eaa6b475d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:04:45.238635 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47ce1e-be01-4c5f-87d8-98c9939c12d4 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:45.238930 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47ce1e-be01-4c5f-87d8-98c9939c12d4 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:45.239208 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47ce1e-be01-4c5f-87d8-98c9939c12d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:45.258902 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-ae47ce1e-be01-4c5f-87d8-98c9939c12d4 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:04:45.260108 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ae47ce1e-be01-4c5f-87d8-98c9939c12d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:04:45.318992 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1258/2504] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:04:45.326862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dde75e-1e86-48b4-8edc-cfc9bf1e2b19 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:45.327148 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dde75e-1e86-48b4-8edc-cfc9bf1e2b19 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:45.327422 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dde75e-1e86-48b4-8edc-cfc9bf1e2b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:45.347343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a2dde75e-1e86-48b4-8edc-cfc9bf1e2b19 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:04:45.348576 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a2dde75e-1e86-48b4-8edc-cfc9bf1e2b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:04:45.357016 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1247/2505] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:04:45.361081 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47ce1e-be01-4c5f-87d8-98c9939c12d4 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:45.370662 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47ce1e-be01-4c5f-87d8-98c9939c12d4 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:45.375237 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b01d3-3e9d-4e2e-bef1-8a871ba05bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:45.375842 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b01d3-3e9d-4e2e-bef1-8a871ba05bce admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:45.376128 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b01d3-3e9d-4e2e-bef1-8a871ba05bce admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:45.376408 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b01d3-3e9d-4e2e-bef1-8a871ba05bce admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:45.377094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b01d3-3e9d-4e2e-bef1-8a871ba05bce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:04:45.377401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b01d3-3e9d-4e2e-bef1-8a871ba05bce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:45.378993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b01d3-3e9d-4e2e-bef1-8a871ba05bce admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:45.390344 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1259/2506] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 23:04:45.394422 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dde75e-1e86-48b4-8edc-cfc9bf1e2b19 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:45.404257 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dde75e-1e86-48b4-8edc-cfc9bf1e2b19 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:45.408895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9182b3-66f9-4597-b235-122ca5424683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:45.409478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9182b3-66f9-4597-b235-122ca5424683 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:45.409755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9182b3-66f9-4597-b235-122ca5424683 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:45.410023 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9182b3-66f9-4597-b235-122ca5424683 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:45.410648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9182b3-66f9-4597-b235-122ca5424683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:45.412585 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9182b3-66f9-4597-b235-122ca5424683 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:45.521436 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1248/2507] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:04:45 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:04:45.525559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b01d3-3e9d-4e2e-bef1-8a871ba05bce admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:45.536611 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b01d3-3e9d-4e2e-bef1-8a871ba05bce admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:45.594093 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16adb5f-c1ed-4001-95ba-33717bd429d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:45.594708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16adb5f-c1ed-4001-95ba-33717bd429d7 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:45.594994 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16adb5f-c1ed-4001-95ba-33717bd429d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:45.595268 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16adb5f-c1ed-4001-95ba-33717bd429d7 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:45.595889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16adb5f-c1ed-4001-95ba-33717bd429d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:45.598109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16adb5f-c1ed-4001-95ba-33717bd429d7 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:45.606100 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:04:45.716604 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1260/2508] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:04:45 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:04:45.720943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9182b3-66f9-4597-b235-122ca5424683 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:45.731477 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9182b3-66f9-4597-b235-122ca5424683 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:45.735958 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c272e-e78d-495f-8c85-9516c287e24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:45.736648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c272e-e78d-495f-8c85-9516c287e24f admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:45.736901 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c272e-e78d-495f-8c85-9516c287e24f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:45.737172 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c272e-e78d-495f-8c85-9516c287e24f admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:45.737808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c272e-e78d-495f-8c85-9516c287e24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:45.739391 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c272e-e78d-495f-8c85-9516c287e24f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:45.748910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1249/2509] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:04:45.755775 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16adb5f-c1ed-4001-95ba-33717bd429d7 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:45.766280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16adb5f-c1ed-4001-95ba-33717bd429d7 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:45.770858 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683df3f-6dd4-4287-9d49-a92b4cdf4399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:45.781312 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683df3f-6dd4-4287-9d49-a92b4cdf4399 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:45.781312 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683df3f-6dd4-4287-9d49-a92b4cdf4399 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:45.781312 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683df3f-6dd4-4287-9d49-a92b4cdf4399 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:45.781312 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683df3f-6dd4-4287-9d49-a92b4cdf4399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:45.781312 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683df3f-6dd4-4287-9d49-a92b4cdf4399 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:45.785173 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1261/2510] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:04:45.789138 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c272e-e78d-495f-8c85-9516c287e24f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:45.799015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c272e-e78d-495f-8c85-9516c287e24f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:45.803540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909aed9-1f20-494e-8496-742585bd5b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:45.804338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909aed9-1f20-494e-8496-742585bd5b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:45.804507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909aed9-1f20-494e-8496-742585bd5b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:45.804816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909aed9-1f20-494e-8496-742585bd5b49 admin admin] PATH_INFO: `/v3/projects/70ce5a3303bc4a50a9817520ef4933d4/users/b6d4550ba1254e7d841e4e5400bd94c4/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:45.818955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909aed9-1f20-494e-8496-742585bd5b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ce5a3303bc4a50a9817520ef4933d4, user_id=b6d4550ba1254e7d841e4e5400bd94c4, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:45.821667 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909aed9-1f20-494e-8496-742585bd5b49 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:45.915657 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1250/2511] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:04:45 2022] PUT /identity/v3/projects/70ce5a3303bc4a50a9817520ef4933d4/users/b6d4550ba1254e7d841e4e5400bd94c4/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 23:04:45.926618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04fe60-029d-438b-97c0-017ece136db2 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:45.930273 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04fe60-029d-438b-97c0-017ece136db2 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:45.930273 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04fe60-029d-438b-97c0-017ece136db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:45.955399 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-da04fe60-029d-438b-97c0-017ece136db2 None None] MFA Rules not processed for user `b6d4550ba1254e7d841e4e5400bd94c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:04:45.956643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-da04fe60-029d-438b-97c0-017ece136db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:04:46.020510 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1262/2512] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:04:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:04:46.031790 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909aed9-1f20-494e-8496-742585bd5b49 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:46.033626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c909aed9-1f20-494e-8496-742585bd5b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:04:46.106488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909aed9-1f20-494e-8496-742585bd5b49 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:46.111986 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cf52c-8635-4adb-a867-8549217fe857 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:46.112624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cf52c-8635-4adb-a867-8549217fe857 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:46.112904 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cf52c-8635-4adb-a867-8549217fe857 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:46.113177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cf52c-8635-4adb-a867-8549217fe857 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:46.120745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2cf52c-8635-4adb-a867-8549217fe857 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:46.122820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2cf52c-8635-4adb-a867-8549217fe857 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:46.131631 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1251/2513] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:04:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:04:49.181669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04fe60-029d-438b-97c0-017ece136db2 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:49.241192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04fe60-029d-438b-97c0-017ece136db2 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:49.245814 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c432cec-d125-4d1e-bb93-7dd2565063e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:49.246447 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c432cec-d125-4d1e-bb93-7dd2565063e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:49.246729 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c432cec-d125-4d1e-bb93-7dd2565063e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:49.247006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c432cec-d125-4d1e-bb93-7dd2565063e8 admin admin] PATH_INFO: `/v3/users/b6d4550ba1254e7d841e4e5400bd94c4` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:49.248211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c432cec-d125-4d1e-bb93-7dd2565063e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6d4550ba1254e7d841e4e5400bd94c4)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:49.250176 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c432cec-d125-4d1e-bb93-7dd2565063e8 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:49.417583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4c432cec-d125-4d1e-bb93-7dd2565063e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6d4550ba1254e7d841e4e5400bd94c4'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:04:49.500345 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4c432cec-d125-4d1e-bb93-7dd2565063e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6d4550ba1254e7d841e4e5400bd94c4'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:04:49.501004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4c432cec-d125-4d1e-bb93-7dd2565063e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6d4550ba1254e7d841e4e5400bd94c4'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:04:49.512096 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:04:49.513307 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4c432cec-d125-4d1e-bb93-7dd2565063e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6d4550ba1254e7d841e4e5400bd94c4'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:04:49.513976 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4c432cec-d125-4d1e-bb93-7dd2565063e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6d4550ba1254e7d841e4e5400bd94c4'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:04:49.525793 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1263/2514] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:04:49 2022] DELETE /identity/v3/users/b6d4550ba1254e7d841e4e5400bd94c4 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:04:49.530394 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245feda-2a3c-4262-ae30-9bc646af0af0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:49.533482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245feda-2a3c-4262-ae30-9bc646af0af0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:49.533482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245feda-2a3c-4262-ae30-9bc646af0af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:49.550175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-0245feda-2a3c-4262-ae30-9bc646af0af0 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:04:49.551420 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0245feda-2a3c-4262-ae30-9bc646af0af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:04:49.609164 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1252/2515] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 23:04:49.619019 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c432cec-d125-4d1e-bb93-7dd2565063e8 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:49.620498 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4c432cec-d125-4d1e-bb93-7dd2565063e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:04:49.677146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c432cec-d125-4d1e-bb93-7dd2565063e8 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:49.680623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d75074-79ac-4424-9342-fc15e2705d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:49.681227 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d75074-79ac-4424-9342-fc15e2705d2d service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:49.681504 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d75074-79ac-4424-9342-fc15e2705d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:49.681773 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d75074-79ac-4424-9342-fc15e2705d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:49.690584 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d75074-79ac-4424-9342-fc15e2705d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:49.692012 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d75074-79ac-4424-9342-fc15e2705d2d service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:49.701517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1264/2516] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:04:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:04:50.124567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245feda-2a3c-4262-ae30-9bc646af0af0 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:50.128755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-0245feda-2a3c-4262-ae30-9bc646af0af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:04:50.133245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:04:50.139573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245feda-2a3c-4262-ae30-9bc646af0af0 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:50.144658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e6f2a-fe8d-47c8-a5c8-8b6372f91cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:50.145375 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e6f2a-fe8d-47c8-a5c8-8b6372f91cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:50.145659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e6f2a-fe8d-47c8-a5c8-8b6372f91cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:50.145935 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e6f2a-fe8d-47c8-a5c8-8b6372f91cc1 admin admin] PATH_INFO: `/v3/projects/70ce5a3303bc4a50a9817520ef4933d4` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:50.147097 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e6f2a-fe8d-47c8-a5c8-8b6372f91cc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ce5a3303bc4a50a9817520ef4933d4)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:50.149081 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e6f2a-fe8d-47c8-a5c8-8b6372f91cc1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:50.266366 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-330e6f2a-fe8d-47c8-a5c8-8b6372f91cc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ce5a3303bc4a50a9817520ef4933d4', 'request_id': 'req-330e6f2a-fe8d-47c8-a5c8-8b6372f91cc1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:04:50.272507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-330e6f2a-fe8d-47c8-a5c8-8b6372f91cc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ce5a3303bc4a50a9817520ef4933d4', 'request_id': 'req-330e6f2a-fe8d-47c8-a5c8-8b6372f91cc1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:04:50.366074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-330e6f2a-fe8d-47c8-a5c8-8b6372f91cc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ce5a3303bc4a50a9817520ef4933d4', 'request_id': 'req-330e6f2a-fe8d-47c8-a5c8-8b6372f91cc1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:04:50.376717 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-330e6f2a-fe8d-47c8-a5c8-8b6372f91cc1 admin admin] The token cache is being invalidate because project 70ce5a3303bc4a50a9817520ef4933d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:04:50.376997 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-330e6f2a-fe8d-47c8-a5c8-8b6372f91cc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:04:50.377632 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-330e6f2a-fe8d-47c8-a5c8-8b6372f91cc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:04:50.379100 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1253/2517] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:04:50 2022] DELETE /identity/v3/projects/70ce5a3303bc4a50a9817520ef4933d4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:04:50.383953 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de210073-2e88-466a-be4b-f1871ccd0fd2 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:50.384588 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de210073-2e88-466a-be4b-f1871ccd0fd2 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:50.384868 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de210073-2e88-466a-be4b-f1871ccd0fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:50.404763 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-de210073-2e88-466a-be4b-f1871ccd0fd2 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:04:50.405961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-de210073-2e88-466a-be4b-f1871ccd0fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:04:50.463315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1265/2518] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:04:50.471046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c757d80-f9a0-440b-99ba-0cb95c3e7d21 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:50.471331 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c757d80-f9a0-440b-99ba-0cb95c3e7d21 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:50.471872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c757d80-f9a0-440b-99ba-0cb95c3e7d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:50.491218 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9c757d80-f9a0-440b-99ba-0cb95c3e7d21 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:04:50.492403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9c757d80-f9a0-440b-99ba-0cb95c3e7d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:04:50.500684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1254/2519] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:04:50.504827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de210073-2e88-466a-be4b-f1871ccd0fd2 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:50.515257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de210073-2e88-466a-be4b-f1871ccd0fd2 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:50.520002 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7149052-0f8d-4215-800f-4ce1ca8a0fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:50.520654 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7149052-0f8d-4215-800f-4ce1ca8a0fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:50.520936 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7149052-0f8d-4215-800f-4ce1ca8a0fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:50.521207 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7149052-0f8d-4215-800f-4ce1ca8a0fc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:50.521849 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7149052-0f8d-4215-800f-4ce1ca8a0fc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:04:50.522149 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7149052-0f8d-4215-800f-4ce1ca8a0fc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:50.523743 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7149052-0f8d-4215-800f-4ce1ca8a0fc4 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:50.535090 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1266/2520] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 23:04:50.539051 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c757d80-f9a0-440b-99ba-0cb95c3e7d21 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:50.548116 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c757d80-f9a0-440b-99ba-0cb95c3e7d21 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:50.552770 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5723fb-78ee-4ba9-8813-26b4b3151d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:50.553350 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5723fb-78ee-4ba9-8813-26b4b3151d2f admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:50.553626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5723fb-78ee-4ba9-8813-26b4b3151d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:50.553892 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5723fb-78ee-4ba9-8813-26b4b3151d2f admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:50.554518 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5723fb-78ee-4ba9-8813-26b4b3151d2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:50.556509 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5723fb-78ee-4ba9-8813-26b4b3151d2f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:50.621106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1255/2521] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:04:50 2022] POST /identity/v3/projects => generated 379 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 23:04:50.625275 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7149052-0f8d-4215-800f-4ce1ca8a0fc4 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:50.635094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7149052-0f8d-4215-800f-4ce1ca8a0fc4 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:50.690924 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86885b-6740-47d0-b178-8f102b952ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:50.691569 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86885b-6740-47d0-b178-8f102b952ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:50.691848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86885b-6740-47d0-b178-8f102b952ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:50.692134 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86885b-6740-47d0-b178-8f102b952ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:50.692784 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86885b-6740-47d0-b178-8f102b952ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:50.694696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86885b-6740-47d0-b178-8f102b952ae0 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:50.774464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1267/2522] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:04:50 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:04:50.778505 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5723fb-78ee-4ba9-8813-26b4b3151d2f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:50.789385 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5723fb-78ee-4ba9-8813-26b4b3151d2f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:50.793997 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638671f-a80a-4b50-93d7-fd5222d02e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:50.794592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638671f-a80a-4b50-93d7-fd5222d02e41 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:50.794872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638671f-a80a-4b50-93d7-fd5222d02e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:50.795154 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638671f-a80a-4b50-93d7-fd5222d02e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:50.795781 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638671f-a80a-4b50-93d7-fd5222d02e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:50.797441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638671f-a80a-4b50-93d7-fd5222d02e41 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:50.807223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1256/2523] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:04:50.811008 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86885b-6740-47d0-b178-8f102b952ae0 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:50.820966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86885b-6740-47d0-b178-8f102b952ae0 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:50.826080 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3aa4d-a2b4-431a-af11-3a20487a660b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:50.826674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3aa4d-a2b4-431a-af11-3a20487a660b admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:50.826952 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3aa4d-a2b4-431a-af11-3a20487a660b admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:50.827229 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3aa4d-a2b4-431a-af11-3a20487a660b admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:50.827895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3aa4d-a2b4-431a-af11-3a20487a660b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:50.829512 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3aa4d-a2b4-431a-af11-3a20487a660b admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:50.830740 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:04:50.840396 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1268/2524] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:04:50.845127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638671f-a80a-4b50-93d7-fd5222d02e41 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:50.855412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638671f-a80a-4b50-93d7-fd5222d02e41 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:50.860200 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ada5f-6b6d-4e9c-a5a2-a71ecc53f1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:50.860878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ada5f-6b6d-4e9c-a5a2-a71ecc53f1a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:50.861159 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ada5f-6b6d-4e9c-a5a2-a71ecc53f1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:50.861435 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ada5f-6b6d-4e9c-a5a2-a71ecc53f1a4 admin admin] PATH_INFO: `/v3/projects/84c51a62295345ed9177ba452dffd754/users/e34b49f5a3fe4feba8ba905ea8abe5bf/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:50.876897 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ada5f-6b6d-4e9c-a5a2-a71ecc53f1a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c51a62295345ed9177ba452dffd754, user_id=e34b49f5a3fe4feba8ba905ea8abe5bf, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:50.879612 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ada5f-6b6d-4e9c-a5a2-a71ecc53f1a4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:50.943703 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1257/2525] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:04:50 2022] PUT /identity/v3/projects/84c51a62295345ed9177ba452dffd754/users/e34b49f5a3fe4feba8ba905ea8abe5bf/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:04:50.954492 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e72648-5e67-412c-abf2-64d47465443b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:50.954782 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e72648-5e67-412c-abf2-64d47465443b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:50.955059 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e72648-5e67-412c-abf2-64d47465443b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:50.983107 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-f4e72648-5e67-412c-abf2-64d47465443b None None] MFA Rules not processed for user `e34b49f5a3fe4feba8ba905ea8abe5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:04:50.984332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f4e72648-5e67-412c-abf2-64d47465443b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:04:51.048589 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1269/2526] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:04:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:04:51.052920 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ada5f-6b6d-4e9c-a5a2-a71ecc53f1a4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:51.115233 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ada5f-6b6d-4e9c-a5a2-a71ecc53f1a4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:51.119868 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cba6c-c44b-4f1d-aca4-12340e02e16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:51.120507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cba6c-c44b-4f1d-aca4-12340e02e16b admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:51.120789 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cba6c-c44b-4f1d-aca4-12340e02e16b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:51.121060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cba6c-c44b-4f1d-aca4-12340e02e16b admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:51.121686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cba6c-c44b-4f1d-aca4-12340e02e16b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:51.124078 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cba6c-c44b-4f1d-aca4-12340e02e16b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:51.230221 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1258/2527] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:04:51 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:04:51.234251 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e72648-5e67-412c-abf2-64d47465443b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:51.244835 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e72648-5e67-412c-abf2-64d47465443b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:51.421323 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a08e43-945a-4262-b94e-194ccd5b0cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:51.421984 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a08e43-945a-4262-b94e-194ccd5b0cdf admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:51.422117 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a08e43-945a-4262-b94e-194ccd5b0cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:51.422419 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a08e43-945a-4262-b94e-194ccd5b0cdf admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:51.423041 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a08e43-945a-4262-b94e-194ccd5b0cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:51.425013 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a08e43-945a-4262-b94e-194ccd5b0cdf admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:51.529288 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1270/2528] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:04:51 2022] POST /identity/v3/users => generated 296 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:04:51.533326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cba6c-c44b-4f1d-aca4-12340e02e16b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:51.543507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cba6c-c44b-4f1d-aca4-12340e02e16b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:51.548646 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003dc04-1230-4c1d-ae7d-34c0e5f8ddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:51.549246 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003dc04-1230-4c1d-ae7d-34c0e5f8ddf4 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:51.549526 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003dc04-1230-4c1d-ae7d-34c0e5f8ddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:51.549798 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003dc04-1230-4c1d-ae7d-34c0e5f8ddf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:51.550430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003dc04-1230-4c1d-ae7d-34c0e5f8ddf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:51.552027 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003dc04-1230-4c1d-ae7d-34c0e5f8ddf4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:51.553266 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:04:51.563450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1259/2529] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:04:51.567443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a08e43-945a-4262-b94e-194ccd5b0cdf admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:51.577648 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a08e43-945a-4262-b94e-194ccd5b0cdf admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:51.582452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369c79d-816c-41ee-9182-3e6f6d235a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:51.584800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369c79d-816c-41ee-9182-3e6f6d235a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:51.584800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369c79d-816c-41ee-9182-3e6f6d235a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:51.584800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369c79d-816c-41ee-9182-3e6f6d235a78 admin admin] PATH_INFO: `/v3/projects/530d1bcc262d4fba9425fb5d1e1d0f8a/users/b4afb248513b4f72a5917d177fa55e50/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:51.598448 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369c79d-816c-41ee-9182-3e6f6d235a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=530d1bcc262d4fba9425fb5d1e1d0f8a, user_id=b4afb248513b4f72a5917d177fa55e50, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:51.601122 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369c79d-816c-41ee-9182-3e6f6d235a78 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:51.671914 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1271/2530] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:04:51 2022] PUT /identity/v3/projects/530d1bcc262d4fba9425fb5d1e1d0f8a/users/b4afb248513b4f72a5917d177fa55e50/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 23:04:51.675792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003dc04-1230-4c1d-ae7d-34c0e5f8ddf4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:51.686356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003dc04-1230-4c1d-ae7d-34c0e5f8ddf4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:51.746891 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c215b-9472-495d-9b22-2f602ae60acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:51.748125 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c215b-9472-495d-9b22-2f602ae60acb admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:51.748407 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c215b-9472-495d-9b22-2f602ae60acb admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:51.748717 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c215b-9472-495d-9b22-2f602ae60acb admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:51.749361 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c215b-9472-495d-9b22-2f602ae60acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:51.750994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c215b-9472-495d-9b22-2f602ae60acb admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:51.760756 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1260/2531] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:04:51.764948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369c79d-816c-41ee-9182-3e6f6d235a78 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:51.775006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369c79d-816c-41ee-9182-3e6f6d235a78 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:51.779580 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d836b-a885-4a4f-a365-164aab688d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:51.780227 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d836b-a885-4a4f-a365-164aab688d56 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:51.780530 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d836b-a885-4a4f-a365-164aab688d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:51.780801 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d836b-a885-4a4f-a365-164aab688d56 admin admin] PATH_INFO: `/v3/projects/530d1bcc262d4fba9425fb5d1e1d0f8a/users/b4afb248513b4f72a5917d177fa55e50/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:51.782733 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d836b-a885-4a4f-a365-164aab688d56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=530d1bcc262d4fba9425fb5d1e1d0f8a, user_id=b4afb248513b4f72a5917d177fa55e50, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:51.785432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d836b-a885-4a4f-a365-164aab688d56 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:51.795920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1272/2532] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:04:51 2022] PUT /identity/v3/projects/530d1bcc262d4fba9425fb5d1e1d0f8a/users/b4afb248513b4f72a5917d177fa55e50/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:04:51.814053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bc139-deed-4acf-a08c-92efdb83b2bb None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:51.814346 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bc139-deed-4acf-a08c-92efdb83b2bb None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:51.814622 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bc139-deed-4acf-a08c-92efdb83b2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:51.842380 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-809bc139-deed-4acf-a08c-92efdb83b2bb None None] MFA Rules not processed for user `b4afb248513b4f72a5917d177fa55e50`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:04:51.843591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-809bc139-deed-4acf-a08c-92efdb83b2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:04:51.913458 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1261/2533] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:04:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:04:51.925400 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d836b-a885-4a4f-a365-164aab688d56 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:51.927049 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-906d836b-a885-4a4f-a365-164aab688d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:04:51.968730 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:04:51.984146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d836b-a885-4a4f-a365-164aab688d56 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:51.987766 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e6110-fc41-4494-90a0-bfa6078b8355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:51.988366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e6110-fc41-4494-90a0-bfa6078b8355 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:51.988692 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e6110-fc41-4494-90a0-bfa6078b8355 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:51.988940 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e6110-fc41-4494-90a0-bfa6078b8355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:51.997804 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e6110-fc41-4494-90a0-bfa6078b8355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:51.999211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e6110-fc41-4494-90a0-bfa6078b8355 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:52.008703 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1273/2534] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:04:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:04:52.217791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bc139-deed-4acf-a08c-92efdb83b2bb None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:04:52.227494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bc139-deed-4acf-a08c-92efdb83b2bb None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:04:52.231075 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902edcd-2548-47c7-a0d2-1176d9a7cef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:04:52.231666 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902edcd-2548-47c7-a0d2-1176d9a7cef0 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:04:52.231946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902edcd-2548-47c7-a0d2-1176d9a7cef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:04:52.232222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902edcd-2548-47c7-a0d2-1176d9a7cef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:04:52.287139 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902edcd-2548-47c7-a0d2-1176d9a7cef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:04:52.288605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902edcd-2548-47c7-a0d2-1176d9a7cef0 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:04:52.297392 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1262/2535] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:04:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:05:00.690830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e6110-fc41-4494-90a0-bfa6078b8355 service cinder] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:00.750873 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e6110-fc41-4494-90a0-bfa6078b8355 service cinder] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:00.755813 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e76325-4636-475e-ae9d-43b8b98a52e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:00.756446 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e76325-4636-475e-ae9d-43b8b98a52e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:00.756737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e76325-4636-475e-ae9d-43b8b98a52e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:00.757009 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e76325-4636-475e-ae9d-43b8b98a52e5 admin admin] PATH_INFO: `/v3/users/e34b49f5a3fe4feba8ba905ea8abe5bf` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:00.758111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e76325-4636-475e-ae9d-43b8b98a52e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e34b49f5a3fe4feba8ba905ea8abe5bf)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:00.760018 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e76325-4636-475e-ae9d-43b8b98a52e5 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:00.907889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-03e76325-4636-475e-ae9d-43b8b98a52e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e34b49f5a3fe4feba8ba905ea8abe5bf'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:00.969095 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-03e76325-4636-475e-ae9d-43b8b98a52e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e34b49f5a3fe4feba8ba905ea8abe5bf'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:00.969650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-03e76325-4636-475e-ae9d-43b8b98a52e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e34b49f5a3fe4feba8ba905ea8abe5bf'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:00.981821 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-03e76325-4636-475e-ae9d-43b8b98a52e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e34b49f5a3fe4feba8ba905ea8abe5bf'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:00.982445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-03e76325-4636-475e-ae9d-43b8b98a52e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e34b49f5a3fe4feba8ba905ea8abe5bf'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:00.994396 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1274/2536] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:05:00 2022] DELETE /identity/v3/users/e34b49f5a3fe4feba8ba905ea8abe5bf => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:00.999202 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b35f7b-01b1-4a08-9a69-67d95628e8aa None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:00.999696 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b35f7b-01b1-4a08-9a69-67d95628e8aa None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:00.999810 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b35f7b-01b1-4a08-9a69-67d95628e8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:01.019562 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-79b35f7b-01b1-4a08-9a69-67d95628e8aa None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:01.020786 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-79b35f7b-01b1-4a08-9a69-67d95628e8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:01.029942 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:01.078651 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1263/2537] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:01.091537 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e76325-4636-475e-ae9d-43b8b98a52e5 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:01.093024 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-03e76325-4636-475e-ae9d-43b8b98a52e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:01.149033 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e76325-4636-475e-ae9d-43b8b98a52e5 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:01.152578 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cff11-454a-42ea-8c98-435e1b421dbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:01.153184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cff11-454a-42ea-8c98-435e1b421dbe service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:01.153467 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cff11-454a-42ea-8c98-435e1b421dbe service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:01.153787 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cff11-454a-42ea-8c98-435e1b421dbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:01.162496 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cff11-454a-42ea-8c98-435e1b421dbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:01.163916 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cff11-454a-42ea-8c98-435e1b421dbe service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:01.173117 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1275/2538] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:05:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:05:01.559619 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b35f7b-01b1-4a08-9a69-67d95628e8aa None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:01.563249 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-79b35f7b-01b1-4a08-9a69-67d95628e8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:01.573088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b35f7b-01b1-4a08-9a69-67d95628e8aa None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:01.577764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161172a-bbe9-44c8-8cc4-3e0f94e4bd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:01.578402 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161172a-bbe9-44c8-8cc4-3e0f94e4bd38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:01.578681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161172a-bbe9-44c8-8cc4-3e0f94e4bd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:01.578957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161172a-bbe9-44c8-8cc4-3e0f94e4bd38 admin admin] PATH_INFO: `/v3/projects/84c51a62295345ed9177ba452dffd754` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:01.580101 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161172a-bbe9-44c8-8cc4-3e0f94e4bd38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c51a62295345ed9177ba452dffd754)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:01.582169 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161172a-bbe9-44c8-8cc4-3e0f94e4bd38 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:01.672633 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3161172a-bbe9-44c8-8cc4-3e0f94e4bd38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c51a62295345ed9177ba452dffd754', 'request_id': 'req-3161172a-bbe9-44c8-8cc4-3e0f94e4bd38'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:01.679507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3161172a-bbe9-44c8-8cc4-3e0f94e4bd38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c51a62295345ed9177ba452dffd754', 'request_id': 'req-3161172a-bbe9-44c8-8cc4-3e0f94e4bd38'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:01.740711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3161172a-bbe9-44c8-8cc4-3e0f94e4bd38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c51a62295345ed9177ba452dffd754', 'request_id': 'req-3161172a-bbe9-44c8-8cc4-3e0f94e4bd38'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:01.751395 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3161172a-bbe9-44c8-8cc4-3e0f94e4bd38 admin admin] The token cache is being invalidate because project 84c51a62295345ed9177ba452dffd754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:05:01.751678 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3161172a-bbe9-44c8-8cc4-3e0f94e4bd38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:01.752292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3161172a-bbe9-44c8-8cc4-3e0f94e4bd38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:01.753807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1264/2539] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:05:01 2022] DELETE /identity/v3/projects/84c51a62295345ed9177ba452dffd754 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:01.757815 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cff11-454a-42ea-8c98-435e1b421dbe service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:01.762567 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:01.767898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cff11-454a-42ea-8c98-435e1b421dbe service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:01.822373 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd73cb-47b6-4cf7-845e-89ee85cc3acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:01.822938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd73cb-47b6-4cf7-845e-89ee85cc3acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:01.823221 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd73cb-47b6-4cf7-845e-89ee85cc3acb admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:01.823496 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd73cb-47b6-4cf7-845e-89ee85cc3acb admin admin] PATH_INFO: `/v3/users/b4afb248513b4f72a5917d177fa55e50` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:01.824651 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd73cb-47b6-4cf7-845e-89ee85cc3acb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4afb248513b4f72a5917d177fa55e50)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:01.826563 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd73cb-47b6-4cf7-845e-89ee85cc3acb admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:01.996968 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-a4fd73cb-47b6-4cf7-845e-89ee85cc3acb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4afb248513b4f72a5917d177fa55e50'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:02.069470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-a4fd73cb-47b6-4cf7-845e-89ee85cc3acb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4afb248513b4f72a5917d177fa55e50'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:02.070093 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-a4fd73cb-47b6-4cf7-845e-89ee85cc3acb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4afb248513b4f72a5917d177fa55e50'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:02.082955 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-a4fd73cb-47b6-4cf7-845e-89ee85cc3acb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4afb248513b4f72a5917d177fa55e50'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:02.083528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-a4fd73cb-47b6-4cf7-845e-89ee85cc3acb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4afb248513b4f72a5917d177fa55e50'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:02.096371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1276/2540] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:05:01 2022] DELETE /identity/v3/users/b4afb248513b4f72a5917d177fa55e50 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:02.485134 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161172a-bbe9-44c8-8cc4-3e0f94e4bd38 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:02.486618 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3161172a-bbe9-44c8-8cc4-3e0f94e4bd38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:02.503209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161172a-bbe9-44c8-8cc4-3e0f94e4bd38 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:02.559535 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d85110-0bee-4639-abbc-8c7c5f83546f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:02.560173 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d85110-0bee-4639-abbc-8c7c5f83546f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:02.560469 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d85110-0bee-4639-abbc-8c7c5f83546f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:02.560744 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d85110-0bee-4639-abbc-8c7c5f83546f admin admin] PATH_INFO: `/v3/projects/530d1bcc262d4fba9425fb5d1e1d0f8a` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:02.561855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d85110-0bee-4639-abbc-8c7c5f83546f admin admin] RBAC: Authorizing `identity:delete_project(project_id=530d1bcc262d4fba9425fb5d1e1d0f8a)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:02.563791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d85110-0bee-4639-abbc-8c7c5f83546f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:02.666742 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:02.672715 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d6d85110-0bee-4639-abbc-8c7c5f83546f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '530d1bcc262d4fba9425fb5d1e1d0f8a', 'request_id': 'req-d6d85110-0bee-4639-abbc-8c7c5f83546f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:02.679359 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d6d85110-0bee-4639-abbc-8c7c5f83546f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '530d1bcc262d4fba9425fb5d1e1d0f8a', 'request_id': 'req-d6d85110-0bee-4639-abbc-8c7c5f83546f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:02.752718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d6d85110-0bee-4639-abbc-8c7c5f83546f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '530d1bcc262d4fba9425fb5d1e1d0f8a', 'request_id': 'req-d6d85110-0bee-4639-abbc-8c7c5f83546f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:02.764079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d6d85110-0bee-4639-abbc-8c7c5f83546f admin admin] The token cache is being invalidate because project 530d1bcc262d4fba9425fb5d1e1d0f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:05:02.764379 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d6d85110-0bee-4639-abbc-8c7c5f83546f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:02.765029 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d6d85110-0bee-4639-abbc-8c7c5f83546f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:02.766518 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1265/2541] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:05:02 2022] DELETE /identity/v3/projects/530d1bcc262d4fba9425fb5d1e1d0f8a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:02.771506 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840f69-fc3e-4289-bdd8-2458235d046b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:02.772135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840f69-fc3e-4289-bdd8-2458235d046b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:02.772135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840f69-fc3e-4289-bdd8-2458235d046b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:02.795831 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-36840f69-fc3e-4289-bdd8-2458235d046b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:02.797125 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-36840f69-fc3e-4289-bdd8-2458235d046b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:02.856948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1277/2542] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 23:05:02.865470 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5683b27-4fb7-4826-97d3-dc5469d7aa15 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:02.865757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5683b27-4fb7-4826-97d3-dc5469d7aa15 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:02.866033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5683b27-4fb7-4826-97d3-dc5469d7aa15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:02.887068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c5683b27-4fb7-4826-97d3-dc5469d7aa15 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:02.888270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c5683b27-4fb7-4826-97d3-dc5469d7aa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:02.896659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1266/2543] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:02.900944 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36840f69-fc3e-4289-bdd8-2458235d046b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:02.911145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36840f69-fc3e-4289-bdd8-2458235d046b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:02.915613 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12eff8-a390-4052-8982-0f79f07fc749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:02.916208 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12eff8-a390-4052-8982-0f79f07fc749 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:02.916522 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12eff8-a390-4052-8982-0f79f07fc749 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:02.916857 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12eff8-a390-4052-8982-0f79f07fc749 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:02.917444 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12eff8-a390-4052-8982-0f79f07fc749 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:05:02.917742 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12eff8-a390-4052-8982-0f79f07fc749 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:02.919320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12eff8-a390-4052-8982-0f79f07fc749 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:02.930514 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1278/2544] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 23:05:02.934664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5683b27-4fb7-4826-97d3-dc5469d7aa15 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:02.944085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5683b27-4fb7-4826-97d3-dc5469d7aa15 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:02.948699 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34350ff5-c5ce-48ad-9eed-e4fd1b6ca7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:02.949283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34350ff5-c5ce-48ad-9eed-e4fd1b6ca7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:02.949559 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34350ff5-c5ce-48ad-9eed-e4fd1b6ca7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:02.949829 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34350ff5-c5ce-48ad-9eed-e4fd1b6ca7d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:02.950486 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34350ff5-c5ce-48ad-9eed-e4fd1b6ca7d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:02.952391 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34350ff5-c5ce-48ad-9eed-e4fd1b6ca7d2 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:03.022257 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1267/2545] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:05:02 2022] POST /identity/v3/projects => generated 367 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:05:03.026316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12eff8-a390-4052-8982-0f79f07fc749 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:03.036030 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12eff8-a390-4052-8982-0f79f07fc749 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:03.040598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:03.092884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbb8dc-91c2-4fd7-be8e-9ba6fe0e02e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:03.094501 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbb8dc-91c2-4fd7-be8e-9ba6fe0e02e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:03.094501 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbb8dc-91c2-4fd7-be8e-9ba6fe0e02e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:03.094501 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbb8dc-91c2-4fd7-be8e-9ba6fe0e02e1 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:03.094771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbb8dc-91c2-4fd7-be8e-9ba6fe0e02e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:03.096593 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbb8dc-91c2-4fd7-be8e-9ba6fe0e02e1 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:03.173317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1279/2546] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:05:03 2022] POST /identity/v3/users => generated 284 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:05:03.177354 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34350ff5-c5ce-48ad-9eed-e4fd1b6ca7d2 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:03.187747 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34350ff5-c5ce-48ad-9eed-e4fd1b6ca7d2 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:03.192977 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e6805-a2af-4f84-b7ad-c972fb67021a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:03.193578 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e6805-a2af-4f84-b7ad-c972fb67021a admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:03.193862 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e6805-a2af-4f84-b7ad-c972fb67021a admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:03.194138 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e6805-a2af-4f84-b7ad-c972fb67021a admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:03.194783 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e6805-a2af-4f84-b7ad-c972fb67021a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:03.196388 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e6805-a2af-4f84-b7ad-c972fb67021a admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:03.207218 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1268/2547] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:03.210992 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbb8dc-91c2-4fd7-be8e-9ba6fe0e02e1 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:03.220946 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbb8dc-91c2-4fd7-be8e-9ba6fe0e02e1 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:03.225748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60d697-ba6e-442f-aed2-ad326ae3b820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:03.226338 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60d697-ba6e-442f-aed2-ad326ae3b820 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:03.226618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60d697-ba6e-442f-aed2-ad326ae3b820 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:03.226889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60d697-ba6e-442f-aed2-ad326ae3b820 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:03.227521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60d697-ba6e-442f-aed2-ad326ae3b820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:03.229143 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60d697-ba6e-442f-aed2-ad326ae3b820 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:03.239404 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1280/2548] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:03.243355 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e6805-a2af-4f84-b7ad-c972fb67021a admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:03.253553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e6805-a2af-4f84-b7ad-c972fb67021a admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:03.258199 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388cf3e-d04e-4ba9-ab93-ff2bd81ec449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:03.258832 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388cf3e-d04e-4ba9-ab93-ff2bd81ec449 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:03.259113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388cf3e-d04e-4ba9-ab93-ff2bd81ec449 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:03.259386 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388cf3e-d04e-4ba9-ab93-ff2bd81ec449 admin admin] PATH_INFO: `/v3/projects/106ba4507b8d42709b0c4bc3473f11af/users/7775b4c6045b44b8a2b06e9311ebe2c6/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:03.274164 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388cf3e-d04e-4ba9-ab93-ff2bd81ec449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=106ba4507b8d42709b0c4bc3473f11af, user_id=7775b4c6045b44b8a2b06e9311ebe2c6, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:03.276882 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388cf3e-d04e-4ba9-ab93-ff2bd81ec449 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:03.345906 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1269/2549] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:05:03 2022] PUT /identity/v3/projects/106ba4507b8d42709b0c4bc3473f11af/users/7775b4c6045b44b8a2b06e9311ebe2c6/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:03.357411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724697d-8493-4e13-97dd-fd106460c005 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:03.357697 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724697d-8493-4e13-97dd-fd106460c005 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:03.357970 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724697d-8493-4e13-97dd-fd106460c005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:03.386181 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-4724697d-8493-4e13-97dd-fd106460c005 None None] MFA Rules not processed for user `7775b4c6045b44b8a2b06e9311ebe2c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:03.387376 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4724697d-8493-4e13-97dd-fd106460c005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:03.452143 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1281/2550] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:03.456700 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388cf3e-d04e-4ba9-ab93-ff2bd81ec449 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:03.517889 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388cf3e-d04e-4ba9-ab93-ff2bd81ec449 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:03.522540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201e4bc-cfcc-4e1d-ada4-7c34269b737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:03.523148 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201e4bc-cfcc-4e1d-ada4-7c34269b737f admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:03.523427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201e4bc-cfcc-4e1d-ada4-7c34269b737f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:03.523724 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201e4bc-cfcc-4e1d-ada4-7c34269b737f admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:03.524327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201e4bc-cfcc-4e1d-ada4-7c34269b737f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:03.526274 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201e4bc-cfcc-4e1d-ada4-7c34269b737f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:03.607998 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1270/2551] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:05:03 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:05:03.612657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724697d-8493-4e13-97dd-fd106460c005 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:03.623322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724697d-8493-4e13-97dd-fd106460c005 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:03.677841 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee6f69-5592-4086-9067-ef0e10087ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:03.678453 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6f69-5592-4086-9067-ef0e10087ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:03.678737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6f69-5592-4086-9067-ef0e10087ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:03.679013 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6f69-5592-4086-9067-ef0e10087ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:03.679646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee6f69-5592-4086-9067-ef0e10087ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:03.681605 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee6f69-5592-4086-9067-ef0e10087ce1 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:03.755812 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1282/2552] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:05:03 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:05:03.760948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201e4bc-cfcc-4e1d-ada4-7c34269b737f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:03.771522 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201e4bc-cfcc-4e1d-ada4-7c34269b737f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:03.776153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aacb60-fc82-4f71-81a3-e541f7e9b991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:03.776812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aacb60-fc82-4f71-81a3-e541f7e9b991 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:03.777085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aacb60-fc82-4f71-81a3-e541f7e9b991 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:03.777356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aacb60-fc82-4f71-81a3-e541f7e9b991 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:03.778025 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aacb60-fc82-4f71-81a3-e541f7e9b991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:03.779627 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aacb60-fc82-4f71-81a3-e541f7e9b991 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:03.790777 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1271/2553] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:03.794970 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee6f69-5592-4086-9067-ef0e10087ce1 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:03.805473 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee6f69-5592-4086-9067-ef0e10087ce1 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:03.811557 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bc357-c534-4283-94d6-1938ca24b49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:03.811557 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bc357-c534-4283-94d6-1938ca24b49e admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:03.811557 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bc357-c534-4283-94d6-1938ca24b49e admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:03.811557 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bc357-c534-4283-94d6-1938ca24b49e admin admin] PATH_INFO: `/v3/projects/cf84a7ad73cb49b2980b292db6546134/users/5c007e7e5522412eba067a1fc28cf3bb/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:03.813358 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:03.825789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bc357-c534-4283-94d6-1938ca24b49e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf84a7ad73cb49b2980b292db6546134, user_id=5c007e7e5522412eba067a1fc28cf3bb, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:03.828440 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bc357-c534-4283-94d6-1938ca24b49e admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:03.916030 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1283/2554] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:05:03 2022] PUT /identity/v3/projects/cf84a7ad73cb49b2980b292db6546134/users/5c007e7e5522412eba067a1fc28cf3bb/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:03.920024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aacb60-fc82-4f71-81a3-e541f7e9b991 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:03.930736 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aacb60-fc82-4f71-81a3-e541f7e9b991 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:03.968525 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:03.988045 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e9486-c184-403d-b267-764971c71e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:03.988689 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e9486-c184-403d-b267-764971c71e8c admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:03.988967 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e9486-c184-403d-b267-764971c71e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:03.989236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e9486-c184-403d-b267-764971c71e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:03.989871 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e9486-c184-403d-b267-764971c71e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:03.991468 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e9486-c184-403d-b267-764971c71e8c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:04.000992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1272/2555] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:04.005307 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bc357-c534-4283-94d6-1938ca24b49e admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:04.015844 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bc357-c534-4283-94d6-1938ca24b49e admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:04.021059 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d436e9b-e230-40f4-b26f-e9db6eddfb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:04.021714 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d436e9b-e230-40f4-b26f-e9db6eddfb1c admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:04.022024 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d436e9b-e230-40f4-b26f-e9db6eddfb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:04.022296 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d436e9b-e230-40f4-b26f-e9db6eddfb1c admin admin] PATH_INFO: `/v3/projects/cf84a7ad73cb49b2980b292db6546134/users/5c007e7e5522412eba067a1fc28cf3bb/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:04.024215 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d436e9b-e230-40f4-b26f-e9db6eddfb1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf84a7ad73cb49b2980b292db6546134, user_id=5c007e7e5522412eba067a1fc28cf3bb, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:04.027027 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d436e9b-e230-40f4-b26f-e9db6eddfb1c admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:04.037797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1284/2556] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:05:04 2022] PUT /identity/v3/projects/cf84a7ad73cb49b2980b292db6546134/users/5c007e7e5522412eba067a1fc28cf3bb/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:04.047898 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49543e-6333-4393-b2d3-8c8849a4aa80 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:04.048184 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49543e-6333-4393-b2d3-8c8849a4aa80 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:04.048506 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49543e-6333-4393-b2d3-8c8849a4aa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:04.081084 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-5a49543e-6333-4393-b2d3-8c8849a4aa80 None None] MFA Rules not processed for user `5c007e7e5522412eba067a1fc28cf3bb`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:04.082482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5a49543e-6333-4393-b2d3-8c8849a4aa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:04.151662 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1273/2557] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:04.163677 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d436e9b-e230-40f4-b26f-e9db6eddfb1c admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:04.166666 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7d436e9b-e230-40f4-b26f-e9db6eddfb1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:04.221575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d436e9b-e230-40f4-b26f-e9db6eddfb1c admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:04.225512 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eca3d8-b3f3-4b7e-a769-dbadf3c3a4b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:04.226108 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eca3d8-b3f3-4b7e-a769-dbadf3c3a4b5 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:04.226386 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eca3d8-b3f3-4b7e-a769-dbadf3c3a4b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:04.229534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eca3d8-b3f3-4b7e-a769-dbadf3c3a4b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:04.235575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eca3d8-b3f3-4b7e-a769-dbadf3c3a4b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:04.237103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eca3d8-b3f3-4b7e-a769-dbadf3c3a4b5 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:04.246492 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1285/2558] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:05:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:05:07.060360 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49543e-6333-4393-b2d3-8c8849a4aa80 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:07.126602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49543e-6333-4393-b2d3-8c8849a4aa80 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:07.131437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc0f30-2db0-4ebf-b575-89526056d4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:07.132073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc0f30-2db0-4ebf-b575-89526056d4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:07.132350 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc0f30-2db0-4ebf-b575-89526056d4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:07.132648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc0f30-2db0-4ebf-b575-89526056d4a3 admin admin] PATH_INFO: `/v3/users/7775b4c6045b44b8a2b06e9311ebe2c6` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:07.133884 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc0f30-2db0-4ebf-b575-89526056d4a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7775b4c6045b44b8a2b06e9311ebe2c6)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:07.136229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc0f30-2db0-4ebf-b575-89526056d4a3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:07.311971 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-89cc0f30-2db0-4ebf-b575-89526056d4a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7775b4c6045b44b8a2b06e9311ebe2c6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:07.383955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-89cc0f30-2db0-4ebf-b575-89526056d4a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7775b4c6045b44b8a2b06e9311ebe2c6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:07.384665 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-89cc0f30-2db0-4ebf-b575-89526056d4a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7775b4c6045b44b8a2b06e9311ebe2c6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:07.385266 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-89cc0f30-2db0-4ebf-b575-89526056d4a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7775b4c6045b44b8a2b06e9311ebe2c6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:07.392147 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-89cc0f30-2db0-4ebf-b575-89526056d4a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7775b4c6045b44b8a2b06e9311ebe2c6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:07.393319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:07.409866 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1274/2559] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:05:07 2022] DELETE /identity/v3/users/7775b4c6045b44b8a2b06e9311ebe2c6 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:07.414399 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778dba2-39ff-4eb4-ad69-465abf1cb9d7 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:07.414855 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778dba2-39ff-4eb4-ad69-465abf1cb9d7 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:07.414971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778dba2-39ff-4eb4-ad69-465abf1cb9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:07.434450 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-3778dba2-39ff-4eb4-ad69-465abf1cb9d7 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:07.435681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3778dba2-39ff-4eb4-ad69-465abf1cb9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:07.494482 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1286/2560] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:07.507696 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc0f30-2db0-4ebf-b575-89526056d4a3 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:07.509095 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-89cc0f30-2db0-4ebf-b575-89526056d4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:07.567713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc0f30-2db0-4ebf-b575-89526056d4a3 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:07.571210 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f765f6-7645-4f1c-b88d-9585234d7c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:07.571816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f765f6-7645-4f1c-b88d-9585234d7c66 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:07.572091 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f765f6-7645-4f1c-b88d-9585234d7c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:07.572361 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f765f6-7645-4f1c-b88d-9585234d7c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:07.580966 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f765f6-7645-4f1c-b88d-9585234d7c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:07.582946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f765f6-7645-4f1c-b88d-9585234d7c66 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:07.592594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1275/2561] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:05:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:05:07.983464 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778dba2-39ff-4eb4-ad69-465abf1cb9d7 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:07.985065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3778dba2-39ff-4eb4-ad69-465abf1cb9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:08.014161 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778dba2-39ff-4eb4-ad69-465abf1cb9d7 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:08.017930 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64bb39-d9e4-45d8-adab-b7f9c68351d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:08.018574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64bb39-d9e4-45d8-adab-b7f9c68351d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:08.018900 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64bb39-d9e4-45d8-adab-b7f9c68351d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:08.019291 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64bb39-d9e4-45d8-adab-b7f9c68351d5 admin admin] PATH_INFO: `/v3/projects/106ba4507b8d42709b0c4bc3473f11af` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:08.020412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64bb39-d9e4-45d8-adab-b7f9c68351d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=106ba4507b8d42709b0c4bc3473f11af)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:08.022387 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64bb39-d9e4-45d8-adab-b7f9c68351d5 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:08.140199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9d64bb39-d9e4-45d8-adab-b7f9c68351d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '106ba4507b8d42709b0c4bc3473f11af', 'request_id': 'req-9d64bb39-d9e4-45d8-adab-b7f9c68351d5'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:08.146655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9d64bb39-d9e4-45d8-adab-b7f9c68351d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '106ba4507b8d42709b0c4bc3473f11af', 'request_id': 'req-9d64bb39-d9e4-45d8-adab-b7f9c68351d5'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:08.236184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9d64bb39-d9e4-45d8-adab-b7f9c68351d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '106ba4507b8d42709b0c4bc3473f11af', 'request_id': 'req-9d64bb39-d9e4-45d8-adab-b7f9c68351d5'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:08.242046 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:08.248395 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9d64bb39-d9e4-45d8-adab-b7f9c68351d5 admin admin] The token cache is being invalidate because project 106ba4507b8d42709b0c4bc3473f11af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:05:08.251403 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9d64bb39-d9e4-45d8-adab-b7f9c68351d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:08.251403 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9d64bb39-d9e4-45d8-adab-b7f9c68351d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:08.251403 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1287/2562] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:05:07 2022] DELETE /identity/v3/projects/106ba4507b8d42709b0c4bc3473f11af => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:08.255464 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f765f6-7645-4f1c-b88d-9585234d7c66 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:08.269281 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f765f6-7645-4f1c-b88d-9585234d7c66 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:08.326365 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4624548-5932-478f-972a-5875e9d5d11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:08.327141 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4624548-5932-478f-972a-5875e9d5d11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:08.327480 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4624548-5932-478f-972a-5875e9d5d11d admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:08.327761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4624548-5932-478f-972a-5875e9d5d11d admin admin] PATH_INFO: `/v3/users/5c007e7e5522412eba067a1fc28cf3bb` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:08.328947 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4624548-5932-478f-972a-5875e9d5d11d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c007e7e5522412eba067a1fc28cf3bb)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:08.330916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4624548-5932-478f-972a-5875e9d5d11d admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:08.494531 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e4624548-5932-478f-972a-5875e9d5d11d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c007e7e5522412eba067a1fc28cf3bb'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:08.569239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e4624548-5932-478f-972a-5875e9d5d11d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c007e7e5522412eba067a1fc28cf3bb'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:08.569873 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e4624548-5932-478f-972a-5875e9d5d11d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c007e7e5522412eba067a1fc28cf3bb'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:08.570476 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e4624548-5932-478f-972a-5875e9d5d11d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c007e7e5522412eba067a1fc28cf3bb'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:08.577573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-e4624548-5932-478f-972a-5875e9d5d11d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c007e7e5522412eba067a1fc28cf3bb'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:08.594459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1276/2563] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:05:08 2022] DELETE /identity/v3/users/5c007e7e5522412eba067a1fc28cf3bb => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:08.974147 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64bb39-d9e4-45d8-adab-b7f9c68351d5 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:08.975677 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9d64bb39-d9e4-45d8-adab-b7f9c68351d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:09.030383 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64bb39-d9e4-45d8-adab-b7f9c68351d5 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:09.078866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9ed86-0b51-4ae1-8520-d69d4456d3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:09.079529 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9ed86-0b51-4ae1-8520-d69d4456d3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:09.079819 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9ed86-0b51-4ae1-8520-d69d4456d3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:09.080088 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9ed86-0b51-4ae1-8520-d69d4456d3d6 admin admin] PATH_INFO: `/v3/projects/cf84a7ad73cb49b2980b292db6546134` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:09.081279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9ed86-0b51-4ae1-8520-d69d4456d3d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf84a7ad73cb49b2980b292db6546134)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:09.083300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9ed86-0b51-4ae1-8520-d69d4456d3d6 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:09.192827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-83e9ed86-0b51-4ae1-8520-d69d4456d3d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf84a7ad73cb49b2980b292db6546134', 'request_id': 'req-83e9ed86-0b51-4ae1-8520-d69d4456d3d6'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:09.198889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-83e9ed86-0b51-4ae1-8520-d69d4456d3d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf84a7ad73cb49b2980b292db6546134', 'request_id': 'req-83e9ed86-0b51-4ae1-8520-d69d4456d3d6'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:09.283447 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-83e9ed86-0b51-4ae1-8520-d69d4456d3d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf84a7ad73cb49b2980b292db6546134', 'request_id': 'req-83e9ed86-0b51-4ae1-8520-d69d4456d3d6'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:09.293657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-83e9ed86-0b51-4ae1-8520-d69d4456d3d6 admin admin] The token cache is being invalidate because project cf84a7ad73cb49b2980b292db6546134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:05:09.293948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-83e9ed86-0b51-4ae1-8520-d69d4456d3d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:09.294560 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-83e9ed86-0b51-4ae1-8520-d69d4456d3d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:09.296036 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1288/2564] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:05:08 2022] DELETE /identity/v3/projects/cf84a7ad73cb49b2980b292db6546134 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:09.302112 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597af549-90cb-4f38-af2e-8ea6e98b3f42 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:09.302600 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597af549-90cb-4f38-af2e-8ea6e98b3f42 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:09.302698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597af549-90cb-4f38-af2e-8ea6e98b3f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:09.307643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:09.333210 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-597af549-90cb-4f38-af2e-8ea6e98b3f42 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:09.334420 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-597af549-90cb-4f38-af2e-8ea6e98b3f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:09.394896 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1277/2565] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:09.402418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de7fbb-3717-4877-97a2-57176bb4a905 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:09.402708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de7fbb-3717-4877-97a2-57176bb4a905 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:09.402986 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de7fbb-3717-4877-97a2-57176bb4a905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:09.423166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-42de7fbb-3717-4877-97a2-57176bb4a905 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:09.424512 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-42de7fbb-3717-4877-97a2-57176bb4a905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:09.433058 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1289/2566] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:09.437355 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597af549-90cb-4f38-af2e-8ea6e98b3f42 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:09.447034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597af549-90cb-4f38-af2e-8ea6e98b3f42 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:09.451778 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da3609-64fa-43bf-bd8b-6b993c729fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:09.452384 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da3609-64fa-43bf-bd8b-6b993c729fde admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:09.452694 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da3609-64fa-43bf-bd8b-6b993c729fde admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:09.461100 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da3609-64fa-43bf-bd8b-6b993c729fde admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:09.461100 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da3609-64fa-43bf-bd8b-6b993c729fde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:05:09.461100 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da3609-64fa-43bf-bd8b-6b993c729fde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:09.461100 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da3609-64fa-43bf-bd8b-6b993c729fde admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:09.470205 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1278/2567] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 23:05:09.475550 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de7fbb-3717-4877-97a2-57176bb4a905 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:09.484703 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de7fbb-3717-4877-97a2-57176bb4a905 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:09.489898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f724be8-7c20-4ecf-8ac4-80e634ff8dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:09.490493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f724be8-7c20-4ecf-8ac4-80e634ff8dea admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:09.490779 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f724be8-7c20-4ecf-8ac4-80e634ff8dea admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:09.491052 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f724be8-7c20-4ecf-8ac4-80e634ff8dea admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:09.491705 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f724be8-7c20-4ecf-8ac4-80e634ff8dea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:09.493643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f724be8-7c20-4ecf-8ac4-80e634ff8dea admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:09.559962 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1290/2568] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:05:09 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:05:09.563623 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da3609-64fa-43bf-bd8b-6b993c729fde admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:09.573563 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da3609-64fa-43bf-bd8b-6b993c729fde admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:09.629367 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6e0a9-ac0c-440f-bbe0-cb98f396721c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:09.629975 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6e0a9-ac0c-440f-bbe0-cb98f396721c admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:09.630261 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6e0a9-ac0c-440f-bbe0-cb98f396721c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:09.630556 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6e0a9-ac0c-440f-bbe0-cb98f396721c admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:09.631178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6e0a9-ac0c-440f-bbe0-cb98f396721c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:09.633160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6e0a9-ac0c-440f-bbe0-cb98f396721c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:09.701151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1279/2569] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:05:09 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:05:09.705226 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f724be8-7c20-4ecf-8ac4-80e634ff8dea admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:09.715876 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f724be8-7c20-4ecf-8ac4-80e634ff8dea admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:09.720508 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d21ed-4d99-48a7-b3a2-2402e9442250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:09.721040 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d21ed-4d99-48a7-b3a2-2402e9442250 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:09.721331 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d21ed-4d99-48a7-b3a2-2402e9442250 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:09.721589 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d21ed-4d99-48a7-b3a2-2402e9442250 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:09.723092 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d21ed-4d99-48a7-b3a2-2402e9442250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:09.724699 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d21ed-4d99-48a7-b3a2-2402e9442250 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:09.734830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1291/2570] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 23:05:09.739048 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6e0a9-ac0c-440f-bbe0-cb98f396721c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:09.748911 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6e0a9-ac0c-440f-bbe0-cb98f396721c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:09.753516 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7befcaa-1533-4a40-a7f8-a1dbffbdb0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:09.754089 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7befcaa-1533-4a40-a7f8-a1dbffbdb0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:09.754365 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7befcaa-1533-4a40-a7f8-a1dbffbdb0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:09.754637 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7befcaa-1533-4a40-a7f8-a1dbffbdb0e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:09.755270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7befcaa-1533-4a40-a7f8-a1dbffbdb0e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:09.756901 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7befcaa-1533-4a40-a7f8-a1dbffbdb0e7 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:09.767185 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1280/2571] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:09.771703 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d21ed-4d99-48a7-b3a2-2402e9442250 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:09.781726 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d21ed-4d99-48a7-b3a2-2402e9442250 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:09.786800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de73e5-543d-4e5c-9c40-f4c9a46e7368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:09.787435 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de73e5-543d-4e5c-9c40-f4c9a46e7368 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:09.787738 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de73e5-543d-4e5c-9c40-f4c9a46e7368 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:09.788006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de73e5-543d-4e5c-9c40-f4c9a46e7368 admin admin] PATH_INFO: `/v3/projects/16cb99746aac4615b9bdf88d071d142d/users/5cfa2fc9679e4d5ab472d718906f649e/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:09.798676 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:09.805346 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de73e5-543d-4e5c-9c40-f4c9a46e7368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16cb99746aac4615b9bdf88d071d142d, user_id=5cfa2fc9679e4d5ab472d718906f649e, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:09.806912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de73e5-543d-4e5c-9c40-f4c9a46e7368 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:09.900093 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1292/2572] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:05:09 2022] PUT /identity/v3/projects/16cb99746aac4615b9bdf88d071d142d/users/5cfa2fc9679e4d5ab472d718906f649e/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:09.911955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e6611-d83f-4861-9d15-ba6d803d079d None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:09.912244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e6611-d83f-4861-9d15-ba6d803d079d None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:09.912554 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e6611-d83f-4861-9d15-ba6d803d079d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:09.940559 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-dd1e6611-d83f-4861-9d15-ba6d803d079d None None] MFA Rules not processed for user `5cfa2fc9679e4d5ab472d718906f649e`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:09.941807 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-dd1e6611-d83f-4861-9d15-ba6d803d079d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:09.989006 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:10.005670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1281/2573] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:10.010145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de73e5-543d-4e5c-9c40-f4c9a46e7368 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:10.071518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de73e5-543d-4e5c-9c40-f4c9a46e7368 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:10.076161 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a778028-d425-4118-b55a-e1981c907bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:10.076803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a778028-d425-4118-b55a-e1981c907bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:10.077089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a778028-d425-4118-b55a-e1981c907bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:10.077367 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a778028-d425-4118-b55a-e1981c907bc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:10.078010 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a778028-d425-4118-b55a-e1981c907bc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:10.079908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a778028-d425-4118-b55a-e1981c907bc4 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:10.182043 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1293/2574] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:05:10 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:05:10.186088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e6611-d83f-4861-9d15-ba6d803d079d None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:10.215728 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e6611-d83f-4861-9d15-ba6d803d079d None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:10.270921 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c791ff-e175-43bd-b683-25c991280933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:10.271534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c791ff-e175-43bd-b683-25c991280933 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:10.271816 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c791ff-e175-43bd-b683-25c991280933 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:10.272121 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c791ff-e175-43bd-b683-25c991280933 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:10.272784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c791ff-e175-43bd-b683-25c991280933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:10.274785 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c791ff-e175-43bd-b683-25c991280933 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:10.352277 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1282/2575] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:05:10 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:05:10.356448 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a778028-d425-4118-b55a-e1981c907bc4 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:10.376026 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a778028-d425-4118-b55a-e1981c907bc4 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:10.381156 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054aa718-62c6-4658-b631-db6c962c9fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:10.381748 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aa718-62c6-4658-b631-db6c962c9fbd admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:10.382025 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aa718-62c6-4658-b631-db6c962c9fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:10.382294 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aa718-62c6-4658-b631-db6c962c9fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:10.382920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054aa718-62c6-4658-b631-db6c962c9fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:10.384819 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054aa718-62c6-4658-b631-db6c962c9fbd admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:10.395389 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1294/2576] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:10.399361 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c791ff-e175-43bd-b683-25c991280933 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:10.409239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c791ff-e175-43bd-b683-25c991280933 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:10.413815 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37bc84-9d70-4d7f-b6a4-be6dd7487591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:10.414406 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37bc84-9d70-4d7f-b6a4-be6dd7487591 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:10.414687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37bc84-9d70-4d7f-b6a4-be6dd7487591 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:10.414965 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37bc84-9d70-4d7f-b6a4-be6dd7487591 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:10.415607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37bc84-9d70-4d7f-b6a4-be6dd7487591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:10.417241 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37bc84-9d70-4d7f-b6a4-be6dd7487591 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:10.428252 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1283/2577] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:10.431492 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054aa718-62c6-4658-b631-db6c962c9fbd admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:10.441675 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054aa718-62c6-4658-b631-db6c962c9fbd admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:10.446126 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e518757-aa23-4272-896b-fe21792b1a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:10.446759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e518757-aa23-4272-896b-fe21792b1a89 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:10.447035 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e518757-aa23-4272-896b-fe21792b1a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:10.447307 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e518757-aa23-4272-896b-fe21792b1a89 admin admin] PATH_INFO: `/v3/projects/68669845454f42a6a47f9843e81772f4/users/a0ee85a7f3bc46b1a09db3525ff937ab/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:10.461452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e518757-aa23-4272-896b-fe21792b1a89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68669845454f42a6a47f9843e81772f4, user_id=a0ee85a7f3bc46b1a09db3525ff937ab, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:10.464088 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e518757-aa23-4272-896b-fe21792b1a89 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:10.546934 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1295/2578] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:05:10 2022] PUT /identity/v3/projects/68669845454f42a6a47f9843e81772f4/users/a0ee85a7f3bc46b1a09db3525ff937ab/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:10.558200 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbd07a-08cb-44c4-b40c-8dddb1ca937b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:10.558569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbd07a-08cb-44c4-b40c-8dddb1ca937b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:10.558913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbd07a-08cb-44c4-b40c-8dddb1ca937b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:10.588044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7dcbd07a-08cb-44c4-b40c-8dddb1ca937b None None] MFA Rules not processed for user `a0ee85a7f3bc46b1a09db3525ff937ab`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:10.589280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7dcbd07a-08cb-44c4-b40c-8dddb1ca937b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:10.655963 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1284/2579] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:10.660484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e518757-aa23-4272-896b-fe21792b1a89 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:10.720739 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e518757-aa23-4272-896b-fe21792b1a89 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:10.725557 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7f36a-008a-4f91-9ec6-aa292047d293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:10.726155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7f36a-008a-4f91-9ec6-aa292047d293 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:10.726431 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7f36a-008a-4f91-9ec6-aa292047d293 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:10.726700 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7f36a-008a-4f91-9ec6-aa292047d293 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:10.727319 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7f36a-008a-4f91-9ec6-aa292047d293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:10.729215 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7f36a-008a-4f91-9ec6-aa292047d293 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:10.816808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1296/2580] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:05:10 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:05:10.820843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbd07a-08cb-44c4-b40c-8dddb1ca937b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:10.831295 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbd07a-08cb-44c4-b40c-8dddb1ca937b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:10.870792 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:10.886386 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a18034-2b39-4eb7-a69e-6a079b11c233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:10.886986 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a18034-2b39-4eb7-a69e-6a079b11c233 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:10.887264 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a18034-2b39-4eb7-a69e-6a079b11c233 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:10.887533 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a18034-2b39-4eb7-a69e-6a079b11c233 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:10.888162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a18034-2b39-4eb7-a69e-6a079b11c233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:10.890142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a18034-2b39-4eb7-a69e-6a079b11c233 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:10.986507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1285/2581] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:05:10 2022] POST /identity/v3/users => generated 300 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:05:10.991014 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7f36a-008a-4f91-9ec6-aa292047d293 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:10.997518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:11.001180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7f36a-008a-4f91-9ec6-aa292047d293 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:11.006038 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510e1ee-9d61-4a88-8a14-13c0becf06f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:11.006643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510e1ee-9d61-4a88-8a14-13c0becf06f8 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:11.006926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510e1ee-9d61-4a88-8a14-13c0becf06f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:11.007206 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510e1ee-9d61-4a88-8a14-13c0becf06f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:11.007847 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510e1ee-9d61-4a88-8a14-13c0becf06f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:11.009485 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510e1ee-9d61-4a88-8a14-13c0becf06f8 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:11.019984 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1297/2582] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:11.026341 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a18034-2b39-4eb7-a69e-6a079b11c233 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:11.036825 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a18034-2b39-4eb7-a69e-6a079b11c233 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:11.041494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fda02-24db-42f3-95d7-b8c6bc6ca5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:11.042148 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fda02-24db-42f3-95d7-b8c6bc6ca5eb admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:11.042429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fda02-24db-42f3-95d7-b8c6bc6ca5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:11.042706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fda02-24db-42f3-95d7-b8c6bc6ca5eb admin admin] PATH_INFO: `/v3/projects/122c2a517d24447aadc69d6b19edf4cf/users/23f060e15c8145d0afac9f434998f962/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:11.059125 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fda02-24db-42f3-95d7-b8c6bc6ca5eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=122c2a517d24447aadc69d6b19edf4cf, user_id=23f060e15c8145d0afac9f434998f962, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:11.063572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fda02-24db-42f3-95d7-b8c6bc6ca5eb admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:11.141402 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1286/2583] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:05:11 2022] PUT /identity/v3/projects/122c2a517d24447aadc69d6b19edf4cf/users/23f060e15c8145d0afac9f434998f962/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:11.145421 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510e1ee-9d61-4a88-8a14-13c0becf06f8 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:11.155212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510e1ee-9d61-4a88-8a14-13c0becf06f8 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:11.214140 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcf59c-30ac-48fc-a53b-fdc63ef0e513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:11.214753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcf59c-30ac-48fc-a53b-fdc63ef0e513 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:11.215033 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcf59c-30ac-48fc-a53b-fdc63ef0e513 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:11.215310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcf59c-30ac-48fc-a53b-fdc63ef0e513 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:11.215945 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcf59c-30ac-48fc-a53b-fdc63ef0e513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:11.217628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcf59c-30ac-48fc-a53b-fdc63ef0e513 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:11.228499 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1298/2584] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:11.232783 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fda02-24db-42f3-95d7-b8c6bc6ca5eb admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:11.243000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fda02-24db-42f3-95d7-b8c6bc6ca5eb admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:11.247471 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcf280-de89-4c6a-a5fd-cc78b0b68416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:11.248116 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcf280-de89-4c6a-a5fd-cc78b0b68416 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:11.248395 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcf280-de89-4c6a-a5fd-cc78b0b68416 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:11.248698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcf280-de89-4c6a-a5fd-cc78b0b68416 admin admin] PATH_INFO: `/v3/projects/122c2a517d24447aadc69d6b19edf4cf/users/23f060e15c8145d0afac9f434998f962/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:11.250604 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdcf280-de89-4c6a-a5fd-cc78b0b68416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=122c2a517d24447aadc69d6b19edf4cf, user_id=23f060e15c8145d0afac9f434998f962, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:11.253338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdcf280-de89-4c6a-a5fd-cc78b0b68416 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:11.263384 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1287/2585] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:05:11 2022] PUT /identity/v3/projects/122c2a517d24447aadc69d6b19edf4cf/users/23f060e15c8145d0afac9f434998f962/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:11.274801 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ae935-6b16-4a13-be3f-4d0d698619c1 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:11.275094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ae935-6b16-4a13-be3f-4d0d698619c1 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:11.275373 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ae935-6b16-4a13-be3f-4d0d698619c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:11.304103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-467ae935-6b16-4a13-be3f-4d0d698619c1 None None] MFA Rules not processed for user `23f060e15c8145d0afac9f434998f962`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:11.305380 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-467ae935-6b16-4a13-be3f-4d0d698619c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:11.373024 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1299/2586] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:11.383919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcf280-de89-4c6a-a5fd-cc78b0b68416 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:11.385791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8fdcf280-de89-4c6a-a5fd-cc78b0b68416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:11.458298 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcf280-de89-4c6a-a5fd-cc78b0b68416 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:11.461899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402610e-29cf-4eb6-be77-c2c63f4958c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:11.462497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402610e-29cf-4eb6-be77-c2c63f4958c4 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:11.462783 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402610e-29cf-4eb6-be77-c2c63f4958c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:11.463045 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402610e-29cf-4eb6-be77-c2c63f4958c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:11.471741 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402610e-29cf-4eb6-be77-c2c63f4958c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:11.473496 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402610e-29cf-4eb6-be77-c2c63f4958c4 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:11.482678 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1288/2587] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:05:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:05:12.534791 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ae935-6b16-4a13-be3f-4d0d698619c1 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:12.536214 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-467ae935-6b16-4a13-be3f-4d0d698619c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:12.547791 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ae935-6b16-4a13-be3f-4d0d698619c1 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:12.551293 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbadf63-00d8-4037-aa8c-cbdd3fe5c6b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:12.551888 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbadf63-00d8-4037-aa8c-cbdd3fe5c6b9 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:12.552164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbadf63-00d8-4037-aa8c-cbdd3fe5c6b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:12.552452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbadf63-00d8-4037-aa8c-cbdd3fe5c6b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:12.615442 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbadf63-00d8-4037-aa8c-cbdd3fe5c6b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:12.617234 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbadf63-00d8-4037-aa8c-cbdd3fe5c6b9 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:12.627705 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1300/2588] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:05:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:05:17.551788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402610e-29cf-4eb6-be77-c2c63f4958c4 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:17.561450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402610e-29cf-4eb6-be77-c2c63f4958c4 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:17.565283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235393d9-8249-4d2c-85b4-df6f7aabb3d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:17.568350 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235393d9-8249-4d2c-85b4-df6f7aabb3d0 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:17.568350 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235393d9-8249-4d2c-85b4-df6f7aabb3d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:17.568350 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235393d9-8249-4d2c-85b4-df6f7aabb3d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:17.625691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235393d9-8249-4d2c-85b4-df6f7aabb3d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:17.627127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235393d9-8249-4d2c-85b4-df6f7aabb3d0 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:17.637696 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1289/2589] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:05:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:05:21.496532 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbadf63-00d8-4037-aa8c-cbdd3fe5c6b9 service cinder] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:21.509439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:21.558063 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbadf63-00d8-4037-aa8c-cbdd3fe5c6b9 service cinder] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:21.562646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26366c3-d0a0-4b60-8e18-8d85ecab1509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:21.563272 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26366c3-d0a0-4b60-8e18-8d85ecab1509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:21.563548 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26366c3-d0a0-4b60-8e18-8d85ecab1509 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:21.563816 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26366c3-d0a0-4b60-8e18-8d85ecab1509 admin admin] PATH_INFO: `/v3/users/5cfa2fc9679e4d5ab472d718906f649e` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:21.564966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26366c3-d0a0-4b60-8e18-8d85ecab1509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cfa2fc9679e4d5ab472d718906f649e)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:21.566910 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26366c3-d0a0-4b60-8e18-8d85ecab1509 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:21.776526 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-a26366c3-d0a0-4b60-8e18-8d85ecab1509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cfa2fc9679e4d5ab472d718906f649e'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:21.855566 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-a26366c3-d0a0-4b60-8e18-8d85ecab1509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cfa2fc9679e4d5ab472d718906f649e'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:21.856184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-a26366c3-d0a0-4b60-8e18-8d85ecab1509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cfa2fc9679e4d5ab472d718906f649e'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:21.869060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-a26366c3-d0a0-4b60-8e18-8d85ecab1509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cfa2fc9679e4d5ab472d718906f649e'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:21.869735 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-a26366c3-d0a0-4b60-8e18-8d85ecab1509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cfa2fc9679e4d5ab472d718906f649e'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:21.882684 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1301/2590] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:05:21 2022] DELETE /identity/v3/users/5cfa2fc9679e4d5ab472d718906f649e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:21.887464 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b5b1e-6c7b-47ea-a20b-1f137d78dada None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:21.888088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b5b1e-6c7b-47ea-a20b-1f137d78dada None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:21.888088 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b5b1e-6c7b-47ea-a20b-1f137d78dada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:21.919007 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4d4b5b1e-6c7b-47ea-a20b-1f137d78dada None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:21.920217 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4d4b5b1e-6c7b-47ea-a20b-1f137d78dada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:21.928211 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:21.980097 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1290/2591] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:21.989834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26366c3-d0a0-4b60-8e18-8d85ecab1509 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:21.991261 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-a26366c3-d0a0-4b60-8e18-8d85ecab1509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:22.048756 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26366c3-d0a0-4b60-8e18-8d85ecab1509 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:22.052234 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23456b-d266-4d86-81ef-40b9c0f97132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:22.052864 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23456b-d266-4d86-81ef-40b9c0f97132 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:22.053139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23456b-d266-4d86-81ef-40b9c0f97132 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:22.053411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23456b-d266-4d86-81ef-40b9c0f97132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:22.062272 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23456b-d266-4d86-81ef-40b9c0f97132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:22.063675 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23456b-d266-4d86-81ef-40b9c0f97132 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:22.074181 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1302/2592] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:05:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:05:22.475354 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b5b1e-6c7b-47ea-a20b-1f137d78dada None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:22.476965 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4d4b5b1e-6c7b-47ea-a20b-1f137d78dada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:22.489730 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b5b1e-6c7b-47ea-a20b-1f137d78dada None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:22.495547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ba3b2-9519-42a4-ba11-3d9c1d0669fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:22.496178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ba3b2-9519-42a4-ba11-3d9c1d0669fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:22.496479 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ba3b2-9519-42a4-ba11-3d9c1d0669fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:22.496756 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ba3b2-9519-42a4-ba11-3d9c1d0669fd admin admin] PATH_INFO: `/v3/projects/16cb99746aac4615b9bdf88d071d142d` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:22.497985 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ba3b2-9519-42a4-ba11-3d9c1d0669fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=16cb99746aac4615b9bdf88d071d142d)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:22.499861 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ba3b2-9519-42a4-ba11-3d9c1d0669fd admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:22.603708 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-693ba3b2-9519-42a4-ba11-3d9c1d0669fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16cb99746aac4615b9bdf88d071d142d', 'request_id': 'req-693ba3b2-9519-42a4-ba11-3d9c1d0669fd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:22.610039 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-693ba3b2-9519-42a4-ba11-3d9c1d0669fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16cb99746aac4615b9bdf88d071d142d', 'request_id': 'req-693ba3b2-9519-42a4-ba11-3d9c1d0669fd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:22.696463 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-693ba3b2-9519-42a4-ba11-3d9c1d0669fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16cb99746aac4615b9bdf88d071d142d', 'request_id': 'req-693ba3b2-9519-42a4-ba11-3d9c1d0669fd'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:22.707459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-693ba3b2-9519-42a4-ba11-3d9c1d0669fd admin admin] The token cache is being invalidate because project 16cb99746aac4615b9bdf88d071d142d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:05:22.707778 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-693ba3b2-9519-42a4-ba11-3d9c1d0669fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:22.708404 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-693ba3b2-9519-42a4-ba11-3d9c1d0669fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:22.709949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1291/2593] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:05:22 2022] DELETE /identity/v3/projects/16cb99746aac4615b9bdf88d071d142d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:22.713973 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23456b-d266-4d86-81ef-40b9c0f97132 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:22.723988 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23456b-d266-4d86-81ef-40b9c0f97132 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:22.756705 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:22.779474 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e5a6f-7de4-4dd0-9d62-9d956df43888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:22.780100 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e5a6f-7de4-4dd0-9d62-9d956df43888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:22.780377 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e5a6f-7de4-4dd0-9d62-9d956df43888 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:22.792148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e5a6f-7de4-4dd0-9d62-9d956df43888 admin admin] PATH_INFO: `/v3/users/a0ee85a7f3bc46b1a09db3525ff937ab` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:22.792148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e5a6f-7de4-4dd0-9d62-9d956df43888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ee85a7f3bc46b1a09db3525ff937ab)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:22.792148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e5a6f-7de4-4dd0-9d62-9d956df43888 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:22.998253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-840e5a6f-7de4-4dd0-9d62-9d956df43888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ee85a7f3bc46b1a09db3525ff937ab'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:23.087601 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-840e5a6f-7de4-4dd0-9d62-9d956df43888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ee85a7f3bc46b1a09db3525ff937ab'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:23.088146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-840e5a6f-7de4-4dd0-9d62-9d956df43888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ee85a7f3bc46b1a09db3525ff937ab'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:23.101448 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-840e5a6f-7de4-4dd0-9d62-9d956df43888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ee85a7f3bc46b1a09db3525ff937ab'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:23.111148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-840e5a6f-7de4-4dd0-9d62-9d956df43888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ee85a7f3bc46b1a09db3525ff937ab'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:23.115310 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1303/2594] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:05:22 2022] DELETE /identity/v3/users/a0ee85a7f3bc46b1a09db3525ff937ab => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:23.509521 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ba3b2-9519-42a4-ba11-3d9c1d0669fd admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:23.511691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-693ba3b2-9519-42a4-ba11-3d9c1d0669fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:23.528909 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ba3b2-9519-42a4-ba11-3d9c1d0669fd admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:23.596228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbfa58-3943-42c2-b19f-ba534290e717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:23.598613 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbfa58-3943-42c2-b19f-ba534290e717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:23.598613 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbfa58-3943-42c2-b19f-ba534290e717 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:23.598613 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbfa58-3943-42c2-b19f-ba534290e717 admin admin] PATH_INFO: `/v3/projects/68669845454f42a6a47f9843e81772f4` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:23.598613 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbfa58-3943-42c2-b19f-ba534290e717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68669845454f42a6a47f9843e81772f4)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:23.600879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbfa58-3943-42c2-b19f-ba534290e717 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:23.679240 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:23.690360 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-30fbfa58-3943-42c2-b19f-ba534290e717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68669845454f42a6a47f9843e81772f4', 'request_id': 'req-30fbfa58-3943-42c2-b19f-ba534290e717'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:23.697372 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-30fbfa58-3943-42c2-b19f-ba534290e717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68669845454f42a6a47f9843e81772f4', 'request_id': 'req-30fbfa58-3943-42c2-b19f-ba534290e717'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:23.761815 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-30fbfa58-3943-42c2-b19f-ba534290e717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68669845454f42a6a47f9843e81772f4', 'request_id': 'req-30fbfa58-3943-42c2-b19f-ba534290e717'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:23.774503 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-30fbfa58-3943-42c2-b19f-ba534290e717 admin admin] The token cache is being invalidate because project 68669845454f42a6a47f9843e81772f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:05:23.775881 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-30fbfa58-3943-42c2-b19f-ba534290e717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:23.776739 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-30fbfa58-3943-42c2-b19f-ba534290e717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:23.778322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1292/2595] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:05:23 2022] DELETE /identity/v3/projects/68669845454f42a6a47f9843e81772f4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 23:05:23.783195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e5a6f-7de4-4dd0-9d62-9d956df43888 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:23.785264 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-840e5a6f-7de4-4dd0-9d62-9d956df43888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:23.798824 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e5a6f-7de4-4dd0-9d62-9d956df43888 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:23.857169 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16074ee-a9d5-4a25-a3fa-508bd56529c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:23.857809 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16074ee-a9d5-4a25-a3fa-508bd56529c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:23.858091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16074ee-a9d5-4a25-a3fa-508bd56529c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:23.858365 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16074ee-a9d5-4a25-a3fa-508bd56529c3 admin admin] PATH_INFO: `/v3/users/23f060e15c8145d0afac9f434998f962` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:23.859478 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16074ee-a9d5-4a25-a3fa-508bd56529c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f060e15c8145d0afac9f434998f962)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:23.861447 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16074ee-a9d5-4a25-a3fa-508bd56529c3 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:24.046817 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b16074ee-a9d5-4a25-a3fa-508bd56529c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f060e15c8145d0afac9f434998f962'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:24.107602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b16074ee-a9d5-4a25-a3fa-508bd56529c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f060e15c8145d0afac9f434998f962'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:24.108232 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b16074ee-a9d5-4a25-a3fa-508bd56529c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f060e15c8145d0afac9f434998f962'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:24.110534 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:24.121827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b16074ee-a9d5-4a25-a3fa-508bd56529c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f060e15c8145d0afac9f434998f962'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:24.122475 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-b16074ee-a9d5-4a25-a3fa-508bd56529c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f060e15c8145d0afac9f434998f962'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:24.135146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1304/2596] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:05:23 2022] DELETE /identity/v3/users/23f060e15c8145d0afac9f434998f962 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:24.508684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbfa58-3943-42c2-b19f-ba534290e717 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:24.510211 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-30fbfa58-3943-42c2-b19f-ba534290e717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:24.522987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbfa58-3943-42c2-b19f-ba534290e717 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:24.580045 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1617b2-c5bc-40a4-bb2e-3c006522e257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:24.580721 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1617b2-c5bc-40a4-bb2e-3c006522e257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:24.581007 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1617b2-c5bc-40a4-bb2e-3c006522e257 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:24.581283 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1617b2-c5bc-40a4-bb2e-3c006522e257 admin admin] PATH_INFO: `/v3/projects/122c2a517d24447aadc69d6b19edf4cf` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:24.582395 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1617b2-c5bc-40a4-bb2e-3c006522e257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=122c2a517d24447aadc69d6b19edf4cf)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:24.584695 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1617b2-c5bc-40a4-bb2e-3c006522e257 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:24.689098 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5f1617b2-c5bc-40a4-bb2e-3c006522e257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '122c2a517d24447aadc69d6b19edf4cf', 'request_id': 'req-5f1617b2-c5bc-40a4-bb2e-3c006522e257'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:24.695112 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5f1617b2-c5bc-40a4-bb2e-3c006522e257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '122c2a517d24447aadc69d6b19edf4cf', 'request_id': 'req-5f1617b2-c5bc-40a4-bb2e-3c006522e257'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:24.786884 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5f1617b2-c5bc-40a4-bb2e-3c006522e257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '122c2a517d24447aadc69d6b19edf4cf', 'request_id': 'req-5f1617b2-c5bc-40a4-bb2e-3c006522e257'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:24.798033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5f1617b2-c5bc-40a4-bb2e-3c006522e257 admin admin] The token cache is being invalidate because project 122c2a517d24447aadc69d6b19edf4cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:05:24.802153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5f1617b2-c5bc-40a4-bb2e-3c006522e257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:24.802153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5f1617b2-c5bc-40a4-bb2e-3c006522e257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:24.802153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1293/2597] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:05:24 2022] DELETE /identity/v3/projects/122c2a517d24447aadc69d6b19edf4cf => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:24.806223 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc449067-1515-4b3c-a27b-c2b15fc4de23 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:24.806684 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc449067-1515-4b3c-a27b-c2b15fc4de23 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:24.806778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc449067-1515-4b3c-a27b-c2b15fc4de23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:24.845604 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-dc449067-1515-4b3c-a27b-c2b15fc4de23 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:24.846817 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-dc449067-1515-4b3c-a27b-c2b15fc4de23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:24.908440 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1305/2598] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:24.918216 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed39db-8b8b-456a-93db-c2c685af1962 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:24.918496 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed39db-8b8b-456a-93db-c2c685af1962 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:24.918767 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed39db-8b8b-456a-93db-c2c685af1962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:24.938912 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-bbed39db-8b8b-456a-93db-c2c685af1962 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:24.940105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-bbed39db-8b8b-456a-93db-c2c685af1962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:24.948179 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1294/2599] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:24.952302 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc449067-1515-4b3c-a27b-c2b15fc4de23 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:24.962625 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc449067-1515-4b3c-a27b-c2b15fc4de23 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:24.967110 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227b2fa-051a-4f17-8984-b329272526c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:24.967703 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227b2fa-051a-4f17-8984-b329272526c5 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:24.967977 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227b2fa-051a-4f17-8984-b329272526c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:24.968245 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227b2fa-051a-4f17-8984-b329272526c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:24.968917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227b2fa-051a-4f17-8984-b329272526c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:05:24.969220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227b2fa-051a-4f17-8984-b329272526c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:24.970811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227b2fa-051a-4f17-8984-b329272526c5 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:24.983137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1306/2600] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 23:05:24.987441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed39db-8b8b-456a-93db-c2c685af1962 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:24.996831 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed39db-8b8b-456a-93db-c2c685af1962 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:25.001526 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a574e-8554-4b8a-9169-81ca703ae80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:25.002157 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a574e-8554-4b8a-9169-81ca703ae80d admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:25.002431 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a574e-8554-4b8a-9169-81ca703ae80d admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:25.002701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a574e-8554-4b8a-9169-81ca703ae80d admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:25.003326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a574e-8554-4b8a-9169-81ca703ae80d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:25.005262 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a574e-8554-4b8a-9169-81ca703ae80d admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:25.103037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1295/2601] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:05:24 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:05:25.109350 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227b2fa-051a-4f17-8984-b329272526c5 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:25.119548 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227b2fa-051a-4f17-8984-b329272526c5 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:25.176029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569769e-6c23-49dc-bc94-a62608c9e495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:25.176679 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569769e-6c23-49dc-bc94-a62608c9e495 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:25.177079 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569769e-6c23-49dc-bc94-a62608c9e495 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:25.177358 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569769e-6c23-49dc-bc94-a62608c9e495 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:25.177997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569769e-6c23-49dc-bc94-a62608c9e495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:25.179941 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569769e-6c23-49dc-bc94-a62608c9e495 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:25.243969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1307/2602] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:05:25 2022] POST /identity/v3/users => generated 294 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:05:25.248082 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a574e-8554-4b8a-9169-81ca703ae80d admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:25.258941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a574e-8554-4b8a-9169-81ca703ae80d admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:25.263566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63050c5-cf28-4d5d-830b-57be2cd60e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:25.264163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63050c5-cf28-4d5d-830b-57be2cd60e1c admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:25.264477 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63050c5-cf28-4d5d-830b-57be2cd60e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:25.264758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63050c5-cf28-4d5d-830b-57be2cd60e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:25.265399 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63050c5-cf28-4d5d-830b-57be2cd60e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:25.267012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63050c5-cf28-4d5d-830b-57be2cd60e1c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:25.277387 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1296/2603] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:25.281136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569769e-6c23-49dc-bc94-a62608c9e495 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:25.290821 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569769e-6c23-49dc-bc94-a62608c9e495 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:25.295437 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b065f-ed2a-4a70-9f0e-94aebd0d0451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:25.296039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b065f-ed2a-4a70-9f0e-94aebd0d0451 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:25.296330 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b065f-ed2a-4a70-9f0e-94aebd0d0451 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:25.296623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b065f-ed2a-4a70-9f0e-94aebd0d0451 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:25.297252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b065f-ed2a-4a70-9f0e-94aebd0d0451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:25.298854 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b065f-ed2a-4a70-9f0e-94aebd0d0451 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:25.309153 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1308/2604] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:25.313105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63050c5-cf28-4d5d-830b-57be2cd60e1c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:25.323428 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63050c5-cf28-4d5d-830b-57be2cd60e1c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:25.328034 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623207c1-421e-412f-ae4b-dd761c27fd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:25.328697 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623207c1-421e-412f-ae4b-dd761c27fd24 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:25.328980 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623207c1-421e-412f-ae4b-dd761c27fd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:25.329251 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623207c1-421e-412f-ae4b-dd761c27fd24 admin admin] PATH_INFO: `/v3/projects/d724298641b347b0bddc76c613d54b10/users/6926548788674866aa53c1da5386530b/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:25.344264 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623207c1-421e-412f-ae4b-dd761c27fd24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d724298641b347b0bddc76c613d54b10, user_id=6926548788674866aa53c1da5386530b, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:25.346936 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623207c1-421e-412f-ae4b-dd761c27fd24 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:25.349454 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:25.421276 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1297/2605] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:05:25 2022] PUT /identity/v3/projects/d724298641b347b0bddc76c613d54b10/users/6926548788674866aa53c1da5386530b/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:25.433133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a55a30-915e-41e2-a7c1-0cc3f788b38f None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:25.433415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a55a30-915e-41e2-a7c1-0cc3f788b38f None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:25.435966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a55a30-915e-41e2-a7c1-0cc3f788b38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:25.461419 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-f5a55a30-915e-41e2-a7c1-0cc3f788b38f None None] MFA Rules not processed for user `6926548788674866aa53c1da5386530b`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:25.464627 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f5a55a30-915e-41e2-a7c1-0cc3f788b38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:25.474805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:25.528495 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1309/2606] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:25.532955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623207c1-421e-412f-ae4b-dd761c27fd24 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:25.594027 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623207c1-421e-412f-ae4b-dd761c27fd24 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:25.598681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839e537-5f66-4264-b7e4-967b5ffddb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:25.599469 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839e537-5f66-4264-b7e4-967b5ffddb2e admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:25.599744 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839e537-5f66-4264-b7e4-967b5ffddb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:25.600010 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839e537-5f66-4264-b7e4-967b5ffddb2e admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:25.600688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839e537-5f66-4264-b7e4-967b5ffddb2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:25.602602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839e537-5f66-4264-b7e4-967b5ffddb2e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:25.708205 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1298/2607] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:05:25 2022] POST /identity/v3/projects => generated 389 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:05:25.712346 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a55a30-915e-41e2-a7c1-0cc3f788b38f None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:25.723010 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a55a30-915e-41e2-a7c1-0cc3f788b38f None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:25.778387 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7c770-d785-47ff-8121-0a830ef4403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:25.779014 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7c770-d785-47ff-8121-0a830ef4403f admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:25.779295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7c770-d785-47ff-8121-0a830ef4403f admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:25.779570 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7c770-d785-47ff-8121-0a830ef4403f admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:25.780200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7c770-d785-47ff-8121-0a830ef4403f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:25.782181 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7c770-d785-47ff-8121-0a830ef4403f admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:25.876839 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1310/2608] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:05:25 2022] POST /identity/v3/users => generated 301 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 23:05:25.880795 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839e537-5f66-4264-b7e4-967b5ffddb2e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:25.891289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839e537-5f66-4264-b7e4-967b5ffddb2e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:25.895908 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cf2c7-6fbe-4e69-afaf-9eb5c47e5f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:25.898489 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cf2c7-6fbe-4e69-afaf-9eb5c47e5f38 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:25.898489 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cf2c7-6fbe-4e69-afaf-9eb5c47e5f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:25.898489 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cf2c7-6fbe-4e69-afaf-9eb5c47e5f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:25.898489 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645cf2c7-6fbe-4e69-afaf-9eb5c47e5f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:25.899998 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645cf2c7-6fbe-4e69-afaf-9eb5c47e5f38 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:25.910876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1299/2609] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:25.915450 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7c770-d785-47ff-8121-0a830ef4403f admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:25.925436 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7c770-d785-47ff-8121-0a830ef4403f admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:25.930705 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dab825-e020-4fb0-9895-9e14308b2325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:25.931349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dab825-e020-4fb0-9895-9e14308b2325 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:25.931629 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dab825-e020-4fb0-9895-9e14308b2325 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:25.931903 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dab825-e020-4fb0-9895-9e14308b2325 admin admin] PATH_INFO: `/v3/projects/70c6a6792b074609aefecc7d642796de/users/85eda12f8272447c8c70e9ebdc45b01a/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:25.946149 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dab825-e020-4fb0-9895-9e14308b2325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c6a6792b074609aefecc7d642796de, user_id=85eda12f8272447c8c70e9ebdc45b01a, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:25.948858 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dab825-e020-4fb0-9895-9e14308b2325 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:26.016092 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1311/2610] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:05:25 2022] PUT /identity/v3/projects/70c6a6792b074609aefecc7d642796de/users/85eda12f8272447c8c70e9ebdc45b01a/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:26.020096 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cf2c7-6fbe-4e69-afaf-9eb5c47e5f38 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:26.030241 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cf2c7-6fbe-4e69-afaf-9eb5c47e5f38 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:26.090376 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a350154-6fd5-42fe-8ec7-77db0634a56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:26.090995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a350154-6fd5-42fe-8ec7-77db0634a56d admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:26.091275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a350154-6fd5-42fe-8ec7-77db0634a56d admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:26.091550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a350154-6fd5-42fe-8ec7-77db0634a56d admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:26.092193 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a350154-6fd5-42fe-8ec7-77db0634a56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:26.093854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a350154-6fd5-42fe-8ec7-77db0634a56d admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:26.107697 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1300/2611] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:26.108888 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dab825-e020-4fb0-9895-9e14308b2325 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:26.119932 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dab825-e020-4fb0-9895-9e14308b2325 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:26.124658 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4786f1-a8d5-4c62-bd70-82e288ab31b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:26.125432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4786f1-a8d5-4c62-bd70-82e288ab31b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:26.125775 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4786f1-a8d5-4c62-bd70-82e288ab31b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:26.126114 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4786f1-a8d5-4c62-bd70-82e288ab31b6 admin admin] PATH_INFO: `/v3/projects/70c6a6792b074609aefecc7d642796de/users/85eda12f8272447c8c70e9ebdc45b01a/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:26.128163 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4786f1-a8d5-4c62-bd70-82e288ab31b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c6a6792b074609aefecc7d642796de, user_id=85eda12f8272447c8c70e9ebdc45b01a, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:26.130901 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4786f1-a8d5-4c62-bd70-82e288ab31b6 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:26.141623 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1312/2612] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:05:26 2022] PUT /identity/v3/projects/70c6a6792b074609aefecc7d642796de/users/85eda12f8272447c8c70e9ebdc45b01a/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:26.207452 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e68a3-6d97-4dc3-a620-027972150f74 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:26.207737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e68a3-6d97-4dc3-a620-027972150f74 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:26.208013 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e68a3-6d97-4dc3-a620-027972150f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:26.236758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4b1e68a3-6d97-4dc3-a620-027972150f74 None None] MFA Rules not processed for user `85eda12f8272447c8c70e9ebdc45b01a`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:26.238017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4b1e68a3-6d97-4dc3-a620-027972150f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:26.286232 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:26.305653 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1301/2613] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:26 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:26.316458 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4786f1-a8d5-4c62-bd70-82e288ab31b6 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:26.318515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4d4786f1-a8d5-4c62-bd70-82e288ab31b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:26.375619 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4786f1-a8d5-4c62-bd70-82e288ab31b6 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:26.379297 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202b16b-0eac-4711-9da4-fa6844b428c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:26.379833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202b16b-0eac-4711-9da4-fa6844b428c1 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:26.380118 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202b16b-0eac-4711-9da4-fa6844b428c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:26.380383 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202b16b-0eac-4711-9da4-fa6844b428c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:26.389269 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202b16b-0eac-4711-9da4-fa6844b428c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:26.390682 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202b16b-0eac-4711-9da4-fa6844b428c1 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:26.400556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1313/2614] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:05:26 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:05:26.533655 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e68a3-6d97-4dc3-a620-027972150f74 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:26.599812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e68a3-6d97-4dc3-a620-027972150f74 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:26.604318 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a990c5-ab7f-405f-a318-0ef55dc5efe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:26.605012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a990c5-ab7f-405f-a318-0ef55dc5efe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:26.605289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a990c5-ab7f-405f-a318-0ef55dc5efe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:26.605558 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a990c5-ab7f-405f-a318-0ef55dc5efe4 admin admin] PATH_INFO: `/v3/users/6926548788674866aa53c1da5386530b` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:26.606674 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a990c5-ab7f-405f-a318-0ef55dc5efe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6926548788674866aa53c1da5386530b)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:26.608639 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a990c5-ab7f-405f-a318-0ef55dc5efe4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:26.761423 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-48a990c5-ab7f-405f-a318-0ef55dc5efe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6926548788674866aa53c1da5386530b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:26.827316 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-48a990c5-ab7f-405f-a318-0ef55dc5efe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6926548788674866aa53c1da5386530b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:26.827950 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-48a990c5-ab7f-405f-a318-0ef55dc5efe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6926548788674866aa53c1da5386530b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:26.828732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-48a990c5-ab7f-405f-a318-0ef55dc5efe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6926548788674866aa53c1da5386530b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:26.837340 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-48a990c5-ab7f-405f-a318-0ef55dc5efe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6926548788674866aa53c1da5386530b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:26.856562 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1302/2615] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:05:26 2022] DELETE /identity/v3/users/6926548788674866aa53c1da5386530b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:26.861112 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47461f44-da80-49ae-9cb4-4a3057676a2b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:26.861403 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47461f44-da80-49ae-9cb4-4a3057676a2b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:26.861670 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47461f44-da80-49ae-9cb4-4a3057676a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:26.881700 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-47461f44-da80-49ae-9cb4-4a3057676a2b None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:26.883488 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-47461f44-da80-49ae-9cb4-4a3057676a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:26.888556 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:26.942722 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1314/2616] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:26.953242 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a990c5-ab7f-405f-a318-0ef55dc5efe4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:26.954667 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-48a990c5-ab7f-405f-a318-0ef55dc5efe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:27.018698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a990c5-ab7f-405f-a318-0ef55dc5efe4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:27.023342 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bec1bf-320e-4db0-8fd1-899d27729604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:27.023959 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bec1bf-320e-4db0-8fd1-899d27729604 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:27.024239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bec1bf-320e-4db0-8fd1-899d27729604 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:27.024552 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bec1bf-320e-4db0-8fd1-899d27729604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:27.034575 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bec1bf-320e-4db0-8fd1-899d27729604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:27.036455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bec1bf-320e-4db0-8fd1-899d27729604 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:27.048443 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1303/2617] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:05:27.137048 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e09c2-9f50-4af3-8cba-7614f486230e None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:27.137333 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e09c2-9f50-4af3-8cba-7614f486230e None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:27.137627 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e09c2-9f50-4af3-8cba-7614f486230e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:27.167104 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-178e09c2-9f50-4af3-8cba-7614f486230e None None] MFA Rules not processed for user `642d4bef7e9c459a8d2dde636094b528`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:27.168349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-178e09c2-9f50-4af3-8cba-7614f486230e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:27.234772 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1315/2618] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Sep 6 23:05:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:27.378059 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bec1bf-320e-4db0-8fd1-899d27729604 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:27.379485 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-26bec1bf-320e-4db0-8fd1-899d27729604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:27.393095 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:27.453604 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bec1bf-320e-4db0-8fd1-899d27729604 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:27.458983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5569fb6-ca0e-44e7-b6b6-908994861adf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660248a90f524a43b143bae127e0eaa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:27.459624 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5569fb6-ca0e-44e7-b6b6-908994861adf service swift] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:27.459928 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5569fb6-ca0e-44e7-b6b6-908994861adf service swift] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:27.460205 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5569fb6-ca0e-44e7-b6b6-908994861adf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:27.468293 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5569fb6-ca0e-44e7-b6b6-908994861adf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:27.469964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5569fb6-ca0e-44e7-b6b6-908994861adf service swift] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:27.478643 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1304/2619] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Sep 6 23:05:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 23:05:27.575760 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e09c2-9f50-4af3-8cba-7614f486230e None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:27.580646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-178e09c2-9f50-4af3-8cba-7614f486230e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:27.615883 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e09c2-9f50-4af3-8cba-7614f486230e None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:27.631390 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad657ae1-a634-4832-bae6-e574685dffeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:27.635648 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad657ae1-a634-4832-bae6-e574685dffeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:27.635648 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad657ae1-a634-4832-bae6-e574685dffeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:27.635648 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad657ae1-a634-4832-bae6-e574685dffeb admin admin] PATH_INFO: `/v3/projects/d724298641b347b0bddc76c613d54b10` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:27.635648 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad657ae1-a634-4832-bae6-e574685dffeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d724298641b347b0bddc76c613d54b10)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:27.636155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad657ae1-a634-4832-bae6-e574685dffeb admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:27.803594 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ad657ae1-a634-4832-bae6-e574685dffeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd724298641b347b0bddc76c613d54b10', 'request_id': 'req-ad657ae1-a634-4832-bae6-e574685dffeb'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:27.811849 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ad657ae1-a634-4832-bae6-e574685dffeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd724298641b347b0bddc76c613d54b10', 'request_id': 'req-ad657ae1-a634-4832-bae6-e574685dffeb'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:27.883235 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ad657ae1-a634-4832-bae6-e574685dffeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd724298641b347b0bddc76c613d54b10', 'request_id': 'req-ad657ae1-a634-4832-bae6-e574685dffeb'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:27.899858 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ad657ae1-a634-4832-bae6-e574685dffeb admin admin] The token cache is being invalidate because project d724298641b347b0bddc76c613d54b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:05:27.900263 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ad657ae1-a634-4832-bae6-e574685dffeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:27.901413 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-ad657ae1-a634-4832-bae6-e574685dffeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:27.904353 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1316/2620] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:05:27 2022] DELETE /identity/v3/projects/d724298641b347b0bddc76c613d54b10 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:27.909121 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5569fb6-ca0e-44e7-b6b6-908994861adf service swift] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:27.930160 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5569fb6-ca0e-44e7-b6b6-908994861adf service swift] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:28.010996 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8bda8-31ee-4ef0-bf40-77943e513979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:28.019686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8bda8-31ee-4ef0-bf40-77943e513979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:28.019686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8bda8-31ee-4ef0-bf40-77943e513979 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:28.019686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8bda8-31ee-4ef0-bf40-77943e513979 admin admin] PATH_INFO: `/v3/users/85eda12f8272447c8c70e9ebdc45b01a` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:28.019686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8bda8-31ee-4ef0-bf40-77943e513979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85eda12f8272447c8c70e9ebdc45b01a)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:28.019686 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8bda8-31ee-4ef0-bf40-77943e513979 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:28.182977 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-64c8bda8-31ee-4ef0-bf40-77943e513979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85eda12f8272447c8c70e9ebdc45b01a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:28.245108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-64c8bda8-31ee-4ef0-bf40-77943e513979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85eda12f8272447c8c70e9ebdc45b01a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:28.245794 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-64c8bda8-31ee-4ef0-bf40-77943e513979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85eda12f8272447c8c70e9ebdc45b01a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:28.246424 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-64c8bda8-31ee-4ef0-bf40-77943e513979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85eda12f8272447c8c70e9ebdc45b01a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:28.255259 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-64c8bda8-31ee-4ef0-bf40-77943e513979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85eda12f8272447c8c70e9ebdc45b01a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:28.279105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1305/2621] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:05:27 2022] DELETE /identity/v3/users/85eda12f8272447c8c70e9ebdc45b01a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:28.751891 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad657ae1-a634-4832-bae6-e574685dffeb admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:28.753456 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-ad657ae1-a634-4832-bae6-e574685dffeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:28.774396 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad657ae1-a634-4832-bae6-e574685dffeb admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:28.801139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:28.840829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4a73b-9c55-4325-bbae-f3d2d53c7bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:28.841624 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4a73b-9c55-4325-bbae-f3d2d53c7bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:28.841965 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4a73b-9c55-4325-bbae-f3d2d53c7bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:28.842305 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4a73b-9c55-4325-bbae-f3d2d53c7bdd admin admin] PATH_INFO: `/v3/projects/70c6a6792b074609aefecc7d642796de` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:28.843566 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4a73b-9c55-4325-bbae-f3d2d53c7bdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c6a6792b074609aefecc7d642796de)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:28.845646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4a73b-9c55-4325-bbae-f3d2d53c7bdd admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:28.978596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-1de4a73b-9c55-4325-bbae-f3d2d53c7bdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c6a6792b074609aefecc7d642796de', 'request_id': 'req-1de4a73b-9c55-4325-bbae-f3d2d53c7bdd'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:28.987331 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-1de4a73b-9c55-4325-bbae-f3d2d53c7bdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c6a6792b074609aefecc7d642796de', 'request_id': 'req-1de4a73b-9c55-4325-bbae-f3d2d53c7bdd'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:29.059495 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-1de4a73b-9c55-4325-bbae-f3d2d53c7bdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c6a6792b074609aefecc7d642796de', 'request_id': 'req-1de4a73b-9c55-4325-bbae-f3d2d53c7bdd'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:29.077142 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-1de4a73b-9c55-4325-bbae-f3d2d53c7bdd admin admin] The token cache is being invalidate because project 70c6a6792b074609aefecc7d642796de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:05:29.077436 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-1de4a73b-9c55-4325-bbae-f3d2d53c7bdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:29.078121 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-1de4a73b-9c55-4325-bbae-f3d2d53c7bdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:29.079641 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1317/2622] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:05:28 2022] DELETE /identity/v3/projects/70c6a6792b074609aefecc7d642796de => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:29.085654 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5020ed-26f4-421c-8f9f-9fed6f6718fe None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:29.086202 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5020ed-26f4-421c-8f9f-9fed6f6718fe None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:29.086202 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5020ed-26f4-421c-8f9f-9fed6f6718fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:29.106660 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-6b5020ed-26f4-421c-8f9f-9fed6f6718fe None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:29.108738 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6b5020ed-26f4-421c-8f9f-9fed6f6718fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:29.123796 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:29.176938 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1306/2623] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:29.186003 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb51665-16a5-494a-b434-d1ade49dc39d None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:29.186650 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb51665-16a5-494a-b434-d1ade49dc39d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:29.187033 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb51665-16a5-494a-b434-d1ade49dc39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:29.208342 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-9eb51665-16a5-494a-b434-d1ade49dc39d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:29.209759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9eb51665-16a5-494a-b434-d1ade49dc39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:29.217798 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1318/2624] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:29.222303 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5020ed-26f4-421c-8f9f-9fed6f6718fe None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:29.234319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5020ed-26f4-421c-8f9f-9fed6f6718fe None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:29.239894 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c66bf-d825-4721-bb9e-8dfa0d8d81cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:29.240545 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c66bf-d825-4721-bb9e-8dfa0d8d81cf admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:29.240822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c66bf-d825-4721-bb9e-8dfa0d8d81cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:29.241102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c66bf-d825-4721-bb9e-8dfa0d8d81cf admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:29.242300 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c66bf-d825-4721-bb9e-8dfa0d8d81cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:05:29.242602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c66bf-d825-4721-bb9e-8dfa0d8d81cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:29.244458 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c66bf-d825-4721-bb9e-8dfa0d8d81cf admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:29.261975 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1307/2625] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 23:05:29.262887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb51665-16a5-494a-b434-d1ade49dc39d None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:29.273022 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb51665-16a5-494a-b434-d1ade49dc39d None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:29.277602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163bae4-d088-4bd9-a505-8b1840ee2c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:29.278344 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163bae4-d088-4bd9-a505-8b1840ee2c0d admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:29.278625 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163bae4-d088-4bd9-a505-8b1840ee2c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:29.278893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163bae4-d088-4bd9-a505-8b1840ee2c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:29.279516 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163bae4-d088-4bd9-a505-8b1840ee2c0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:29.281475 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163bae4-d088-4bd9-a505-8b1840ee2c0d admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:29.378462 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1319/2626] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:05:29 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 23:05:29.383151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c66bf-d825-4721-bb9e-8dfa0d8d81cf admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:29.394572 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c66bf-d825-4721-bb9e-8dfa0d8d81cf admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:29.464923 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee557f-6b44-408f-a359-eb15dfb284b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:29.465554 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee557f-6b44-408f-a359-eb15dfb284b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:29.465882 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee557f-6b44-408f-a359-eb15dfb284b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:29.466161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee557f-6b44-408f-a359-eb15dfb284b8 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:29.466841 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee557f-6b44-408f-a359-eb15dfb284b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:29.468842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee557f-6b44-408f-a359-eb15dfb284b8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:29.555755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1308/2627] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:05:29 2022] POST /identity/v3/users => generated 294 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 23:05:29.556963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163bae4-d088-4bd9-a505-8b1840ee2c0d admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:29.574153 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163bae4-d088-4bd9-a505-8b1840ee2c0d admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:29.579453 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e193a31-3d17-4a1e-984e-7e132adb295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:29.580073 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e193a31-3d17-4a1e-984e-7e132adb295f admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:29.580353 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e193a31-3d17-4a1e-984e-7e132adb295f admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:29.580675 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e193a31-3d17-4a1e-984e-7e132adb295f admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:29.581329 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e193a31-3d17-4a1e-984e-7e132adb295f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:29.582946 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e193a31-3d17-4a1e-984e-7e132adb295f admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:29.594581 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1320/2628] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:29.598557 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee557f-6b44-408f-a359-eb15dfb284b8 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:29.610176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee557f-6b44-408f-a359-eb15dfb284b8 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:29.615588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926acde8-e042-499e-8466-17f0e0624f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:29.616253 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926acde8-e042-499e-8466-17f0e0624f26 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:29.617083 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926acde8-e042-499e-8466-17f0e0624f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:29.617360 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926acde8-e042-499e-8466-17f0e0624f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:29.618244 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926acde8-e042-499e-8466-17f0e0624f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:29.620056 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926acde8-e042-499e-8466-17f0e0624f26 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:29.634727 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1309/2629] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 23:05:29.635891 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e193a31-3d17-4a1e-984e-7e132adb295f admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:29.646697 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e193a31-3d17-4a1e-984e-7e132adb295f admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:29.651621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecf295-5186-46c9-95fe-6b0edad43757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:29.652282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecf295-5186-46c9-95fe-6b0edad43757 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:29.652603 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecf295-5186-46c9-95fe-6b0edad43757 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:29.652880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecf295-5186-46c9-95fe-6b0edad43757 admin admin] PATH_INFO: `/v3/projects/cc25d9e48132427e8b134992d3053758/users/d1a50cdd5f7b49ddaaab2cddf93ac8df/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:29.670508 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecf295-5186-46c9-95fe-6b0edad43757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc25d9e48132427e8b134992d3053758, user_id=d1a50cdd5f7b49ddaaab2cddf93ac8df, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:29.673233 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecf295-5186-46c9-95fe-6b0edad43757 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:29.740104 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1321/2630] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:05:29 2022] PUT /identity/v3/projects/cc25d9e48132427e8b134992d3053758/users/d1a50cdd5f7b49ddaaab2cddf93ac8df/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:29.752617 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b551d-fe9c-454b-bc52-49c172c07fbc None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:29.753177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b551d-fe9c-454b-bc52-49c172c07fbc None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:29.753725 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b551d-fe9c-454b-bc52-49c172c07fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:29.809008 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-378b551d-fe9c-454b-bc52-49c172c07fbc None None] MFA Rules not processed for user `d1a50cdd5f7b49ddaaab2cddf93ac8df`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:29.810528 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-378b551d-fe9c-454b-bc52-49c172c07fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:29.912095 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1310/2631] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:29.916327 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecf295-5186-46c9-95fe-6b0edad43757 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:29.977759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:29.995721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecf295-5186-46c9-95fe-6b0edad43757 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:30.002247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecbcff-1a30-4878-b97b-6abfed921490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:30.002882 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecbcff-1a30-4878-b97b-6abfed921490 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:30.003044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecbcff-1a30-4878-b97b-6abfed921490 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:30.003296 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecbcff-1a30-4878-b97b-6abfed921490 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:30.003975 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecbcff-1a30-4878-b97b-6abfed921490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:30.006222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecbcff-1a30-4878-b97b-6abfed921490 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:30.139878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1322/2632] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:05:29 2022] POST /identity/v3/projects => generated 385 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 23:05:30.143574 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b551d-fe9c-454b-bc52-49c172c07fbc None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:30.155223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b551d-fe9c-454b-bc52-49c172c07fbc None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:30.169982 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:30.237527 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572112f9-15a7-4f05-bf52-70684911c942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:30.238317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572112f9-15a7-4f05-bf52-70684911c942 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:30.238600 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572112f9-15a7-4f05-bf52-70684911c942 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:30.238878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572112f9-15a7-4f05-bf52-70684911c942 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:30.239526 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572112f9-15a7-4f05-bf52-70684911c942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:30.241618 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572112f9-15a7-4f05-bf52-70684911c942 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:30.337915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1311/2633] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:05:30 2022] POST /identity/v3/users => generated 299 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:05:30.341943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecbcff-1a30-4878-b97b-6abfed921490 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:30.352871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecbcff-1a30-4878-b97b-6abfed921490 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:30.357499 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37d728-7747-4ab3-bc6d-397ce8f860ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:30.358108 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37d728-7747-4ab3-bc6d-397ce8f860ab admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:30.358387 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37d728-7747-4ab3-bc6d-397ce8f860ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:30.358657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37d728-7747-4ab3-bc6d-397ce8f860ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:30.359294 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37d728-7747-4ab3-bc6d-397ce8f860ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:30.360912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37d728-7747-4ab3-bc6d-397ce8f860ab admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:30.371603 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1323/2634] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:30.376154 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572112f9-15a7-4f05-bf52-70684911c942 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:30.390018 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572112f9-15a7-4f05-bf52-70684911c942 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:30.395286 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c77bcf-f062-464f-855f-95f26f245023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:30.395954 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c77bcf-f062-464f-855f-95f26f245023 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:30.396231 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c77bcf-f062-464f-855f-95f26f245023 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:30.396540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c77bcf-f062-464f-855f-95f26f245023 admin admin] PATH_INFO: `/v3/projects/d2ae6c55441e4c34b91ba7bfdc103a02/users/fa310dc36dde4419811079afebe22222/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:30.412350 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c77bcf-f062-464f-855f-95f26f245023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ae6c55441e4c34b91ba7bfdc103a02, user_id=fa310dc36dde4419811079afebe22222, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:30.415588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c77bcf-f062-464f-855f-95f26f245023 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:30.777103 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1312/2635] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:05:30 2022] PUT /identity/v3/projects/d2ae6c55441e4c34b91ba7bfdc103a02/users/fa310dc36dde4419811079afebe22222/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 23:05:30.781108 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37d728-7747-4ab3-bc6d-397ce8f860ab admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:30.790925 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37d728-7747-4ab3-bc6d-397ce8f860ab admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:30.846263 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a571e-010c-4290-9821-fcdab2fca9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:30.846862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a571e-010c-4290-9821-fcdab2fca9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:30.847139 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a571e-010c-4290-9821-fcdab2fca9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:30.847410 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a571e-010c-4290-9821-fcdab2fca9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:30.848040 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a571e-010c-4290-9821-fcdab2fca9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:30.849955 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a571e-010c-4290-9821-fcdab2fca9a2 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:30.859578 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1324/2636] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:30.863723 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c77bcf-f062-464f-855f-95f26f245023 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:30.874733 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c77bcf-f062-464f-855f-95f26f245023 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:30.879288 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac0cfc-d9af-476a-ac27-df6d7f9df69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:30.880045 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac0cfc-d9af-476a-ac27-df6d7f9df69b admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:30.880387 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac0cfc-d9af-476a-ac27-df6d7f9df69b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:30.880753 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac0cfc-d9af-476a-ac27-df6d7f9df69b admin admin] PATH_INFO: `/v3/projects/d2ae6c55441e4c34b91ba7bfdc103a02/users/fa310dc36dde4419811079afebe22222/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:30.883350 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac0cfc-d9af-476a-ac27-df6d7f9df69b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ae6c55441e4c34b91ba7bfdc103a02, user_id=fa310dc36dde4419811079afebe22222, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:30.886242 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac0cfc-d9af-476a-ac27-df6d7f9df69b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:30.900966 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1313/2637] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:05:30 2022] PUT /identity/v3/projects/d2ae6c55441e4c34b91ba7bfdc103a02/users/fa310dc36dde4419811079afebe22222/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:30.910949 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960aa0a3-7ec6-4e05-925e-7119714696df None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:30.911240 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960aa0a3-7ec6-4e05-925e-7119714696df None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:30.911515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960aa0a3-7ec6-4e05-925e-7119714696df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:30.955257 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-960aa0a3-7ec6-4e05-925e-7119714696df None None] MFA Rules not processed for user `fa310dc36dde4419811079afebe22222`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:30.957164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-960aa0a3-7ec6-4e05-925e-7119714696df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:31.074175 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1325/2638] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:31.094778 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac0cfc-d9af-476a-ac27-df6d7f9df69b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:31.097230 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8bac0cfc-d9af-476a-ac27-df6d7f9df69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:31.172537 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac0cfc-d9af-476a-ac27-df6d7f9df69b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:31.177588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee456f3-27a2-4a2c-8009-f195df2861fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:31.177588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee456f3-27a2-4a2c-8009-f195df2861fe service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:31.177823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee456f3-27a2-4a2c-8009-f195df2861fe service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:31.177983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee456f3-27a2-4a2c-8009-f195df2861fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:31.188017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee456f3-27a2-4a2c-8009-f195df2861fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:31.190412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee456f3-27a2-4a2c-8009-f195df2861fe service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:31.204916 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1314/2639] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:05:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:05:32.415687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960aa0a3-7ec6-4e05-925e-7119714696df None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:32.468573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:32.487047 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960aa0a3-7ec6-4e05-925e-7119714696df None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:32.491765 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db00e6-6f68-4639-977f-0f94e861081e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:32.494454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db00e6-6f68-4639-977f-0f94e861081e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:32.494454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db00e6-6f68-4639-977f-0f94e861081e admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:32.494454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db00e6-6f68-4639-977f-0f94e861081e admin admin] PATH_INFO: `/v3/users/d1a50cdd5f7b49ddaaab2cddf93ac8df` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:32.494454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db00e6-6f68-4639-977f-0f94e861081e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a50cdd5f7b49ddaaab2cddf93ac8df)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:32.496081 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db00e6-6f68-4639-977f-0f94e861081e admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:32.781857 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c9db00e6-6f68-4639-977f-0f94e861081e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a50cdd5f7b49ddaaab2cddf93ac8df'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:32.833560 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c9db00e6-6f68-4639-977f-0f94e861081e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a50cdd5f7b49ddaaab2cddf93ac8df'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:32.834370 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c9db00e6-6f68-4639-977f-0f94e861081e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a50cdd5f7b49ddaaab2cddf93ac8df'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:32.847659 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c9db00e6-6f68-4639-977f-0f94e861081e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a50cdd5f7b49ddaaab2cddf93ac8df'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:32.848343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c9db00e6-6f68-4639-977f-0f94e861081e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a50cdd5f7b49ddaaab2cddf93ac8df'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:32.864847 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1326/2640] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:05:32 2022] DELETE /identity/v3/users/d1a50cdd5f7b49ddaaab2cddf93ac8df => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:32.869593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e069ee2-3bd7-46f3-915b-7b24da269ed1 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:32.870085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e069ee2-3bd7-46f3-915b-7b24da269ed1 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:32.870270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e069ee2-3bd7-46f3-915b-7b24da269ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:32.891441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9e069ee2-3bd7-46f3-915b-7b24da269ed1 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:32.892840 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9e069ee2-3bd7-46f3-915b-7b24da269ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:32.962868 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1315/2641] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:32.973009 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db00e6-6f68-4639-977f-0f94e861081e admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:32.975055 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c9db00e6-6f68-4639-977f-0f94e861081e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:33.074731 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db00e6-6f68-4639-977f-0f94e861081e admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:33.078743 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf112d6-aece-4f5b-808d-f472d57d11c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:33.079457 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf112d6-aece-4f5b-808d-f472d57d11c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:33.079734 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf112d6-aece-4f5b-808d-f472d57d11c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:33.080091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf112d6-aece-4f5b-808d-f472d57d11c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:33.090430 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf112d6-aece-4f5b-808d-f472d57d11c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:33.092044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf112d6-aece-4f5b-808d-f472d57d11c9 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:33.108621 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1327/2642] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:05:33.684896 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e069ee2-3bd7-46f3-915b-7b24da269ed1 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:33.687374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9e069ee2-3bd7-46f3-915b-7b24da269ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:33.703180 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e069ee2-3bd7-46f3-915b-7b24da269ed1 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:33.708207 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57095ee-b797-4f8e-9352-a70a4b2701a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:33.709044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57095ee-b797-4f8e-9352-a70a4b2701a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:33.709459 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57095ee-b797-4f8e-9352-a70a4b2701a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:33.709762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57095ee-b797-4f8e-9352-a70a4b2701a4 admin admin] PATH_INFO: `/v3/projects/cc25d9e48132427e8b134992d3053758` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:33.711482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57095ee-b797-4f8e-9352-a70a4b2701a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc25d9e48132427e8b134992d3053758)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:33.713608 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57095ee-b797-4f8e-9352-a70a4b2701a4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:33.720975 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:33.818057 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b57095ee-b797-4f8e-9352-a70a4b2701a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc25d9e48132427e8b134992d3053758', 'request_id': 'req-b57095ee-b797-4f8e-9352-a70a4b2701a4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:33.825162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b57095ee-b797-4f8e-9352-a70a4b2701a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc25d9e48132427e8b134992d3053758', 'request_id': 'req-b57095ee-b797-4f8e-9352-a70a4b2701a4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:33.928297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b57095ee-b797-4f8e-9352-a70a4b2701a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc25d9e48132427e8b134992d3053758', 'request_id': 'req-b57095ee-b797-4f8e-9352-a70a4b2701a4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:33.940214 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b57095ee-b797-4f8e-9352-a70a4b2701a4 admin admin] The token cache is being invalidate because project cc25d9e48132427e8b134992d3053758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:05:33.940535 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b57095ee-b797-4f8e-9352-a70a4b2701a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:33.941208 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b57095ee-b797-4f8e-9352-a70a4b2701a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:33.942728 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1316/2643] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:05:33 2022] DELETE /identity/v3/projects/cc25d9e48132427e8b134992d3053758 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:33.947057 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf112d6-aece-4f5b-808d-f472d57d11c9 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:33.958086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf112d6-aece-4f5b-808d-f472d57d11c9 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:34.013153 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:34.031163 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b5e9f-b5cf-4d1f-845d-3b54e77a3a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:34.031902 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b5e9f-b5cf-4d1f-845d-3b54e77a3a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:34.032253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b5e9f-b5cf-4d1f-845d-3b54e77a3a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:34.032626 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b5e9f-b5cf-4d1f-845d-3b54e77a3a09 admin admin] PATH_INFO: `/v3/users/fa310dc36dde4419811079afebe22222` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:34.033982 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b5e9f-b5cf-4d1f-845d-3b54e77a3a09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa310dc36dde4419811079afebe22222)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:34.035971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b5e9f-b5cf-4d1f-845d-3b54e77a3a09 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:34.617368 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-fc2b5e9f-b5cf-4d1f-845d-3b54e77a3a09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa310dc36dde4419811079afebe22222'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:34.685435 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-fc2b5e9f-b5cf-4d1f-845d-3b54e77a3a09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa310dc36dde4419811079afebe22222'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:34.686184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-fc2b5e9f-b5cf-4d1f-845d-3b54e77a3a09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa310dc36dde4419811079afebe22222'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:34.703031 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-fc2b5e9f-b5cf-4d1f-845d-3b54e77a3a09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa310dc36dde4419811079afebe22222'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:34.703744 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-fc2b5e9f-b5cf-4d1f-845d-3b54e77a3a09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa310dc36dde4419811079afebe22222'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:34.721340 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1328/2644] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:05:33 2022] DELETE /identity/v3/users/fa310dc36dde4419811079afebe22222 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:35.204587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57095ee-b797-4f8e-9352-a70a4b2701a4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:35.207210 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b57095ee-b797-4f8e-9352-a70a4b2701a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:35.223657 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57095ee-b797-4f8e-9352-a70a4b2701a4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:35.300913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09637ef-0950-4a8c-b7c8-e8383cce15c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:35.301584 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09637ef-0950-4a8c-b7c8-e8383cce15c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:35.301869 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09637ef-0950-4a8c-b7c8-e8383cce15c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:35.302168 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09637ef-0950-4a8c-b7c8-e8383cce15c7 admin admin] PATH_INFO: `/v3/projects/d2ae6c55441e4c34b91ba7bfdc103a02` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:35.303465 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09637ef-0950-4a8c-b7c8-e8383cce15c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2ae6c55441e4c34b91ba7bfdc103a02)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:35.305511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09637ef-0950-4a8c-b7c8-e8383cce15c7 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:35.418925 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d09637ef-0950-4a8c-b7c8-e8383cce15c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2ae6c55441e4c34b91ba7bfdc103a02', 'request_id': 'req-d09637ef-0950-4a8c-b7c8-e8383cce15c7'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:35.427788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d09637ef-0950-4a8c-b7c8-e8383cce15c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2ae6c55441e4c34b91ba7bfdc103a02', 'request_id': 'req-d09637ef-0950-4a8c-b7c8-e8383cce15c7'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:35.493943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d09637ef-0950-4a8c-b7c8-e8383cce15c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2ae6c55441e4c34b91ba7bfdc103a02', 'request_id': 'req-d09637ef-0950-4a8c-b7c8-e8383cce15c7'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:35.510823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d09637ef-0950-4a8c-b7c8-e8383cce15c7 admin admin] The token cache is being invalidate because project d2ae6c55441e4c34b91ba7bfdc103a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:05:35.511111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d09637ef-0950-4a8c-b7c8-e8383cce15c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:35.511831 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d09637ef-0950-4a8c-b7c8-e8383cce15c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:35.513370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1317/2645] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:05:35 2022] DELETE /identity/v3/projects/d2ae6c55441e4c34b91ba7bfdc103a02 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:35.518377 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42f2d6-4457-4950-b335-5513d69ff40c None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:35.525185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42f2d6-4457-4950-b335-5513d69ff40c None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:35.525185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42f2d6-4457-4950-b335-5513d69ff40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:35.543485 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-6e42f2d6-4457-4950-b335-5513d69ff40c None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:35.544976 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-6e42f2d6-4457-4950-b335-5513d69ff40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:35.624461 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1329/2646] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:35.633539 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91840096-1c74-48e4-a21b-443950abb7de None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:35.633838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91840096-1c74-48e4-a21b-443950abb7de None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:35.634102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91840096-1c74-48e4-a21b-443950abb7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:35.660835 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-91840096-1c74-48e4-a21b-443950abb7de None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:35.663936 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-91840096-1c74-48e4-a21b-443950abb7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:35.674523 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1318/2647] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:35.678859 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42f2d6-4457-4950-b335-5513d69ff40c None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:35.692242 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42f2d6-4457-4950-b335-5513d69ff40c None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:35.700395 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16233574-3949-4493-8c07-b6a8888eaa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:35.701376 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16233574-3949-4493-8c07-b6a8888eaa64 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:35.701730 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16233574-3949-4493-8c07-b6a8888eaa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:35.702079 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16233574-3949-4493-8c07-b6a8888eaa64 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:35.702802 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16233574-3949-4493-8c07-b6a8888eaa64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:05:35.703174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16233574-3949-4493-8c07-b6a8888eaa64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:35.704915 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16233574-3949-4493-8c07-b6a8888eaa64 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:35.723756 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91840096-1c74-48e4-a21b-443950abb7de None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:35.728683 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1330/2648] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 23:05:35.734636 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91840096-1c74-48e4-a21b-443950abb7de None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:35.742008 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5066b3e-3336-4a2b-8e6d-27789c31df86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:35.742698 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5066b3e-3336-4a2b-8e6d-27789c31df86 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:35.743268 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5066b3e-3336-4a2b-8e6d-27789c31df86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:35.743753 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5066b3e-3336-4a2b-8e6d-27789c31df86 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:35.744487 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5066b3e-3336-4a2b-8e6d-27789c31df86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:35.746356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5066b3e-3336-4a2b-8e6d-27789c31df86 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:35.764603 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:35.854110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1319/2649] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:05:35 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:05:35.856891 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16233574-3949-4493-8c07-b6a8888eaa64 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:35.871132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16233574-3949-4493-8c07-b6a8888eaa64 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:35.968314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:35.983206 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7243f-f8e5-475d-989d-f9deb2a2e2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:35.984224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7243f-f8e5-475d-989d-f9deb2a2e2df admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:35.984443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7243f-f8e5-475d-989d-f9deb2a2e2df admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:35.984718 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7243f-f8e5-475d-989d-f9deb2a2e2df admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:35.985524 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7243f-f8e5-475d-989d-f9deb2a2e2df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:35.989196 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7243f-f8e5-475d-989d-f9deb2a2e2df admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:36.096473 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1331/2650] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:05:35 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:05:36.100130 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5066b3e-3336-4a2b-8e6d-27789c31df86 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:36.110836 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5066b3e-3336-4a2b-8e6d-27789c31df86 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:36.115466 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d234a8-ea38-4ebb-85ec-f3e1000ce535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:36.116115 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d234a8-ea38-4ebb-85ec-f3e1000ce535 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:36.116961 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d234a8-ea38-4ebb-85ec-f3e1000ce535 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:36.117234 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d234a8-ea38-4ebb-85ec-f3e1000ce535 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:36.117882 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d234a8-ea38-4ebb-85ec-f3e1000ce535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:36.119482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d234a8-ea38-4ebb-85ec-f3e1000ce535 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:36.134028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1320/2651] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:36.135835 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7243f-f8e5-475d-989d-f9deb2a2e2df admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:36.147865 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7243f-f8e5-475d-989d-f9deb2a2e2df admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:36.156448 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f327cc3-9977-4abf-a53c-3777c14e3bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:36.157148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f327cc3-9977-4abf-a53c-3777c14e3bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:36.157499 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f327cc3-9977-4abf-a53c-3777c14e3bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:36.157835 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f327cc3-9977-4abf-a53c-3777c14e3bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:36.158553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f327cc3-9977-4abf-a53c-3777c14e3bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:36.160848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f327cc3-9977-4abf-a53c-3777c14e3bd9 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:36.176115 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1332/2652] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:36.177342 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d234a8-ea38-4ebb-85ec-f3e1000ce535 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:36.192250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d234a8-ea38-4ebb-85ec-f3e1000ce535 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:36.197834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f132e-ca75-4949-80f3-3ee79be98df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:36.198566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f132e-ca75-4949-80f3-3ee79be98df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:36.198915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f132e-ca75-4949-80f3-3ee79be98df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:36.199184 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f132e-ca75-4949-80f3-3ee79be98df1 admin admin] PATH_INFO: `/v3/projects/d72edc2a840d42d9b65126bb618740eb/users/33fe6f63b77947ffa20f0d7404ea8a79/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:36.217786 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f132e-ca75-4949-80f3-3ee79be98df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d72edc2a840d42d9b65126bb618740eb, user_id=33fe6f63b77947ffa20f0d7404ea8a79, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:36.221614 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f132e-ca75-4949-80f3-3ee79be98df1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:36.302927 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1321/2653] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:05:36 2022] PUT /identity/v3/projects/d72edc2a840d42d9b65126bb618740eb/users/33fe6f63b77947ffa20f0d7404ea8a79/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:36.315005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89ca5d-ef09-43f2-8a6d-2863cee5c6c3 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:36.315296 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89ca5d-ef09-43f2-8a6d-2863cee5c6c3 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:36.315574 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89ca5d-ef09-43f2-8a6d-2863cee5c6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:36.350390 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-1d89ca5d-ef09-43f2-8a6d-2863cee5c6c3 None None] MFA Rules not processed for user `33fe6f63b77947ffa20f0d7404ea8a79`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:36.352181 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1d89ca5d-ef09-43f2-8a6d-2863cee5c6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:36.423278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1333/2654] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:36.428855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f132e-ca75-4949-80f3-3ee79be98df1 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:36.503885 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f132e-ca75-4949-80f3-3ee79be98df1 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:36.509163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295b7f9-fc4e-4258-afd5-db1301a57d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:36.509894 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295b7f9-fc4e-4258-afd5-db1301a57d46 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:36.510275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295b7f9-fc4e-4258-afd5-db1301a57d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:36.510649 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295b7f9-fc4e-4258-afd5-db1301a57d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:36.512031 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295b7f9-fc4e-4258-afd5-db1301a57d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:36.514137 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295b7f9-fc4e-4258-afd5-db1301a57d46 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:36.606779 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1322/2655] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:05:36 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 23:05:36.607485 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89ca5d-ef09-43f2-8a6d-2863cee5c6c3 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:36.626320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89ca5d-ef09-43f2-8a6d-2863cee5c6c3 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:36.694051 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51461789-645b-469f-bfe4-63cbd3091512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:36.694531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51461789-645b-469f-bfe4-63cbd3091512 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:36.694769 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51461789-645b-469f-bfe4-63cbd3091512 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:36.695137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51461789-645b-469f-bfe4-63cbd3091512 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:36.695657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51461789-645b-469f-bfe4-63cbd3091512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:36.698297 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51461789-645b-469f-bfe4-63cbd3091512 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:36.810893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1334/2656] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:05:36 2022] POST /identity/v3/users => generated 298 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 23:05:36.814736 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295b7f9-fc4e-4258-afd5-db1301a57d46 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:36.827484 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295b7f9-fc4e-4258-afd5-db1301a57d46 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:36.835530 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb6910-98c0-4e87-a5fc-e2f6ce853ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:36.836226 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb6910-98c0-4e87-a5fc-e2f6ce853ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:36.836608 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb6910-98c0-4e87-a5fc-e2f6ce853ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:36.837008 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb6910-98c0-4e87-a5fc-e2f6ce853ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:36.837734 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb6910-98c0-4e87-a5fc-e2f6ce853ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:36.839451 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb6910-98c0-4e87-a5fc-e2f6ce853ea9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:36.859069 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1323/2657] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:36.861359 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51461789-645b-469f-bfe4-63cbd3091512 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:36.872768 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51461789-645b-469f-bfe4-63cbd3091512 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:36.878030 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930aa97-b8fe-402b-965f-74d4380306be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:36.878694 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930aa97-b8fe-402b-965f-74d4380306be admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:36.878977 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930aa97-b8fe-402b-965f-74d4380306be admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:36.879249 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930aa97-b8fe-402b-965f-74d4380306be admin admin] PATH_INFO: `/v3/projects/82e9ae14169d422595a24a02bcd0472c/users/6bc870829a3a44348964ef31b61928f4/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:36.900394 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930aa97-b8fe-402b-965f-74d4380306be admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e9ae14169d422595a24a02bcd0472c, user_id=6bc870829a3a44348964ef31b61928f4, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:36.903541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930aa97-b8fe-402b-965f-74d4380306be admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:36.967596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1335/2658] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:05:36 2022] PUT /identity/v3/projects/82e9ae14169d422595a24a02bcd0472c/users/6bc870829a3a44348964ef31b61928f4/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:36.971903 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb6910-98c0-4e87-a5fc-e2f6ce853ea9 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:36.986023 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb6910-98c0-4e87-a5fc-e2f6ce853ea9 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:37.051619 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d7d80-347c-4f7a-8254-36fb6fb83275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:37.052412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d7d80-347c-4f7a-8254-36fb6fb83275 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:37.052814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d7d80-347c-4f7a-8254-36fb6fb83275 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:37.053201 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d7d80-347c-4f7a-8254-36fb6fb83275 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:37.053989 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d7d80-347c-4f7a-8254-36fb6fb83275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:37.055701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d7d80-347c-4f7a-8254-36fb6fb83275 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:37.078676 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1324/2659] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:37.080343 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930aa97-b8fe-402b-965f-74d4380306be admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:37.099205 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930aa97-b8fe-402b-965f-74d4380306be admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:37.105123 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b4bb3-d81d-480a-ae59-2f46038c12c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:37.105805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b4bb3-d81d-480a-ae59-2f46038c12c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:37.106182 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b4bb3-d81d-480a-ae59-2f46038c12c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:37.106459 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b4bb3-d81d-480a-ae59-2f46038c12c4 admin admin] PATH_INFO: `/v3/projects/82e9ae14169d422595a24a02bcd0472c/users/6bc870829a3a44348964ef31b61928f4/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:37.108413 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b4bb3-d81d-480a-ae59-2f46038c12c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e9ae14169d422595a24a02bcd0472c, user_id=6bc870829a3a44348964ef31b61928f4, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:37.111942 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b4bb3-d81d-480a-ae59-2f46038c12c4 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:37.135091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1336/2660] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:05:37 2022] PUT /identity/v3/projects/82e9ae14169d422595a24a02bcd0472c/users/6bc870829a3a44348964ef31b61928f4/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:37.136829 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a2b24-078b-481e-8fdb-68896d37387f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:37.141665 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a2b24-078b-481e-8fdb-68896d37387f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:37.141665 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a2b24-078b-481e-8fdb-68896d37387f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:37.176137 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d02a2b24-078b-481e-8fdb-68896d37387f None None] MFA Rules not processed for user `6bc870829a3a44348964ef31b61928f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:37.177421 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d02a2b24-078b-481e-8fdb-68896d37387f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:37.205294 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:37.271494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1325/2661] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:37.286510 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b4bb3-d81d-480a-ae59-2f46038c12c4 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:37.288318 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-401b4bb3-d81d-480a-ae59-2f46038c12c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:37.313030 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:37.387059 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b4bb3-d81d-480a-ae59-2f46038c12c4 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:37.391119 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99517f-7d9f-420a-914a-9ba032d7c822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:37.391860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99517f-7d9f-420a-914a-9ba032d7c822 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:37.392212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99517f-7d9f-420a-914a-9ba032d7c822 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:37.392584 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99517f-7d9f-420a-914a-9ba032d7c822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:37.458051 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99517f-7d9f-420a-914a-9ba032d7c822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:37.459552 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99517f-7d9f-420a-914a-9ba032d7c822 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:37.470225 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1337/2662] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:05:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:05:42.563368 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e7915-d5a2-41b9-989d-1f40ba526218 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:42.564471 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e7915-d5a2-41b9-989d-1f40ba526218 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:42.564756 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e7915-d5a2-41b9-989d-1f40ba526218 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:42.566114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1326/2663] 10.222.0.30 () {54 vars in 961 bytes} [Tue Sep 6 23:05:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 23:05:42.571316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc95af3-c87c-4d39-a650-fd88acf18f2b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:42.571736 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc95af3-c87c-4d39-a650-fd88acf18f2b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:42.571858 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc95af3-c87c-4d39-a650-fd88acf18f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:42.627930 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-cbc95af3-c87c-4d39-a650-fd88acf18f2b None None] MFA Rules not processed for user `4f6bd5bbbf65461990c9bb2747dbe5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:42.629291 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-cbc95af3-c87c-4d39-a650-fd88acf18f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:42.705355 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1338/2664] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Sep 6 23:05:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 23:05:42.714434 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e7915-d5a2-41b9-989d-1f40ba526218 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:42.729805 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e7915-d5a2-41b9-989d-1f40ba526218 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:42.734711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e021eb2-b460-4bf1-826d-cedd69452685 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bd5bbbf65461990c9bb2747dbe5e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:42.735307 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e021eb2-b460-4bf1-826d-cedd69452685 service placement] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:42.735582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e021eb2-b460-4bf1-826d-cedd69452685 service placement] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:42.735851 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e021eb2-b460-4bf1-826d-cedd69452685 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:42.737602 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4e021eb2-b460-4bf1-826d-cedd69452685 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:42.750024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e021eb2-b460-4bf1-826d-cedd69452685 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:42.751654 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e021eb2-b460-4bf1-826d-cedd69452685 service placement] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:42.761560 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1327/2665] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:05:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:05:42.978449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc95af3-c87c-4d39-a650-fd88acf18f2b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:42.979889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-cbc95af3-c87c-4d39-a650-fd88acf18f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:42.991595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc95af3-c87c-4d39-a650-fd88acf18f2b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:42.995447 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05824c-fa9b-4d8c-acd0-6d2d939d2cac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:42.996065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05824c-fa9b-4d8c-acd0-6d2d939d2cac service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:42.998007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05824c-fa9b-4d8c-acd0-6d2d939d2cac service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:42.998292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05824c-fa9b-4d8c-acd0-6d2d939d2cac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:43.008550 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05824c-fa9b-4d8c-acd0-6d2d939d2cac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:43.009989 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05824c-fa9b-4d8c-acd0-6d2d939d2cac service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:43.014021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:43.020140 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1339/2666] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:05:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:05:45.799193 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc0cc7-e6cd-4bab-88cf-a018ebec96cc None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:45.799751 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc0cc7-e6cd-4bab-88cf-a018ebec96cc None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:45.799751 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc0cc7-e6cd-4bab-88cf-a018ebec96cc None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:45.801117 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1328/2667] 10.222.0.30 () {54 vars in 921 bytes} [Tue Sep 6 23:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 23:05:45.807636 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17390ef1-552f-404a-82ee-262770abf086 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:45.808081 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17390ef1-552f-404a-82ee-262770abf086 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:45.808214 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17390ef1-552f-404a-82ee-262770abf086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:45.840136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-17390ef1-552f-404a-82ee-262770abf086 None None] MFA Rules not processed for user `b18fd296138349408613004929144e70`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:45.841422 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-17390ef1-552f-404a-82ee-262770abf086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:45.917263 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1340/2668] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Sep 6 23:05:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:45.928823 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc0cc7-e6cd-4bab-88cf-a018ebec96cc None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:45.930569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-6dfc0cc7-e6cd-4bab-88cf-a018ebec96cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:45.990163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc0cc7-e6cd-4bab-88cf-a018ebec96cc None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:45.995782 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6df535-b791-435e-ba98-4725b6cf886d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a2c1f1668814a5e9e654c6308fa0628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:45.996518 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6df535-b791-435e-ba98-4725b6cf886d service glance] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:46.001630 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6df535-b791-435e-ba98-4725b6cf886d service glance] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:46.001630 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6df535-b791-435e-ba98-4725b6cf886d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:46.007659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6df535-b791-435e-ba98-4725b6cf886d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:46.009201 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6df535-b791-435e-ba98-4725b6cf886d service glance] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:46.020143 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1329/2669] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:05:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:05:46.239379 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6b65b-9258-4103-8ef5-67b2caefdebc None None] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:46.239670 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6b65b-9258-4103-8ef5-67b2caefdebc None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:46.239948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6b65b-9258-4103-8ef5-67b2caefdebc None None] PATH_INFO: `/` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:46.241410 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1341/2670] 10.222.0.30 () {54 vars in 921 bytes} [Tue Sep 6 23:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 23:05:46.246682 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533289c0-05a7-4c39-8e03-216bb361cd51 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:46.246901 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533289c0-05a7-4c39-8e03-216bb361cd51 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:46.247209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533289c0-05a7-4c39-8e03-216bb361cd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:46.267015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-533289c0-05a7-4c39-8e03-216bb361cd51 None None] MFA Rules not processed for user `314bb14d5fa1414a832efb6d37c0446d`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:46.268287 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-533289c0-05a7-4c39-8e03-216bb361cd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:46.321148 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1330/2671] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Sep 6 23:05:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:46.330840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6b65b-9258-4103-8ef5-67b2caefdebc None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:46.332710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1ec6b65b-9258-4103-8ef5-67b2caefdebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:46.349474 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6b65b-9258-4103-8ef5-67b2caefdebc None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:46.353889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23e234-f7b8-40f4-8f49-5c2c9751293e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:46.354512 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23e234-f7b8-40f4-8f49-5c2c9751293e service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:46.354780 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23e234-f7b8-40f4-8f49-5c2c9751293e service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:46.355053 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23e234-f7b8-40f4-8f49-5c2c9751293e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:46.362624 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23e234-f7b8-40f4-8f49-5c2c9751293e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:46.364086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23e234-f7b8-40f4-8f49-5c2c9751293e service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:46.371894 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1342/2672] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:05:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:05:46.456078 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fb96c-a3fc-4f07-ac04-29bf9eb2ced6 None None] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:46.456367 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fb96c-a3fc-4f07-ac04-29bf9eb2ced6 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:46.456678 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fb96c-a3fc-4f07-ac04-29bf9eb2ced6 None None] PATH_INFO: `/` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:46.458071 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1331/2673] 10.222.0.30 () {54 vars in 921 bytes} [Tue Sep 6 23:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 23:05:46.463354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b313dc1-ac59-44d3-b773-373737b3b4a1 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:46.464335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b313dc1-ac59-44d3-b773-373737b3b4a1 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:46.464335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b313dc1-ac59-44d3-b773-373737b3b4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:46.484454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-1b313dc1-ac59-44d3-b773-373737b3b4a1 None None] MFA Rules not processed for user `b18fd296138349408613004929144e70`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:46.485687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1b313dc1-ac59-44d3-b773-373737b3b4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:46.495262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1343/2674] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Sep 6 23:05:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:46.505715 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fb96c-a3fc-4f07-ac04-29bf9eb2ced6 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:46.517342 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fb96c-a3fc-4f07-ac04-29bf9eb2ced6 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:46.520951 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28028b01-a85c-4552-b433-c3afb91df449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:46.521539 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28028b01-a85c-4552-b433-c3afb91df449 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:46.521812 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28028b01-a85c-4552-b433-c3afb91df449 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:46.522081 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28028b01-a85c-4552-b433-c3afb91df449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:46.532448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28028b01-a85c-4552-b433-c3afb91df449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:46.533871 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28028b01-a85c-4552-b433-c3afb91df449 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:46.544859 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1332/2675] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:05:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:05:48.929090 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b313dc1-ac59-44d3-b773-373737b3b4a1 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:48.991532 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b313dc1-ac59-44d3-b773-373737b3b4a1 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:48.997549 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2ea9e-435d-4156-9546-eae09a465f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:48.998463 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2ea9e-435d-4156-9546-eae09a465f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:48.998880 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2ea9e-435d-4156-9546-eae09a465f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:48.999282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2ea9e-435d-4156-9546-eae09a465f6f admin admin] PATH_INFO: `/v3/users/33fe6f63b77947ffa20f0d7404ea8a79` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:49.001120 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2ea9e-435d-4156-9546-eae09a465f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=33fe6f63b77947ffa20f0d7404ea8a79)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:49.003749 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2ea9e-435d-4156-9546-eae09a465f6f admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:49.200627 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c8f2ea9e-435d-4156-9546-eae09a465f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33fe6f63b77947ffa20f0d7404ea8a79'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:49.200822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9e51d-f3b5-45d7-853a-16f7ab5c8ae9 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:49.201269 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9e51d-f3b5-45d7-853a-16f7ab5c8ae9 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:49.201269 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9e51d-f3b5-45d7-853a-16f7ab5c8ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:49.204924 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:49.221702 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-8be9e51d-f3b5-45d7-853a-16f7ab5c8ae9 None None] MFA Rules not processed for user `642d4bef7e9c459a8d2dde636094b528`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:49.222875 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8be9e51d-f3b5-45d7-853a-16f7ab5c8ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:49.256910 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c8f2ea9e-435d-4156-9546-eae09a465f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33fe6f63b77947ffa20f0d7404ea8a79'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:49.257649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c8f2ea9e-435d-4156-9546-eae09a465f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33fe6f63b77947ffa20f0d7404ea8a79'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:49.269153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:49.273164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c8f2ea9e-435d-4156-9546-eae09a465f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33fe6f63b77947ffa20f0d7404ea8a79'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:49.273784 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c8f2ea9e-435d-4156-9546-eae09a465f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33fe6f63b77947ffa20f0d7404ea8a79'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:49.285765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1333/2676] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Sep 6 23:05:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 23:05:49.290373 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1344/2677] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:05:48 2022] DELETE /identity/v3/users/33fe6f63b77947ffa20f0d7404ea8a79 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:49.295366 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902311f5-1817-43ec-83d5-6bb792e23027 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:49.295653 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902311f5-1817-43ec-83d5-6bb792e23027 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:49.295925 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902311f5-1817-43ec-83d5-6bb792e23027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:49.297934 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2ea9e-435d-4156-9546-eae09a465f6f admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:49.299423 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c8f2ea9e-435d-4156-9546-eae09a465f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:49.315137 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-902311f5-1817-43ec-83d5-6bb792e23027 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:49.316344 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-902311f5-1817-43ec-83d5-6bb792e23027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:49.380947 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1334/2678] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:49.381164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2ea9e-435d-4156-9546-eae09a465f6f admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:49.386086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aad25a-8b0e-40a9-a292-890c63500d9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660248a90f524a43b143bae127e0eaa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:49.386710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aad25a-8b0e-40a9-a292-890c63500d9f service swift] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:49.386992 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aad25a-8b0e-40a9-a292-890c63500d9f service swift] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:49.387264 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aad25a-8b0e-40a9-a292-890c63500d9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:49.388512 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902311f5-1817-43ec-83d5-6bb792e23027 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:49.390416 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-902311f5-1817-43ec-83d5-6bb792e23027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:49.445302 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aad25a-8b0e-40a9-a292-890c63500d9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:49.446927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aad25a-8b0e-40a9-a292-890c63500d9f service swift] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:49.447696 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902311f5-1817-43ec-83d5-6bb792e23027 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:49.451300 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020b197-1bed-443b-88a8-a13ed8d7e33f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:49.451976 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020b197-1bed-443b-88a8-a13ed8d7e33f service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:49.452177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020b197-1bed-443b-88a8-a13ed8d7e33f service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:49.452481 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020b197-1bed-443b-88a8-a13ed8d7e33f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:49.455805 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1345/2679] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Sep 6 23:05:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 23:05:49.462018 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020b197-1bed-443b-88a8-a13ed8d7e33f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:49.463979 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020b197-1bed-443b-88a8-a13ed8d7e33f service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:49.473859 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1335/2680] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:05:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 23:05:49.993707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aad25a-8b0e-40a9-a292-890c63500d9f service swift] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:49.995797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-88aad25a-8b0e-40a9-a292-890c63500d9f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:50.015077 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aad25a-8b0e-40a9-a292-890c63500d9f service swift] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:50.020661 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34963c-351e-40d4-8368-525c555620f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:50.021314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34963c-351e-40d4-8368-525c555620f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:50.021643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34963c-351e-40d4-8368-525c555620f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:50.021931 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34963c-351e-40d4-8368-525c555620f7 admin admin] PATH_INFO: `/v3/projects/d72edc2a840d42d9b65126bb618740eb` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:50.023084 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34963c-351e-40d4-8368-525c555620f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d72edc2a840d42d9b65126bb618740eb)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:50.025703 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34963c-351e-40d4-8368-525c555620f7 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:50.162558 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-2a34963c-351e-40d4-8368-525c555620f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd72edc2a840d42d9b65126bb618740eb', 'request_id': 'req-2a34963c-351e-40d4-8368-525c555620f7'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:50.169089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-2a34963c-351e-40d4-8368-525c555620f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd72edc2a840d42d9b65126bb618740eb', 'request_id': 'req-2a34963c-351e-40d4-8368-525c555620f7'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:50.239710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-2a34963c-351e-40d4-8368-525c555620f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd72edc2a840d42d9b65126bb618740eb', 'request_id': 'req-2a34963c-351e-40d4-8368-525c555620f7'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:50.244818 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:50.252287 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-2a34963c-351e-40d4-8368-525c555620f7 admin admin] The token cache is being invalidate because project d72edc2a840d42d9b65126bb618740eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:05:50.252677 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-2a34963c-351e-40d4-8368-525c555620f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:50.253424 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-2a34963c-351e-40d4-8368-525c555620f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:50.258577 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1346/2681] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:05:49 2022] DELETE /identity/v3/projects/d72edc2a840d42d9b65126bb618740eb => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:50.263019 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020b197-1bed-443b-88a8-a13ed8d7e33f service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:50.286852 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020b197-1bed-443b-88a8-a13ed8d7e33f service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:50.375677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e4749-6210-4e96-98bd-07c3333bc359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:50.376325 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e4749-6210-4e96-98bd-07c3333bc359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:50.376654 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e4749-6210-4e96-98bd-07c3333bc359 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:50.377004 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e4749-6210-4e96-98bd-07c3333bc359 admin admin] PATH_INFO: `/v3/users/6bc870829a3a44348964ef31b61928f4` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:50.378165 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e4749-6210-4e96-98bd-07c3333bc359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bc870829a3a44348964ef31b61928f4)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:50.380333 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e4749-6210-4e96-98bd-07c3333bc359 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:50.559638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:50.572775 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ea4e4749-6210-4e96-98bd-07c3333bc359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bc870829a3a44348964ef31b61928f4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:50.646046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ea4e4749-6210-4e96-98bd-07c3333bc359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bc870829a3a44348964ef31b61928f4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:50.646709 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ea4e4749-6210-4e96-98bd-07c3333bc359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bc870829a3a44348964ef31b61928f4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:50.647338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ea4e4749-6210-4e96-98bd-07c3333bc359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bc870829a3a44348964ef31b61928f4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:50.661311 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-ea4e4749-6210-4e96-98bd-07c3333bc359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bc870829a3a44348964ef31b61928f4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:50.688496 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1336/2682] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:05:50 2022] DELETE /identity/v3/users/6bc870829a3a44348964ef31b61928f4 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:51.133990 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34963c-351e-40d4-8368-525c555620f7 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:51.135480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-2a34963c-351e-40d4-8368-525c555620f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:51.164454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34963c-351e-40d4-8368-525c555620f7 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:51.227211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c091607-6f07-434e-bc19-1970b2d00268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:51.229507 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c091607-6f07-434e-bc19-1970b2d00268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:51.229507 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c091607-6f07-434e-bc19-1970b2d00268 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:51.229507 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c091607-6f07-434e-bc19-1970b2d00268 admin admin] PATH_INFO: `/v3/projects/82e9ae14169d422595a24a02bcd0472c` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:51.229913 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c091607-6f07-434e-bc19-1970b2d00268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e9ae14169d422595a24a02bcd0472c)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:51.231838 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c091607-6f07-434e-bc19-1970b2d00268 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:51.331440 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-7c091607-6f07-434e-bc19-1970b2d00268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e9ae14169d422595a24a02bcd0472c', 'request_id': 'req-7c091607-6f07-434e-bc19-1970b2d00268'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:51.338709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-7c091607-6f07-434e-bc19-1970b2d00268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e9ae14169d422595a24a02bcd0472c', 'request_id': 'req-7c091607-6f07-434e-bc19-1970b2d00268'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:51.411051 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-7c091607-6f07-434e-bc19-1970b2d00268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e9ae14169d422595a24a02bcd0472c', 'request_id': 'req-7c091607-6f07-434e-bc19-1970b2d00268'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:51.423187 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-7c091607-6f07-434e-bc19-1970b2d00268 admin admin] The token cache is being invalidate because project 82e9ae14169d422595a24a02bcd0472c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:05:51.423489 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-7c091607-6f07-434e-bc19-1970b2d00268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:51.424144 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-7c091607-6f07-434e-bc19-1970b2d00268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:51.425885 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1347/2683] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:05:51 2022] DELETE /identity/v3/projects/82e9ae14169d422595a24a02bcd0472c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:51.431891 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2781662-4a73-421f-abab-c8eee1fa6e6e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:51.432398 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2781662-4a73-421f-abab-c8eee1fa6e6e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:51.432398 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2781662-4a73-421f-abab-c8eee1fa6e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:51.454286 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b2781662-4a73-421f-abab-c8eee1fa6e6e None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:51.455559 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b2781662-4a73-421f-abab-c8eee1fa6e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:51.534589 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1337/2684] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:51.543194 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14dcc1-5c6e-4596-9a0c-8e8ad08a43fa None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:51.543480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14dcc1-5c6e-4596-9a0c-8e8ad08a43fa None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:51.543816 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14dcc1-5c6e-4596-9a0c-8e8ad08a43fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:51.567560 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-7e14dcc1-5c6e-4596-9a0c-8e8ad08a43fa None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:51.568969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7e14dcc1-5c6e-4596-9a0c-8e8ad08a43fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:51.585248 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1348/2685] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 23:05:51.586217 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2781662-4a73-421f-abab-c8eee1fa6e6e None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:51.597208 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2781662-4a73-421f-abab-c8eee1fa6e6e None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:51.602387 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc6d91-ec17-4050-bdd9-7027bcaef965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:51.603187 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc6d91-ec17-4050-bdd9-7027bcaef965 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:51.604093 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc6d91-ec17-4050-bdd9-7027bcaef965 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:51.605370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc6d91-ec17-4050-bdd9-7027bcaef965 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:51.606051 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc6d91-ec17-4050-bdd9-7027bcaef965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:05:51.606357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc6d91-ec17-4050-bdd9-7027bcaef965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:51.607983 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc6d91-ec17-4050-bdd9-7027bcaef965 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:51.628680 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1338/2686] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 23:05:51.629086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14dcc1-5c6e-4596-9a0c-8e8ad08a43fa None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:51.639319 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14dcc1-5c6e-4596-9a0c-8e8ad08a43fa None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:51.644372 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b137b-4f56-4640-8685-5ae313c9e3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:51.645045 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b137b-4f56-4640-8685-5ae313c9e3ac admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:51.645327 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b137b-4f56-4640-8685-5ae313c9e3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:51.645627 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b137b-4f56-4640-8685-5ae313c9e3ac admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:51.646627 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b137b-4f56-4640-8685-5ae313c9e3ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:51.648599 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b137b-4f56-4640-8685-5ae313c9e3ac admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:51.746883 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1349/2687] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:05:51 2022] POST /identity/v3/projects => generated 399 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 23:05:51.751073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc6d91-ec17-4050-bdd9-7027bcaef965 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:51.762284 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc6d91-ec17-4050-bdd9-7027bcaef965 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:51.831948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba010fe0-cc90-4f1e-8987-6f3029d9da12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:51.832604 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba010fe0-cc90-4f1e-8987-6f3029d9da12 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:51.832930 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba010fe0-cc90-4f1e-8987-6f3029d9da12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:51.833171 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba010fe0-cc90-4f1e-8987-6f3029d9da12 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:51.833795 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba010fe0-cc90-4f1e-8987-6f3029d9da12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:51.835745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba010fe0-cc90-4f1e-8987-6f3029d9da12 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:51.914772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1339/2688] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:05:51 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:05:51.919530 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b137b-4f56-4640-8685-5ae313c9e3ac admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:51.932235 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b137b-4f56-4640-8685-5ae313c9e3ac admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:51.936979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac586a-13c0-4f5b-8bb4-702d8a6ac3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:51.937593 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac586a-13c0-4f5b-8bb4-702d8a6ac3fc admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:51.937866 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac586a-13c0-4f5b-8bb4-702d8a6ac3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:51.938233 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac586a-13c0-4f5b-8bb4-702d8a6ac3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:51.938883 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac586a-13c0-4f5b-8bb4-702d8a6ac3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:51.940492 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac586a-13c0-4f5b-8bb4-702d8a6ac3fc admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:51.951832 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1350/2689] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:51.958554 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba010fe0-cc90-4f1e-8987-6f3029d9da12 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:51.970453 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba010fe0-cc90-4f1e-8987-6f3029d9da12 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:51.975693 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcbcef-f4ff-48aa-a589-f85f635231a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:51.976312 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcbcef-f4ff-48aa-a589-f85f635231a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:51.976622 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcbcef-f4ff-48aa-a589-f85f635231a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:51.976896 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcbcef-f4ff-48aa-a589-f85f635231a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:51.977543 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcbcef-f4ff-48aa-a589-f85f635231a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:51.979658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcbcef-f4ff-48aa-a589-f85f635231a2 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:51.995714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1340/2690] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:05:51.996457 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac586a-13c0-4f5b-8bb4-702d8a6ac3fc admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:52.006779 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac586a-13c0-4f5b-8bb4-702d8a6ac3fc admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:52.012187 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b70071-c923-4bf1-91c4-e49fa13553ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:52.013066 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b70071-c923-4bf1-91c4-e49fa13553ba admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:52.013362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b70071-c923-4bf1-91c4-e49fa13553ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:52.013653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b70071-c923-4bf1-91c4-e49fa13553ba admin admin] PATH_INFO: `/v3/projects/8a148f16b337438a9ae6f3bfeddf202f/users/6cd9221eeece4ab5829509e8ecde25f8/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:52.037033 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b70071-c923-4bf1-91c4-e49fa13553ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a148f16b337438a9ae6f3bfeddf202f, user_id=6cd9221eeece4ab5829509e8ecde25f8, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:52.040369 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b70071-c923-4bf1-91c4-e49fa13553ba admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:52.126834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1351/2691] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:05:51 2022] PUT /identity/v3/projects/8a148f16b337438a9ae6f3bfeddf202f/users/6cd9221eeece4ab5829509e8ecde25f8/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 23:05:52.139541 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b47947-2fd7-4418-9c3b-680075b22e57 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:52.139838 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b47947-2fd7-4418-9c3b-680075b22e57 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:52.140085 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b47947-2fd7-4418-9c3b-680075b22e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:52.170132 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-88b47947-2fd7-4418-9c3b-680075b22e57 None None] MFA Rules not processed for user `6cd9221eeece4ab5829509e8ecde25f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:52.171559 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-88b47947-2fd7-4418-9c3b-680075b22e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:52.177070 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:52.239489 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1341/2692] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:52 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:52.252117 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b70071-c923-4bf1-91c4-e49fa13553ba admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:52.253974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-12b70071-c923-4bf1-91c4-e49fa13553ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:52.278392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:52.316776 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b70071-c923-4bf1-91c4-e49fa13553ba admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:52.320893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51366366-5301-4c83-af93-828fd3b457f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:52.321542 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51366366-5301-4c83-af93-828fd3b457f1 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:52.321882 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51366366-5301-4c83-af93-828fd3b457f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:52.322667 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51366366-5301-4c83-af93-828fd3b457f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:52.331819 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51366366-5301-4c83-af93-828fd3b457f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:52.333450 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51366366-5301-4c83-af93-828fd3b457f1 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:52.344613 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1352/2693] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:05:52 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:05:58.322197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b47947-2fd7-4418-9c3b-680075b22e57 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:58.387236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b47947-2fd7-4418-9c3b-680075b22e57 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:58.392038 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822c1a1-3908-4eb5-aab4-65850250ef37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:58.392729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822c1a1-3908-4eb5-aab4-65850250ef37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:58.393021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822c1a1-3908-4eb5-aab4-65850250ef37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:58.393294 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822c1a1-3908-4eb5-aab4-65850250ef37 admin admin] PATH_INFO: `/v3/users/6cd9221eeece4ab5829509e8ecde25f8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:58.394520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822c1a1-3908-4eb5-aab4-65850250ef37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cd9221eeece4ab5829509e8ecde25f8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:58.396513 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822c1a1-3908-4eb5-aab4-65850250ef37 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:58.573419 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d822c1a1-3908-4eb5-aab4-65850250ef37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cd9221eeece4ab5829509e8ecde25f8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:58.637703 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d822c1a1-3908-4eb5-aab4-65850250ef37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cd9221eeece4ab5829509e8ecde25f8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:58.638238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d822c1a1-3908-4eb5-aab4-65850250ef37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cd9221eeece4ab5829509e8ecde25f8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:58.638843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d822c1a1-3908-4eb5-aab4-65850250ef37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cd9221eeece4ab5829509e8ecde25f8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:58.646858 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d822c1a1-3908-4eb5-aab4-65850250ef37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cd9221eeece4ab5829509e8ecde25f8'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:58.665582 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1342/2694] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:05:58 2022] DELETE /identity/v3/users/6cd9221eeece4ab5829509e8ecde25f8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:05:58.671331 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc114f-1eb7-4723-88df-0e0060e2e884 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:58.671862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc114f-1eb7-4723-88df-0e0060e2e884 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:58.671862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc114f-1eb7-4723-88df-0e0060e2e884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:58.692113 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-0bcc114f-1eb7-4723-88df-0e0060e2e884 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:05:58.693463 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0bcc114f-1eb7-4723-88df-0e0060e2e884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:58.768014 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1353/2695] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:05:58.778490 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822c1a1-3908-4eb5-aab4-65850250ef37 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:58.779987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d822c1a1-3908-4eb5-aab4-65850250ef37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:58.825433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:05:58.860227 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822c1a1-3908-4eb5-aab4-65850250ef37 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:58.864922 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52befe-8cbb-4466-b379-04220553ca0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:58.865757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52befe-8cbb-4466-b379-04220553ca0a service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:58.866172 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52befe-8cbb-4466-b379-04220553ca0a service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:58.866554 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52befe-8cbb-4466-b379-04220553ca0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:58.879290 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52befe-8cbb-4466-b379-04220553ca0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:58.881536 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52befe-8cbb-4466-b379-04220553ca0a service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:58.896343 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1343/2696] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:05:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:05:59.567146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc114f-1eb7-4723-88df-0e0060e2e884 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:05:59.568963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0bcc114f-1eb7-4723-88df-0e0060e2e884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:05:59.581920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc114f-1eb7-4723-88df-0e0060e2e884 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:05:59.586692 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b577b64-7a76-48b8-b4b5-0b0216ff70bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:05:59.587339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b577b64-7a76-48b8-b4b5-0b0216ff70bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:05:59.587610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b577b64-7a76-48b8-b4b5-0b0216ff70bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:05:59.587888 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b577b64-7a76-48b8-b4b5-0b0216ff70bc admin admin] PATH_INFO: `/v3/projects/8a148f16b337438a9ae6f3bfeddf202f` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:05:59.589642 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b577b64-7a76-48b8-b4b5-0b0216ff70bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a148f16b337438a9ae6f3bfeddf202f)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:05:59.591651 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b577b64-7a76-48b8-b4b5-0b0216ff70bc admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:05:59.685244 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-3b577b64-7a76-48b8-b4b5-0b0216ff70bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a148f16b337438a9ae6f3bfeddf202f', 'request_id': 'req-3b577b64-7a76-48b8-b4b5-0b0216ff70bc'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:59.691271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-3b577b64-7a76-48b8-b4b5-0b0216ff70bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a148f16b337438a9ae6f3bfeddf202f', 'request_id': 'req-3b577b64-7a76-48b8-b4b5-0b0216ff70bc'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:59.759423 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-3b577b64-7a76-48b8-b4b5-0b0216ff70bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a148f16b337438a9ae6f3bfeddf202f', 'request_id': 'req-3b577b64-7a76-48b8-b4b5-0b0216ff70bc'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:59.770632 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-3b577b64-7a76-48b8-b4b5-0b0216ff70bc admin admin] The token cache is being invalidate because project 8a148f16b337438a9ae6f3bfeddf202f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:05:59.770919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-3b577b64-7a76-48b8-b4b5-0b0216ff70bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:59.771542 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-3b577b64-7a76-48b8-b4b5-0b0216ff70bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:05:59.773055 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1354/2697] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:05:59 2022] DELETE /identity/v3/projects/8a148f16b337438a9ae6f3bfeddf202f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:06:09.166074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=15 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:06:09.767576 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:06:09.945972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19775d6-a307-4b2a-b155-01004dc98675 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:09.946256 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19775d6-a307-4b2a-b155-01004dc98675 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:09.946528 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19775d6-a307-4b2a-b155-01004dc98675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:09.966888 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a19775d6-a307-4b2a-b155-01004dc98675 None None] MFA Rules not processed for user `642d4bef7e9c459a8d2dde636094b528`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:06:09.968062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a19775d6-a307-4b2a-b155-01004dc98675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:10.026919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1344/2698] 10.222.0.30 () {58 vars in 967 bytes} [Tue Sep 6 23:06:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:06:10.040149 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b577b64-7a76-48b8-b4b5-0b0216ff70bc admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:10.041735 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3b577b64-7a76-48b8-b4b5-0b0216ff70bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:10.115072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b577b64-7a76-48b8-b4b5-0b0216ff70bc admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:10.120292 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9022d-5116-4317-8eee-2dff04532d54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '660248a90f524a43b143bae127e0eaa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:10.120944 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9022d-5116-4317-8eee-2dff04532d54 service swift] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:10.122080 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9022d-5116-4317-8eee-2dff04532d54 service swift] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:10.122364 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9022d-5116-4317-8eee-2dff04532d54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:10.131448 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9022d-5116-4317-8eee-2dff04532d54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:10.133103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9022d-5116-4317-8eee-2dff04532d54 service swift] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:10.142400 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1355/2699] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Sep 6 23:06:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 23:06:20.020058 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=25 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:06:20.139039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=32 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:06:32.563314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19775d6-a307-4b2a-b155-01004dc98675 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:32.564758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a19775d6-a307-4b2a-b155-01004dc98675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:32.622373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19775d6-a307-4b2a-b155-01004dc98675 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:32.642591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4501b49-faa7-48d6-a677-90661fb2839c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:32.642591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4501b49-faa7-48d6-a677-90661fb2839c service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:32.642591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4501b49-faa7-48d6-a677-90661fb2839c service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:32.642591 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4501b49-faa7-48d6-a677-90661fb2839c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:32.643086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a4501b49-faa7-48d6-a677-90661fb2839c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:32.692671 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4501b49-faa7-48d6-a677-90661fb2839c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:32.694203 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4501b49-faa7-48d6-a677-90661fb2839c service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:32.705147 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1345/2700] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:06:36.290305 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9022d-5116-4317-8eee-2dff04532d54 service swift] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:36.291750 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-70c9022d-5116-4317-8eee-2dff04532d54 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:36.307069 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9022d-5116-4317-8eee-2dff04532d54 service swift] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:36.311643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e4b31-1165-403b-ad91-ccfb38564490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:36.312260 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e4b31-1165-403b-ad91-ccfb38564490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:36.313159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e4b31-1165-403b-ad91-ccfb38564490 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:36.313432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e4b31-1165-403b-ad91-ccfb38564490 admin admin] PATH_INFO: `/v3/users/5655757c28a446ed8f7468a4146aa09c` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:36.314544 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e4b31-1165-403b-ad91-ccfb38564490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5655757c28a446ed8f7468a4146aa09c)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:36.316532 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e4b31-1165-403b-ad91-ccfb38564490 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:36.493522 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-700e4b31-1165-403b-ad91-ccfb38564490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5655757c28a446ed8f7468a4146aa09c'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:36.566229 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-700e4b31-1165-403b-ad91-ccfb38564490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5655757c28a446ed8f7468a4146aa09c'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:36.566843 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-700e4b31-1165-403b-ad91-ccfb38564490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5655757c28a446ed8f7468a4146aa09c'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:36.580612 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-700e4b31-1165-403b-ad91-ccfb38564490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5655757c28a446ed8f7468a4146aa09c'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:36.581820 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-700e4b31-1165-403b-ad91-ccfb38564490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5655757c28a446ed8f7468a4146aa09c'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:36.595649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1356/2701] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:06:36 2022] DELETE /identity/v3/users/5655757c28a446ed8f7468a4146aa09c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:06:36.602866 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4501b49-faa7-48d6-a677-90661fb2839c service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:36.612728 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4501b49-faa7-48d6-a677-90661fb2839c service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:36.673757 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d05e91-c397-4913-b49c-391ea0a56db2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:36.674371 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d05e91-c397-4913-b49c-391ea0a56db2 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:36.674674 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d05e91-c397-4913-b49c-391ea0a56db2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:36.674947 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d05e91-c397-4913-b49c-391ea0a56db2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:36.676844 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-61d05e91-c397-4913-b49c-391ea0a56db2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:36.742767 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d05e91-c397-4913-b49c-391ea0a56db2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:36.744032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d05e91-c397-4913-b49c-391ea0a56db2 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:36.753370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1346/2702] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:06:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:06:36.889817 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e4b31-1165-403b-ad91-ccfb38564490 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:36.891844 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-700e4b31-1165-403b-ad91-ccfb38564490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:36.970628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e4b31-1165-403b-ad91-ccfb38564490 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:36.975283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad5fef-6057-4ac7-af75-b3888052839f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:36.975913 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad5fef-6057-4ac7-af75-b3888052839f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:36.976183 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad5fef-6057-4ac7-af75-b3888052839f admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:36.976477 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad5fef-6057-4ac7-af75-b3888052839f admin admin] PATH_INFO: `/v3/projects/03584e607ce74fa398f793b8fdb1145e` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:36.978120 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad5fef-6057-4ac7-af75-b3888052839f admin admin] RBAC: Authorizing `identity:delete_project(project_id=03584e607ce74fa398f793b8fdb1145e)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:36.980078 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad5fef-6057-4ac7-af75-b3888052839f admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:37.082806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-dbad5fef-6057-4ac7-af75-b3888052839f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03584e607ce74fa398f793b8fdb1145e', 'request_id': 'req-dbad5fef-6057-4ac7-af75-b3888052839f'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:37.089241 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-dbad5fef-6057-4ac7-af75-b3888052839f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03584e607ce74fa398f793b8fdb1145e', 'request_id': 'req-dbad5fef-6057-4ac7-af75-b3888052839f'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:37.152317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-dbad5fef-6057-4ac7-af75-b3888052839f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03584e607ce74fa398f793b8fdb1145e', 'request_id': 'req-dbad5fef-6057-4ac7-af75-b3888052839f'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:37.164401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-dbad5fef-6057-4ac7-af75-b3888052839f admin admin] The token cache is being invalidate because project 03584e607ce74fa398f793b8fdb1145e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:06:37.164725 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-dbad5fef-6057-4ac7-af75-b3888052839f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:37.165355 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-dbad5fef-6057-4ac7-af75-b3888052839f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:37.166837 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1357/2703] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:06:36 2022] DELETE /identity/v3/projects/03584e607ce74fa398f793b8fdb1145e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:06:37.172040 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14d303-c712-4d22-9c78-921910292a64 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:37.172356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14d303-c712-4d22-9c78-921910292a64 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:37.172672 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14d303-c712-4d22-9c78-921910292a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:37.181373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:06:37.193196 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-ea14d303-c712-4d22-9c78-921910292a64 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:06:37.194477 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-ea14d303-c712-4d22-9c78-921910292a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:37.252233 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1347/2704] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:06:37.260129 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6c0d3-6f64-41b0-a058-6abee3b07891 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:37.260413 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6c0d3-6f64-41b0-a058-6abee3b07891 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:37.260737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6c0d3-6f64-41b0-a058-6abee3b07891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:37.269356 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:06:37.281542 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-15a6c0d3-6f64-41b0-a058-6abee3b07891 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:06:37.282735 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-15a6c0d3-6f64-41b0-a058-6abee3b07891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:37.290777 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1358/2705] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:06:37.294853 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14d303-c712-4d22-9c78-921910292a64 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:37.304948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14d303-c712-4d22-9c78-921910292a64 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:37.309522 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0da7a-16e6-4cf8-8a4c-02489a13ceb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:37.310113 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0da7a-16e6-4cf8-8a4c-02489a13ceb6 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:37.310387 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0da7a-16e6-4cf8-8a4c-02489a13ceb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:37.310661 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0da7a-16e6-4cf8-8a4c-02489a13ceb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:37.311332 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0da7a-16e6-4cf8-8a4c-02489a13ceb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:06:37.311615 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0da7a-16e6-4cf8-8a4c-02489a13ceb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:37.313764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0da7a-16e6-4cf8-8a4c-02489a13ceb6 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:37.328743 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1348/2706] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 23:06:37.332989 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6c0d3-6f64-41b0-a058-6abee3b07891 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:37.342397 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6c0d3-6f64-41b0-a058-6abee3b07891 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:37.347039 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f6e1d-e78c-46c1-95e6-d438f7f5a75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:37.347636 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f6e1d-e78c-46c1-95e6-d438f7f5a75a admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:37.347914 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f6e1d-e78c-46c1-95e6-d438f7f5a75a admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:37.348187 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f6e1d-e78c-46c1-95e6-d438f7f5a75a admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:37.348856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f6e1d-e78c-46c1-95e6-d438f7f5a75a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:37.350754 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f6e1d-e78c-46c1-95e6-d438f7f5a75a admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:37.436685 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1359/2707] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:06:37 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:06:37.441373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0da7a-16e6-4cf8-8a4c-02489a13ceb6 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:37.451446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0da7a-16e6-4cf8-8a4c-02489a13ceb6 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:37.510463 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280a0ae-383b-43a6-b8f6-90b986b47937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:37.515155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280a0ae-383b-43a6-b8f6-90b986b47937 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:37.515155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280a0ae-383b-43a6-b8f6-90b986b47937 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:37.515155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280a0ae-383b-43a6-b8f6-90b986b47937 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:37.515155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280a0ae-383b-43a6-b8f6-90b986b47937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:37.515155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280a0ae-383b-43a6-b8f6-90b986b47937 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:37.598768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1349/2708] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:06:37 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:06:37.603235 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f6e1d-e78c-46c1-95e6-d438f7f5a75a admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:37.614391 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f6e1d-e78c-46c1-95e6-d438f7f5a75a admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:37.619247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a153e7-16a4-45bf-a111-5e97c028c0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:37.619980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a153e7-16a4-45bf-a111-5e97c028c0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:37.620331 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a153e7-16a4-45bf-a111-5e97c028c0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:37.620723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a153e7-16a4-45bf-a111-5e97c028c0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:37.621445 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a153e7-16a4-45bf-a111-5e97c028c0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:37.623091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a153e7-16a4-45bf-a111-5e97c028c0c4 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:37.634034 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1360/2709] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:06:37.638070 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280a0ae-383b-43a6-b8f6-90b986b47937 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:37.648782 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280a0ae-383b-43a6-b8f6-90b986b47937 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:37.653621 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9275bf-845c-4f1f-bbc6-48844bb19362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:37.654299 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9275bf-845c-4f1f-bbc6-48844bb19362 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:37.654659 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9275bf-845c-4f1f-bbc6-48844bb19362 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:37.655018 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9275bf-845c-4f1f-bbc6-48844bb19362 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:37.655739 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9275bf-845c-4f1f-bbc6-48844bb19362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:37.657480 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9275bf-845c-4f1f-bbc6-48844bb19362 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:37.672387 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1350/2710] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:06:37.673662 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a153e7-16a4-45bf-a111-5e97c028c0c4 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:37.683862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a153e7-16a4-45bf-a111-5e97c028c0c4 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:37.690130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9ba4d-2f3b-4707-9a9a-15577c853c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:37.690803 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9ba4d-2f3b-4707-9a9a-15577c853c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:37.697309 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9ba4d-2f3b-4707-9a9a-15577c853c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:37.697309 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9ba4d-2f3b-4707-9a9a-15577c853c67 admin admin] PATH_INFO: `/v3/projects/573e264c221640949568d1ff7122b9f3/users/95cb85690d134abe919e472d8530bda4/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:37.707173 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9ba4d-2f3b-4707-9a9a-15577c853c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=573e264c221640949568d1ff7122b9f3, user_id=95cb85690d134abe919e472d8530bda4, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:37.710051 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9ba4d-2f3b-4707-9a9a-15577c853c67 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:37.791084 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1361/2711] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:06:37 2022] PUT /identity/v3/projects/573e264c221640949568d1ff7122b9f3/users/95cb85690d134abe919e472d8530bda4/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:06:37.794878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99634ba-d5fb-4c92-944c-5b695e99f9d0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:37.794878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99634ba-d5fb-4c92-944c-5b695e99f9d0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:37.794878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99634ba-d5fb-4c92-944c-5b695e99f9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:37.823169 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a99634ba-d5fb-4c92-944c-5b695e99f9d0 None None] MFA Rules not processed for user `95cb85690d134abe919e472d8530bda4`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:06:37.824553 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a99634ba-d5fb-4c92-944c-5b695e99f9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:37.902657 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:06:37.908232 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1351/2712] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:06:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:06:37.912836 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9ba4d-2f3b-4707-9a9a-15577c853c67 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:37.994642 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9ba4d-2f3b-4707-9a9a-15577c853c67 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:37.999750 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c2469-2b72-40c2-aa34-c7f174c1fa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:38.000616 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c2469-2b72-40c2-aa34-c7f174c1fa11 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:38.001097 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c2469-2b72-40c2-aa34-c7f174c1fa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:38.001468 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c2469-2b72-40c2-aa34-c7f174c1fa11 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:38.002324 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c2469-2b72-40c2-aa34-c7f174c1fa11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:38.004497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c2469-2b72-40c2-aa34-c7f174c1fa11 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:38.121181 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1362/2713] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:06:37 2022] POST /identity/v3/projects => generated 371 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:06:38.126737 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99634ba-d5fb-4c92-944c-5b695e99f9d0 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:38.143872 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99634ba-d5fb-4c92-944c-5b695e99f9d0 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:38.207536 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e684b22-2fa8-4dcd-9172-f1997651798c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:38.208259 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e684b22-2fa8-4dcd-9172-f1997651798c admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:38.208573 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e684b22-2fa8-4dcd-9172-f1997651798c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:38.208849 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e684b22-2fa8-4dcd-9172-f1997651798c admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:38.209486 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e684b22-2fa8-4dcd-9172-f1997651798c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:38.211434 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e684b22-2fa8-4dcd-9172-f1997651798c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:38.298370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1352/2714] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:06:38 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:06:38.299855 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c2469-2b72-40c2-aa34-c7f174c1fa11 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:38.318716 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c2469-2b72-40c2-aa34-c7f174c1fa11 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:38.323513 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a3e94-5375-4441-9fe4-b81942b93537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:38.324199 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a3e94-5375-4441-9fe4-b81942b93537 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:38.324598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a3e94-5375-4441-9fe4-b81942b93537 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:38.325072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a3e94-5375-4441-9fe4-b81942b93537 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:38.325681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a3e94-5375-4441-9fe4-b81942b93537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:38.327362 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a3e94-5375-4441-9fe4-b81942b93537 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:38.338993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1363/2715] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:06:38.343196 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e684b22-2fa8-4dcd-9172-f1997651798c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:38.354477 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e684b22-2fa8-4dcd-9172-f1997651798c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:38.359175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708256b3-1657-4709-a94e-c34ac28c16c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:38.359892 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708256b3-1657-4709-a94e-c34ac28c16c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:38.360172 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708256b3-1657-4709-a94e-c34ac28c16c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:38.360472 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708256b3-1657-4709-a94e-c34ac28c16c5 admin admin] PATH_INFO: `/v3/projects/d1ad239511414375af54a6572ca66ae2/users/93e16d2d8dc749628d82e37ffd899f96/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:38.376100 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708256b3-1657-4709-a94e-c34ac28c16c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ad239511414375af54a6572ca66ae2, user_id=93e16d2d8dc749628d82e37ffd899f96, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:38.378995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708256b3-1657-4709-a94e-c34ac28c16c5 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:38.440165 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1353/2716] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:06:38 2022] PUT /identity/v3/projects/d1ad239511414375af54a6572ca66ae2/users/93e16d2d8dc749628d82e37ffd899f96/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:06:38.441690 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a3e94-5375-4441-9fe4-b81942b93537 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:38.451852 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a3e94-5375-4441-9fe4-b81942b93537 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:38.513454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4484f96-3d4d-44be-9727-e10213be0a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:38.514159 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4484f96-3d4d-44be-9727-e10213be0a86 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:38.514442 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4484f96-3d4d-44be-9727-e10213be0a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:38.514713 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4484f96-3d4d-44be-9727-e10213be0a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:38.515391 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4484f96-3d4d-44be-9727-e10213be0a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:38.517548 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4484f96-3d4d-44be-9727-e10213be0a86 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:38.528019 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1364/2717] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:06:38.532837 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708256b3-1657-4709-a94e-c34ac28c16c5 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:38.544046 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708256b3-1657-4709-a94e-c34ac28c16c5 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:38.549166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120912e4-3834-45a8-a7fd-f15a59d98fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:38.549826 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120912e4-3834-45a8-a7fd-f15a59d98fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:38.550107 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120912e4-3834-45a8-a7fd-f15a59d98fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:38.550383 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120912e4-3834-45a8-a7fd-f15a59d98fe3 admin admin] PATH_INFO: `/v3/projects/d1ad239511414375af54a6572ca66ae2/users/93e16d2d8dc749628d82e37ffd899f96/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:38.552463 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120912e4-3834-45a8-a7fd-f15a59d98fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ad239511414375af54a6572ca66ae2, user_id=93e16d2d8dc749628d82e37ffd899f96, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:38.555153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120912e4-3834-45a8-a7fd-f15a59d98fe3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:38.566437 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1354/2718] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:06:38 2022] PUT /identity/v3/projects/d1ad239511414375af54a6572ca66ae2/users/93e16d2d8dc749628d82e37ffd899f96/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 23:06:38.576692 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098737d-a0da-4b7c-969d-74686ab30d91 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:38.576976 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098737d-a0da-4b7c-969d-74686ab30d91 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:38.577248 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098737d-a0da-4b7c-969d-74686ab30d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:38.599247 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:06:38.608565 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-f098737d-a0da-4b7c-969d-74686ab30d91 None None] MFA Rules not processed for user `93e16d2d8dc749628d82e37ffd899f96`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:06:38.609821 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f098737d-a0da-4b7c-969d-74686ab30d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:38.684570 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1365/2719] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:06:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:06:38.697140 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120912e4-3834-45a8-a7fd-f15a59d98fe3 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:38.698955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-120912e4-3834-45a8-a7fd-f15a59d98fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:38.762970 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120912e4-3834-45a8-a7fd-f15a59d98fe3 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:38.767435 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f55693-1da0-43ad-976b-34102d9d8981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:38.768043 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f55693-1da0-43ad-976b-34102d9d8981 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:38.768327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f55693-1da0-43ad-976b-34102d9d8981 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:38.768634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f55693-1da0-43ad-976b-34102d9d8981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:38.778760 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f55693-1da0-43ad-976b-34102d9d8981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:38.780318 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f55693-1da0-43ad-976b-34102d9d8981 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:38.790864 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1355/2720] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:06:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:06:39.769485 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098737d-a0da-4b7c-969d-74686ab30d91 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:39.832594 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098737d-a0da-4b7c-969d-74686ab30d91 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:39.837172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc941f4-f951-44e0-847c-de7d9eee1e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:39.837808 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc941f4-f951-44e0-847c-de7d9eee1e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:39.838092 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc941f4-f951-44e0-847c-de7d9eee1e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:39.838371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc941f4-f951-44e0-847c-de7d9eee1e67 admin admin] PATH_INFO: `/v3/users/95cb85690d134abe919e472d8530bda4` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:39.839502 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc941f4-f951-44e0-847c-de7d9eee1e67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95cb85690d134abe919e472d8530bda4)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:39.841474 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc941f4-f951-44e0-847c-de7d9eee1e67 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:40.012148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0cc941f4-f951-44e0-847c-de7d9eee1e67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95cb85690d134abe919e472d8530bda4'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:40.078755 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0cc941f4-f951-44e0-847c-de7d9eee1e67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95cb85690d134abe919e472d8530bda4'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:40.079390 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0cc941f4-f951-44e0-847c-de7d9eee1e67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95cb85690d134abe919e472d8530bda4'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:40.092366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0cc941f4-f951-44e0-847c-de7d9eee1e67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95cb85690d134abe919e472d8530bda4'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:40.093096 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-0cc941f4-f951-44e0-847c-de7d9eee1e67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95cb85690d134abe919e472d8530bda4'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:40.106976 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1366/2721] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:06:39 2022] DELETE /identity/v3/users/95cb85690d134abe919e472d8530bda4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:06:40.111549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bfc94-5fde-4617-9aa8-778ec18cfaac None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:40.112064 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bfc94-5fde-4617-9aa8-778ec18cfaac None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:40.112484 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bfc94-5fde-4617-9aa8-778ec18cfaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:40.131025 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-929bfc94-5fde-4617-9aa8-778ec18cfaac None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:06:40.132225 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-929bfc94-5fde-4617-9aa8-778ec18cfaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:40.181338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:06:40.192948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1356/2722] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:06:40.203798 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc941f4-f951-44e0-847c-de7d9eee1e67 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:40.205321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0cc941f4-f951-44e0-847c-de7d9eee1e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:40.220145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:06:40.268271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc941f4-f951-44e0-847c-de7d9eee1e67 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:40.272102 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8c31c-cbdd-45f1-97bd-598c1cb7a631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:40.272739 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8c31c-cbdd-45f1-97bd-598c1cb7a631 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:40.273016 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8c31c-cbdd-45f1-97bd-598c1cb7a631 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:40.273284 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8c31c-cbdd-45f1-97bd-598c1cb7a631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:40.282495 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8c31c-cbdd-45f1-97bd-598c1cb7a631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:40.283913 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8c31c-cbdd-45f1-97bd-598c1cb7a631 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:40.293223 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1367/2723] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:06:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:06:40.752144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bfc94-5fde-4617-9aa8-778ec18cfaac None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:40.753945 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-929bfc94-5fde-4617-9aa8-778ec18cfaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:40.768243 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bfc94-5fde-4617-9aa8-778ec18cfaac None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:40.780887 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28e1c3-7b3c-41be-b039-feec4dfb8d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:40.781550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28e1c3-7b3c-41be-b039-feec4dfb8d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:40.781832 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28e1c3-7b3c-41be-b039-feec4dfb8d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:40.782105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28e1c3-7b3c-41be-b039-feec4dfb8d18 admin admin] PATH_INFO: `/v3/projects/573e264c221640949568d1ff7122b9f3` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:40.783297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28e1c3-7b3c-41be-b039-feec4dfb8d18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=573e264c221640949568d1ff7122b9f3)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:40.785339 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28e1c3-7b3c-41be-b039-feec4dfb8d18 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:41.057616 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cf28e1c3-7b3c-41be-b039-feec4dfb8d18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '573e264c221640949568d1ff7122b9f3', 'request_id': 'req-cf28e1c3-7b3c-41be-b039-feec4dfb8d18'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:41.064295 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cf28e1c3-7b3c-41be-b039-feec4dfb8d18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '573e264c221640949568d1ff7122b9f3', 'request_id': 'req-cf28e1c3-7b3c-41be-b039-feec4dfb8d18'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:41.155143 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cf28e1c3-7b3c-41be-b039-feec4dfb8d18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '573e264c221640949568d1ff7122b9f3', 'request_id': 'req-cf28e1c3-7b3c-41be-b039-feec4dfb8d18'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:41.167759 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cf28e1c3-7b3c-41be-b039-feec4dfb8d18 admin admin] The token cache is being invalidate because project 573e264c221640949568d1ff7122b9f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:06:41.168043 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cf28e1c3-7b3c-41be-b039-feec4dfb8d18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:41.168697 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-cf28e1c3-7b3c-41be-b039-feec4dfb8d18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:41.170231 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1357/2724] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:06:40 2022] DELETE /identity/v3/projects/573e264c221640949568d1ff7122b9f3 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:06:41.174763 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8c31c-cbdd-45f1-97bd-598c1cb7a631 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:41.184818 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8c31c-cbdd-45f1-97bd-598c1cb7a631 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:41.244771 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55f305-1aa9-4b4c-ade2-7d04db84bc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:41.245418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55f305-1aa9-4b4c-ade2-7d04db84bc03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:41.245701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55f305-1aa9-4b4c-ade2-7d04db84bc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:41.245976 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55f305-1aa9-4b4c-ade2-7d04db84bc03 admin admin] PATH_INFO: `/v3/users/93e16d2d8dc749628d82e37ffd899f96` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:41.247175 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55f305-1aa9-4b4c-ade2-7d04db84bc03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e16d2d8dc749628d82e37ffd899f96)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:41.249330 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55f305-1aa9-4b4c-ade2-7d04db84bc03 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:41.438357 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4b55f305-1aa9-4b4c-ade2-7d04db84bc03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e16d2d8dc749628d82e37ffd899f96'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:41.514863 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4b55f305-1aa9-4b4c-ade2-7d04db84bc03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e16d2d8dc749628d82e37ffd899f96'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:41.515485 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4b55f305-1aa9-4b4c-ade2-7d04db84bc03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e16d2d8dc749628d82e37ffd899f96'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:41.528538 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4b55f305-1aa9-4b4c-ade2-7d04db84bc03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e16d2d8dc749628d82e37ffd899f96'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:41.529214 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4b55f305-1aa9-4b4c-ade2-7d04db84bc03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e16d2d8dc749628d82e37ffd899f96'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:41.541360 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1368/2725] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:06:41 2022] DELETE /identity/v3/users/93e16d2d8dc749628d82e37ffd899f96 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:06:41.976948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28e1c3-7b3c-41be-b039-feec4dfb8d18 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:41.976948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cf28e1c3-7b3c-41be-b039-feec4dfb8d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:41.991523 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28e1c3-7b3c-41be-b039-feec4dfb8d18 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:42.052804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49a7bf-e758-4829-a4d7-f329bc72816c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:42.053447 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49a7bf-e758-4829-a4d7-f329bc72816c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:42.053724 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49a7bf-e758-4829-a4d7-f329bc72816c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:42.054000 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49a7bf-e758-4829-a4d7-f329bc72816c admin admin] PATH_INFO: `/v3/projects/d1ad239511414375af54a6572ca66ae2` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:42.055124 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49a7bf-e758-4829-a4d7-f329bc72816c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ad239511414375af54a6572ca66ae2)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:42.057090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49a7bf-e758-4829-a4d7-f329bc72816c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:42.147494 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3c49a7bf-e758-4829-a4d7-f329bc72816c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ad239511414375af54a6572ca66ae2', 'request_id': 'req-3c49a7bf-e758-4829-a4d7-f329bc72816c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:42.159099 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3c49a7bf-e758-4829-a4d7-f329bc72816c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ad239511414375af54a6572ca66ae2', 'request_id': 'req-3c49a7bf-e758-4829-a4d7-f329bc72816c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:42.240710 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3c49a7bf-e758-4829-a4d7-f329bc72816c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ad239511414375af54a6572ca66ae2', 'request_id': 'req-3c49a7bf-e758-4829-a4d7-f329bc72816c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:42.251281 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3c49a7bf-e758-4829-a4d7-f329bc72816c admin admin] The token cache is being invalidate because project d1ad239511414375af54a6572ca66ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:06:42.251565 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3c49a7bf-e758-4829-a4d7-f329bc72816c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:42.252184 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-3c49a7bf-e758-4829-a4d7-f329bc72816c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:42.253831 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1358/2726] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:06:41 2022] DELETE /identity/v3/projects/d1ad239511414375af54a6572ca66ae2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:06:42.259635 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9708ad7-5902-4d34-b630-f91d9fd08ce4 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:42.260119 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9708ad7-5902-4d34-b630-f91d9fd08ce4 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:42.260217 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9708ad7-5902-4d34-b630-f91d9fd08ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:42.280246 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-c9708ad7-5902-4d34-b630-f91d9fd08ce4 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:06:42.281497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c9708ad7-5902-4d34-b630-f91d9fd08ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:42.312061 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:06:42.340437 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1369/2727] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 23:06:42.348653 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edec97-e192-4f8c-b83f-842cc500b082 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:42.348947 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edec97-e192-4f8c-b83f-842cc500b082 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:42.349229 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edec97-e192-4f8c-b83f-842cc500b082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:42.369303 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a8edec97-e192-4f8c-b83f-842cc500b082 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:06:42.370507 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a8edec97-e192-4f8c-b83f-842cc500b082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:42.379063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1359/2728] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:06:42.383063 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9708ad7-5902-4d34-b630-f91d9fd08ce4 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:42.393135 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9708ad7-5902-4d34-b630-f91d9fd08ce4 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:42.397693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d03db1-932a-42aa-8b64-3744e4fbd7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:42.398285 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d03db1-932a-42aa-8b64-3744e4fbd7aa admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:42.398564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d03db1-932a-42aa-8b64-3744e4fbd7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:42.398834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d03db1-932a-42aa-8b64-3744e4fbd7aa admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:42.399471 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d03db1-932a-42aa-8b64-3744e4fbd7aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:06:42.399770 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d03db1-932a-42aa-8b64-3744e4fbd7aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:42.401392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d03db1-932a-42aa-8b64-3744e4fbd7aa admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:42.412632 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1370/2729] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 23:06:42.416970 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8edec97-e192-4f8c-b83f-842cc500b082 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:42.421393 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:06:42.426675 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8edec97-e192-4f8c-b83f-842cc500b082 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:42.431340 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693046c-8bd0-4648-ac84-58c49d22878b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:42.433144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693046c-8bd0-4648-ac84-58c49d22878b admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:42.433144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693046c-8bd0-4648-ac84-58c49d22878b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:42.433144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693046c-8bd0-4648-ac84-58c49d22878b admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:42.433144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693046c-8bd0-4648-ac84-58c49d22878b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:42.435122 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693046c-8bd0-4648-ac84-58c49d22878b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:42.544759 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1360/2730] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:06:42 2022] POST /identity/v3/projects => generated 357 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:06:42.548829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d03db1-932a-42aa-8b64-3744e4fbd7aa admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:42.558628 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d03db1-932a-42aa-8b64-3744e4fbd7aa admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:42.620278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de8bd5-9629-498a-b3ee-678f0c1cf9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:42.620921 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de8bd5-9629-498a-b3ee-678f0c1cf9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:42.621200 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de8bd5-9629-498a-b3ee-678f0c1cf9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:42.621472 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de8bd5-9629-498a-b3ee-678f0c1cf9a3 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:42.622095 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de8bd5-9629-498a-b3ee-678f0c1cf9a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:42.624024 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de8bd5-9629-498a-b3ee-678f0c1cf9a3 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:42.717875 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1371/2731] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:06:42 2022] POST /identity/v3/users => generated 279 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:06:42.721934 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693046c-8bd0-4648-ac84-58c49d22878b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:42.732805 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693046c-8bd0-4648-ac84-58c49d22878b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:42.738059 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b5e76-1d50-4789-b597-af1ad19b262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:42.738662 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b5e76-1d50-4789-b597-af1ad19b262b admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:42.738941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b5e76-1d50-4789-b597-af1ad19b262b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:42.739313 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b5e76-1d50-4789-b597-af1ad19b262b admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:42.739966 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b5e76-1d50-4789-b597-af1ad19b262b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:42.741652 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b5e76-1d50-4789-b597-af1ad19b262b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:42.752317 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1361/2732] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:06:42.756316 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de8bd5-9629-498a-b3ee-678f0c1cf9a3 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:42.770371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de8bd5-9629-498a-b3ee-678f0c1cf9a3 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:42.776210 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5a37e-8b1a-42db-bb62-0fe3616b9136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:42.777583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5a37e-8b1a-42db-bb62-0fe3616b9136 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:42.777583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5a37e-8b1a-42db-bb62-0fe3616b9136 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:42.777583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5a37e-8b1a-42db-bb62-0fe3616b9136 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:42.778156 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5a37e-8b1a-42db-bb62-0fe3616b9136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:42.779794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5a37e-8b1a-42db-bb62-0fe3616b9136 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:42.791494 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1372/2733] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:06:42.795663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b5e76-1d50-4789-b597-af1ad19b262b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:42.807429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b5e76-1d50-4789-b597-af1ad19b262b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:42.812221 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82969d-6bf3-432c-8ba2-e62fed65b0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:42.812914 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82969d-6bf3-432c-8ba2-e62fed65b0d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:42.813198 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82969d-6bf3-432c-8ba2-e62fed65b0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:42.813472 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82969d-6bf3-432c-8ba2-e62fed65b0d1 admin admin] PATH_INFO: `/v3/projects/fd237f2ea9d94698bffbde150adcb403/users/1b6fea740b024eb380fec315636f6d0a/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:42.829313 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82969d-6bf3-432c-8ba2-e62fed65b0d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd237f2ea9d94698bffbde150adcb403, user_id=1b6fea740b024eb380fec315636f6d0a, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:42.832054 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82969d-6bf3-432c-8ba2-e62fed65b0d1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:42.909676 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1362/2734] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:06:42 2022] PUT /identity/v3/projects/fd237f2ea9d94698bffbde150adcb403/users/1b6fea740b024eb380fec315636f6d0a/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:06:42.926094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131bea5-518d-49be-9b35-26c5c45981d8 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:42.926516 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131bea5-518d-49be-9b35-26c5c45981d8 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:42.926920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131bea5-518d-49be-9b35-26c5c45981d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:42.962859 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-7131bea5-518d-49be-9b35-26c5c45981d8 None None] MFA Rules not processed for user `1b6fea740b024eb380fec315636f6d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:06:42.964119 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7131bea5-518d-49be-9b35-26c5c45981d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:43.040893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1373/2735] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:06:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:06:43.045546 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82969d-6bf3-432c-8ba2-e62fed65b0d1 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:43.103766 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131bea5-518d-49be-9b35-26c5c45981d8 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:43.105165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7131bea5-518d-49be-9b35-26c5c45981d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:43.114692 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82969d-6bf3-432c-8ba2-e62fed65b0d1 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:43.119371 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289f102-6cec-4d61-b8be-00389a86ebb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:43.119984 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289f102-6cec-4d61-b8be-00389a86ebb1 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:43.120322 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289f102-6cec-4d61-b8be-00389a86ebb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:43.120632 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289f102-6cec-4d61-b8be-00389a86ebb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:43.121289 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289f102-6cec-4d61-b8be-00389a86ebb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:43.123206 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289f102-6cec-4d61-b8be-00389a86ebb1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:43.140753 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:06:43.163585 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131bea5-518d-49be-9b35-26c5c45981d8 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:43.167183 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17308945-1b54-470f-9494-4d349a608e46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:43.167793 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17308945-1b54-470f-9494-4d349a608e46 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:43.168076 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17308945-1b54-470f-9494-4d349a608e46 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:43.168355 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17308945-1b54-470f-9494-4d349a608e46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:43.170145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-17308945-1b54-470f-9494-4d349a608e46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:43.182440 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17308945-1b54-470f-9494-4d349a608e46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:43.183852 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17308945-1b54-470f-9494-4d349a608e46 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:43.193365 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1374/2736] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:06:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:06:43.208105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1363/2737] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:06:43 2022] POST /identity/v3/projects => generated 357 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:06:43.212138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17308945-1b54-470f-9494-4d349a608e46 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:43.222656 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17308945-1b54-470f-9494-4d349a608e46 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:43.278647 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce67ab-66b3-4c57-bdef-2392f2a18e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:43.279403 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce67ab-66b3-4c57-bdef-2392f2a18e07 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:43.279529 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce67ab-66b3-4c57-bdef-2392f2a18e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:43.279747 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce67ab-66b3-4c57-bdef-2392f2a18e07 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:43.280382 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce67ab-66b3-4c57-bdef-2392f2a18e07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:43.282349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce67ab-66b3-4c57-bdef-2392f2a18e07 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:43.355580 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1375/2738] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:06:43 2022] POST /identity/v3/users => generated 285 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 23:06:43.359495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289f102-6cec-4d61-b8be-00389a86ebb1 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:43.370318 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289f102-6cec-4d61-b8be-00389a86ebb1 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:43.374940 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8014590-f9ef-4679-a892-2f46917b2aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:43.375600 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8014590-f9ef-4679-a892-2f46917b2aba admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:43.375885 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8014590-f9ef-4679-a892-2f46917b2aba admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:43.376280 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8014590-f9ef-4679-a892-2f46917b2aba admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:43.376992 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8014590-f9ef-4679-a892-2f46917b2aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:43.378593 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8014590-f9ef-4679-a892-2f46917b2aba admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:43.388626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1364/2739] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 23:06:43.392889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce67ab-66b3-4c57-bdef-2392f2a18e07 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:43.403260 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce67ab-66b3-4c57-bdef-2392f2a18e07 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:43.408655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5be38-f307-4246-a73b-ebe74294ac63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:43.409313 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5be38-f307-4246-a73b-ebe74294ac63 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:43.409595 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5be38-f307-4246-a73b-ebe74294ac63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:43.409872 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5be38-f307-4246-a73b-ebe74294ac63 admin admin] PATH_INFO: `/v3/projects/a1692a2366c740d9b840e814c02e1918/users/8520a6cc291042ddb726c1d72457cda2/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:43.425833 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5be38-f307-4246-a73b-ebe74294ac63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1692a2366c740d9b840e814c02e1918, user_id=8520a6cc291042ddb726c1d72457cda2, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:43.428573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5be38-f307-4246-a73b-ebe74294ac63 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:43.487710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1376/2740] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:06:43 2022] PUT /identity/v3/projects/a1692a2366c740d9b840e814c02e1918/users/8520a6cc291042ddb726c1d72457cda2/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 23:06:43.491571 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8014590-f9ef-4679-a892-2f46917b2aba admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:43.501488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8014590-f9ef-4679-a892-2f46917b2aba admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:43.558254 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a83c27-4c9e-4281-bda0-bfabda98ded9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:43.558863 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a83c27-4c9e-4281-bda0-bfabda98ded9 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:43.559140 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a83c27-4c9e-4281-bda0-bfabda98ded9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:43.559411 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a83c27-4c9e-4281-bda0-bfabda98ded9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:43.560045 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a83c27-4c9e-4281-bda0-bfabda98ded9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:43.561681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a83c27-4c9e-4281-bda0-bfabda98ded9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:43.571341 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1365/2741] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:06:43.575648 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5be38-f307-4246-a73b-ebe74294ac63 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:43.586989 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5be38-f307-4246-a73b-ebe74294ac63 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:43.591716 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec9f57-c0d2-4c63-91da-e37888992c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:43.592384 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec9f57-c0d2-4c63-91da-e37888992c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:43.592695 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec9f57-c0d2-4c63-91da-e37888992c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:43.592963 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec9f57-c0d2-4c63-91da-e37888992c16 admin admin] PATH_INFO: `/v3/projects/a1692a2366c740d9b840e814c02e1918/users/8520a6cc291042ddb726c1d72457cda2/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:43.594876 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec9f57-c0d2-4c63-91da-e37888992c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1692a2366c740d9b840e814c02e1918, user_id=8520a6cc291042ddb726c1d72457cda2, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:43.598130 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec9f57-c0d2-4c63-91da-e37888992c16 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:43.609613 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1377/2742] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:06:43 2022] PUT /identity/v3/projects/a1692a2366c740d9b840e814c02e1918/users/8520a6cc291042ddb726c1d72457cda2/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 23:06:43.620341 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd19dc-05e7-4c5a-b7a3-6e59a2ebd0d0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:43.620842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd19dc-05e7-4c5a-b7a3-6e59a2ebd0d0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:43.621128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd19dc-05e7-4c5a-b7a3-6e59a2ebd0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:43.651104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f1fd19dc-05e7-4c5a-b7a3-6e59a2ebd0d0 None None] MFA Rules not processed for user `8520a6cc291042ddb726c1d72457cda2`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:06:43.652350 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f1fd19dc-05e7-4c5a-b7a3-6e59a2ebd0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:43.656646 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:06:43.728590 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1366/2743] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:06:43 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:06:43.740479 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec9f57-c0d2-4c63-91da-e37888992c16 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:43.742279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-afec9f57-c0d2-4c63-91da-e37888992c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:43.810128 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec9f57-c0d2-4c63-91da-e37888992c16 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:43.813826 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5777e-e3f1-41cf-9277-ba4a484f05cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:43.814449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5777e-e3f1-41cf-9277-ba4a484f05cc service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:43.814723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5777e-e3f1-41cf-9277-ba4a484f05cc service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:43.814993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5777e-e3f1-41cf-9277-ba4a484f05cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:43.824935 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5777e-e3f1-41cf-9277-ba4a484f05cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:43.826350 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5777e-e3f1-41cf-9277-ba4a484f05cc service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:43.837743 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1378/2744] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:06:43 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:06:44.086090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd19dc-05e7-4c5a-b7a3-6e59a2ebd0d0 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:44.097991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd19dc-05e7-4c5a-b7a3-6e59a2ebd0d0 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:44.101762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c307cbc-6ed9-46c2-a3e7-9ff0f90dd8ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:44.105150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c307cbc-6ed9-46c2-a3e7-9ff0f90dd8ec service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:44.105150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c307cbc-6ed9-46c2-a3e7-9ff0f90dd8ec service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:44.105150 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c307cbc-6ed9-46c2-a3e7-9ff0f90dd8ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:44.160876 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c307cbc-6ed9-46c2-a3e7-9ff0f90dd8ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:44.162296 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c307cbc-6ed9-46c2-a3e7-9ff0f90dd8ec service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:44.172073 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1367/2745] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:06:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:06:50.533562 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5777e-e3f1-41cf-9277-ba4a484f05cc service cinder] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:50.534241 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-d9e5777e-e3f1-41cf-9277-ba4a484f05cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:50.566306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:06:50.604156 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5777e-e3f1-41cf-9277-ba4a484f05cc service cinder] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:50.609019 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be008e72-b4ef-4db6-96e3-1151fedafb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:50.609695 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be008e72-b4ef-4db6-96e3-1151fedafb6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:50.609980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be008e72-b4ef-4db6-96e3-1151fedafb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:50.610304 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be008e72-b4ef-4db6-96e3-1151fedafb6e admin admin] PATH_INFO: `/v3/users/bf5c2fcd827d46c69018a50421438cbc` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:50.611590 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be008e72-b4ef-4db6-96e3-1151fedafb6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf5c2fcd827d46c69018a50421438cbc)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:50.613776 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be008e72-b4ef-4db6-96e3-1151fedafb6e admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:50.800017 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-be008e72-b4ef-4db6-96e3-1151fedafb6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf5c2fcd827d46c69018a50421438cbc'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:50.872480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-be008e72-b4ef-4db6-96e3-1151fedafb6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf5c2fcd827d46c69018a50421438cbc'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:50.873124 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-be008e72-b4ef-4db6-96e3-1151fedafb6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf5c2fcd827d46c69018a50421438cbc'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:50.886092 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-be008e72-b4ef-4db6-96e3-1151fedafb6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf5c2fcd827d46c69018a50421438cbc'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:50.886723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-be008e72-b4ef-4db6-96e3-1151fedafb6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf5c2fcd827d46c69018a50421438cbc'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:50.900032 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1379/2746] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:06:50 2022] DELETE /identity/v3/users/bf5c2fcd827d46c69018a50421438cbc => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:06:51.182488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c307cbc-6ed9-46c2-a3e7-9ff0f90dd8ec service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:51.197066 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c307cbc-6ed9-46c2-a3e7-9ff0f90dd8ec service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:51.250449 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65d79a-e771-4944-8f14-98e7151539f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:51.251079 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65d79a-e771-4944-8f14-98e7151539f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:51.251359 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65d79a-e771-4944-8f14-98e7151539f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:51.251629 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65d79a-e771-4944-8f14-98e7151539f6 admin admin] PATH_INFO: `/v3/projects/02d2e8d47a504e1e98e4bd3870ab337d` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:51.252768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65d79a-e771-4944-8f14-98e7151539f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d2e8d47a504e1e98e4bd3870ab337d)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:51.255448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65d79a-e771-4944-8f14-98e7151539f6 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:51.361130 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:06:51.367479 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5b65d79a-e771-4944-8f14-98e7151539f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d2e8d47a504e1e98e4bd3870ab337d', 'request_id': 'req-5b65d79a-e771-4944-8f14-98e7151539f6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:51.373565 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5b65d79a-e771-4944-8f14-98e7151539f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d2e8d47a504e1e98e4bd3870ab337d', 'request_id': 'req-5b65d79a-e771-4944-8f14-98e7151539f6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:51.417837 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5b65d79a-e771-4944-8f14-98e7151539f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d2e8d47a504e1e98e4bd3870ab337d', 'request_id': 'req-5b65d79a-e771-4944-8f14-98e7151539f6'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:51.428705 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5b65d79a-e771-4944-8f14-98e7151539f6 admin admin] The token cache is being invalidate because project 02d2e8d47a504e1e98e4bd3870ab337d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:06:51.429424 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5b65d79a-e771-4944-8f14-98e7151539f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:51.429706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5b65d79a-e771-4944-8f14-98e7151539f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:51.431179 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1368/2747] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:06:51 2022] DELETE /identity/v3/projects/02d2e8d47a504e1e98e4bd3870ab337d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:06:51.435258 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be008e72-b4ef-4db6-96e3-1151fedafb6e admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:51.436687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-be008e72-b4ef-4db6-96e3-1151fedafb6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:51.449627 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be008e72-b4ef-4db6-96e3-1151fedafb6e admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:51.506460 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd43ca-d02b-460c-80e1-5ed832b8f6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:51.507111 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd43ca-d02b-460c-80e1-5ed832b8f6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:51.507370 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd43ca-d02b-460c-80e1-5ed832b8f6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:51.507639 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd43ca-d02b-460c-80e1-5ed832b8f6c1 admin admin] PATH_INFO: `/v3/users/f927ce9c091d466cbf24b3b90d548868` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:51.508781 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd43ca-d02b-460c-80e1-5ed832b8f6c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f927ce9c091d466cbf24b3b90d548868)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:51.510690 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd43ca-d02b-460c-80e1-5ed832b8f6c1 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:51.637836 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-36cd43ca-d02b-460c-80e1-5ed832b8f6c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f927ce9c091d466cbf24b3b90d548868'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:51.640222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:06:51.752578 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-36cd43ca-d02b-460c-80e1-5ed832b8f6c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f927ce9c091d466cbf24b3b90d548868'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:51.753314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-36cd43ca-d02b-460c-80e1-5ed832b8f6c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f927ce9c091d466cbf24b3b90d548868'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:51.766267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-36cd43ca-d02b-460c-80e1-5ed832b8f6c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f927ce9c091d466cbf24b3b90d548868'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:51.766943 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-36cd43ca-d02b-460c-80e1-5ed832b8f6c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f927ce9c091d466cbf24b3b90d548868'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:51.781218 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1380/2748] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:06:51 2022] DELETE /identity/v3/users/f927ce9c091d466cbf24b3b90d548868 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:06:52.132401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65d79a-e771-4944-8f14-98e7151539f6 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:06:52.133913 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5b65d79a-e771-4944-8f14-98e7151539f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:06:52.147546 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65d79a-e771-4944-8f14-98e7151539f6 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:06:52.202898 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee999b7-0600-4430-9787-44959b6f2b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:06:52.203569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee999b7-0600-4430-9787-44959b6f2b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:06:52.203801 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee999b7-0600-4430-9787-44959b6f2b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:06:52.204076 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee999b7-0600-4430-9787-44959b6f2b77 admin admin] PATH_INFO: `/v3/projects/003cbe279e594b068e2c5b334b3e9996` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:06:52.205232 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee999b7-0600-4430-9787-44959b6f2b77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=003cbe279e594b068e2c5b334b3e9996)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:06:52.207149 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee999b7-0600-4430-9787-44959b6f2b77 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:06:52.327457 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4ee999b7-0600-4430-9787-44959b6f2b77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '003cbe279e594b068e2c5b334b3e9996', 'request_id': 'req-4ee999b7-0600-4430-9787-44959b6f2b77'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:52.334338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4ee999b7-0600-4430-9787-44959b6f2b77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '003cbe279e594b068e2c5b334b3e9996', 'request_id': 'req-4ee999b7-0600-4430-9787-44959b6f2b77'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:52.420626 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4ee999b7-0600-4430-9787-44959b6f2b77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '003cbe279e594b068e2c5b334b3e9996', 'request_id': 'req-4ee999b7-0600-4430-9787-44959b6f2b77'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:52.431925 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4ee999b7-0600-4430-9787-44959b6f2b77 admin admin] The token cache is being invalidate because project 003cbe279e594b068e2c5b334b3e9996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:06:52.432210 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4ee999b7-0600-4430-9787-44959b6f2b77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:52.436376 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4ee999b7-0600-4430-9787-44959b6f2b77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:06:52.436376 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1369/2749] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:06:52 2022] DELETE /identity/v3/projects/003cbe279e594b068e2c5b334b3e9996 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:01.540523 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd43ca-d02b-460c-80e1-5ed832b8f6c1 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:01.541970 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-36cd43ca-d02b-460c-80e1-5ed832b8f6c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:01.554326 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd43ca-d02b-460c-80e1-5ed832b8f6c1 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:01.609693 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacd464-0596-4e07-8380-eadb37986dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:01.610337 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacd464-0596-4e07-8380-eadb37986dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:01.610644 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacd464-0596-4e07-8380-eadb37986dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:01.610917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacd464-0596-4e07-8380-eadb37986dfe admin admin] PATH_INFO: `/v3/users/1b6fea740b024eb380fec315636f6d0a` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:01.612070 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacd464-0596-4e07-8380-eadb37986dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b6fea740b024eb380fec315636f6d0a)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:01.614104 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacd464-0596-4e07-8380-eadb37986dfe admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:01.788510 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9aacd464-0596-4e07-8380-eadb37986dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b6fea740b024eb380fec315636f6d0a'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:01.857984 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9aacd464-0596-4e07-8380-eadb37986dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b6fea740b024eb380fec315636f6d0a'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:01.858630 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9aacd464-0596-4e07-8380-eadb37986dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b6fea740b024eb380fec315636f6d0a'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:01.870929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9aacd464-0596-4e07-8380-eadb37986dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b6fea740b024eb380fec315636f6d0a'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:01.872285 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9aacd464-0596-4e07-8380-eadb37986dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b6fea740b024eb380fec315636f6d0a'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:01.884274 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1381/2750] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:07:01 2022] DELETE /identity/v3/users/1b6fea740b024eb380fec315636f6d0a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 23:07:01.889060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2286e-08be-451e-bce0-dde70a87b803 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:01.889545 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2286e-08be-451e-bce0-dde70a87b803 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:01.889657 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2286e-08be-451e-bce0-dde70a87b803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:01.908927 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-2be2286e-08be-451e-bce0-dde70a87b803 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:01.910155 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2be2286e-08be-451e-bce0-dde70a87b803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:01.961068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:01.969310 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1370/2751] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:01.979802 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacd464-0596-4e07-8380-eadb37986dfe admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:01.981320 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9aacd464-0596-4e07-8380-eadb37986dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:02.032767 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:02.037961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacd464-0596-4e07-8380-eadb37986dfe admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:02.042961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4f853-be36-4987-b2f8-99742ca7bb44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:02.042961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4f853-be36-4987-b2f8-99742ca7bb44 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:02.042961 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4f853-be36-4987-b2f8-99742ca7bb44 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:02.043313 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4f853-be36-4987-b2f8-99742ca7bb44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:02.052081 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4f853-be36-4987-b2f8-99742ca7bb44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:02.053539 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4f853-be36-4987-b2f8-99742ca7bb44 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:02.063475 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1382/2752] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:07:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:07:02.482813 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2286e-08be-451e-bce0-dde70a87b803 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:02.484537 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2be2286e-08be-451e-bce0-dde70a87b803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:02.498323 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2286e-08be-451e-bce0-dde70a87b803 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:02.503114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf06582-e784-4d02-a343-6c64c25d8400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:02.503754 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf06582-e784-4d02-a343-6c64c25d8400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:02.504031 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf06582-e784-4d02-a343-6c64c25d8400 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:02.504329 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf06582-e784-4d02-a343-6c64c25d8400 admin admin] PATH_INFO: `/v3/projects/fd237f2ea9d94698bffbde150adcb403` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:02.505493 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf06582-e784-4d02-a343-6c64c25d8400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd237f2ea9d94698bffbde150adcb403)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:02.507455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf06582-e784-4d02-a343-6c64c25d8400 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:02.612534 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5bf06582-e784-4d02-a343-6c64c25d8400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd237f2ea9d94698bffbde150adcb403', 'request_id': 'req-5bf06582-e784-4d02-a343-6c64c25d8400'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:02.619865 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5bf06582-e784-4d02-a343-6c64c25d8400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd237f2ea9d94698bffbde150adcb403', 'request_id': 'req-5bf06582-e784-4d02-a343-6c64c25d8400'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:02.727704 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5bf06582-e784-4d02-a343-6c64c25d8400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd237f2ea9d94698bffbde150adcb403', 'request_id': 'req-5bf06582-e784-4d02-a343-6c64c25d8400'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:02.738642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5bf06582-e784-4d02-a343-6c64c25d8400 admin admin] The token cache is being invalidate because project fd237f2ea9d94698bffbde150adcb403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:07:02.738927 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5bf06582-e784-4d02-a343-6c64c25d8400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:02.739545 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5bf06582-e784-4d02-a343-6c64c25d8400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:02.741291 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1371/2753] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:07:02 2022] DELETE /identity/v3/projects/fd237f2ea9d94698bffbde150adcb403 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:02.746165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4f853-be36-4987-b2f8-99742ca7bb44 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:02.755827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4f853-be36-4987-b2f8-99742ca7bb44 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:02.810531 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7dc5d-affc-4448-a2b7-22f62c94e405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:02.815501 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7dc5d-affc-4448-a2b7-22f62c94e405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:02.815501 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7dc5d-affc-4448-a2b7-22f62c94e405 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:02.815501 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7dc5d-affc-4448-a2b7-22f62c94e405 admin admin] PATH_INFO: `/v3/users/8520a6cc291042ddb726c1d72457cda2` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:02.815501 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7dc5d-affc-4448-a2b7-22f62c94e405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8520a6cc291042ddb726c1d72457cda2)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:02.815501 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7dc5d-affc-4448-a2b7-22f62c94e405 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:03.025412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9de7dc5d-affc-4448-a2b7-22f62c94e405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8520a6cc291042ddb726c1d72457cda2'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:03.100757 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9de7dc5d-affc-4448-a2b7-22f62c94e405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8520a6cc291042ddb726c1d72457cda2'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:03.101379 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9de7dc5d-affc-4448-a2b7-22f62c94e405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8520a6cc291042ddb726c1d72457cda2'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:03.115185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9de7dc5d-affc-4448-a2b7-22f62c94e405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8520a6cc291042ddb726c1d72457cda2'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:03.128321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-9de7dc5d-affc-4448-a2b7-22f62c94e405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8520a6cc291042ddb726c1d72457cda2'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:03.128321 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1383/2754] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:07:02 2022] DELETE /identity/v3/users/8520a6cc291042ddb726c1d72457cda2 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 23:07:03.779638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf06582-e784-4d02-a343-6c64c25d8400 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:03.781152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5bf06582-e784-4d02-a343-6c64c25d8400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:03.795808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf06582-e784-4d02-a343-6c64c25d8400 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:03.853673 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469056d2-57f2-4ce1-afb7-39af93672ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:03.854240 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469056d2-57f2-4ce1-afb7-39af93672ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:03.854522 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469056d2-57f2-4ce1-afb7-39af93672ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:03.854799 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469056d2-57f2-4ce1-afb7-39af93672ea1 admin admin] PATH_INFO: `/v3/projects/a1692a2366c740d9b840e814c02e1918` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:03.855923 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469056d2-57f2-4ce1-afb7-39af93672ea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1692a2366c740d9b840e814c02e1918)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:03.857910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469056d2-57f2-4ce1-afb7-39af93672ea1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:04.003899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-469056d2-57f2-4ce1-afb7-39af93672ea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1692a2366c740d9b840e814c02e1918', 'request_id': 'req-469056d2-57f2-4ce1-afb7-39af93672ea1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:04.010001 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-469056d2-57f2-4ce1-afb7-39af93672ea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1692a2366c740d9b840e814c02e1918', 'request_id': 'req-469056d2-57f2-4ce1-afb7-39af93672ea1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:04.101441 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-469056d2-57f2-4ce1-afb7-39af93672ea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1692a2366c740d9b840e814c02e1918', 'request_id': 'req-469056d2-57f2-4ce1-afb7-39af93672ea1'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:04.113758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-469056d2-57f2-4ce1-afb7-39af93672ea1 admin admin] The token cache is being invalidate because project a1692a2366c740d9b840e814c02e1918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:07:04.114012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-469056d2-57f2-4ce1-afb7-39af93672ea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:04.114637 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-469056d2-57f2-4ce1-afb7-39af93672ea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:04.116128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1372/2755] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:07:03 2022] DELETE /identity/v3/projects/a1692a2366c740d9b840e814c02e1918 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:04.133878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef527e-1050-4ecb-ad86-53578deb0f71 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:04.134374 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef527e-1050-4ecb-ad86-53578deb0f71 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:04.134485 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef527e-1050-4ecb-ad86-53578deb0f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:04.153763 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-55ef527e-1050-4ecb-ad86-53578deb0f71 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:04.154966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-55ef527e-1050-4ecb-ad86-53578deb0f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:04.213211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1384/2756] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:04.221051 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec207a5-5cef-47d8-82a1-a91d32c135db None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:04.222090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec207a5-5cef-47d8-82a1-a91d32c135db None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:04.222090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec207a5-5cef-47d8-82a1-a91d32c135db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:04.242009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-1ec207a5-5cef-47d8-82a1-a91d32c135db None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:04.243808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1ec207a5-5cef-47d8-82a1-a91d32c135db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:04.251852 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1373/2757] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:04.256182 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef527e-1050-4ecb-ad86-53578deb0f71 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:04.265838 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef527e-1050-4ecb-ad86-53578deb0f71 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:04.270330 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f4518-f3d2-429f-8131-f556d4a5a09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:04.270923 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f4518-f3d2-429f-8131-f556d4a5a09e admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:04.271201 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f4518-f3d2-429f-8131-f556d4a5a09e admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:04.271471 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f4518-f3d2-429f-8131-f556d4a5a09e admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:04.272116 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f4518-f3d2-429f-8131-f556d4a5a09e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:07:04.272415 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f4518-f3d2-429f-8131-f556d4a5a09e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:04.274026 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f4518-f3d2-429f-8131-f556d4a5a09e admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:04.276317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:04.285518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1385/2758] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 23:07:04.290203 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec207a5-5cef-47d8-82a1-a91d32c135db None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:04.299236 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec207a5-5cef-47d8-82a1-a91d32c135db None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:04.303884 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b4e54-0525-49a5-b3a5-2a6d1871640b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:04.304499 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b4e54-0525-49a5-b3a5-2a6d1871640b admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:04.304779 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b4e54-0525-49a5-b3a5-2a6d1871640b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:04.305661 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b4e54-0525-49a5-b3a5-2a6d1871640b admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:04.306303 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b4e54-0525-49a5-b3a5-2a6d1871640b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:04.308209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b4e54-0525-49a5-b3a5-2a6d1871640b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:04.312664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:04.408442 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1374/2759] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:07:04 2022] POST /identity/v3/projects => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:07:04.412609 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f4518-f3d2-429f-8131-f556d4a5a09e admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:04.423418 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f4518-f3d2-429f-8131-f556d4a5a09e admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:04.478035 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c57b16-046f-4ebb-8fa8-387ba48222a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:04.478893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c57b16-046f-4ebb-8fa8-387ba48222a8 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:04.479171 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c57b16-046f-4ebb-8fa8-387ba48222a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:04.479439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c57b16-046f-4ebb-8fa8-387ba48222a8 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:04.480061 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c57b16-046f-4ebb-8fa8-387ba48222a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:04.481991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c57b16-046f-4ebb-8fa8-387ba48222a8 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:04.560634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1386/2760] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:07:04 2022] POST /identity/v3/users => generated 282 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:07:04.577839 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b4e54-0525-49a5-b3a5-2a6d1871640b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:04.588680 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b4e54-0525-49a5-b3a5-2a6d1871640b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:04.593304 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730181d-6fa1-47b4-b0ed-2cb6ef0c4550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:04.593901 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730181d-6fa1-47b4-b0ed-2cb6ef0c4550 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:04.594207 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730181d-6fa1-47b4-b0ed-2cb6ef0c4550 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:04.594482 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730181d-6fa1-47b4-b0ed-2cb6ef0c4550 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:04.595120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730181d-6fa1-47b4-b0ed-2cb6ef0c4550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:04.596758 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730181d-6fa1-47b4-b0ed-2cb6ef0c4550 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:04.607263 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1375/2761] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:07:04.611138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c57b16-046f-4ebb-8fa8-387ba48222a8 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:04.621071 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c57b16-046f-4ebb-8fa8-387ba48222a8 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:04.625616 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c428ffb-9bc3-434a-b028-09f5e15d053f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:04.626207 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428ffb-9bc3-434a-b028-09f5e15d053f admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:04.626485 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428ffb-9bc3-434a-b028-09f5e15d053f admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:04.626755 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428ffb-9bc3-434a-b028-09f5e15d053f admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:04.627388 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c428ffb-9bc3-434a-b028-09f5e15d053f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:04.629023 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c428ffb-9bc3-434a-b028-09f5e15d053f admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:04.639434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1387/2762] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:07:04.643328 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730181d-6fa1-47b4-b0ed-2cb6ef0c4550 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:04.653558 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730181d-6fa1-47b4-b0ed-2cb6ef0c4550 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:04.658129 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cba10-d033-4593-bef1-590487b747b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:04.658820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cba10-d033-4593-bef1-590487b747b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:04.659052 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cba10-d033-4593-bef1-590487b747b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:04.659327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cba10-d033-4593-bef1-590487b747b1 admin admin] PATH_INFO: `/v3/projects/68ad44ea73be4a17b32955eb35c16624/users/1cc0c14f28ce481093a7d73d6c70b152/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:04.673898 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5cba10-d033-4593-bef1-590487b747b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68ad44ea73be4a17b32955eb35c16624, user_id=1cc0c14f28ce481093a7d73d6c70b152, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:04.676611 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5cba10-d033-4593-bef1-590487b747b1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:04.743292 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1376/2763] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:07:04 2022] PUT /identity/v3/projects/68ad44ea73be4a17b32955eb35c16624/users/1cc0c14f28ce481093a7d73d6c70b152/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:04.753521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a36f50-1ffd-4270-9083-d1fcf19b3f15 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:04.753814 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a36f50-1ffd-4270-9083-d1fcf19b3f15 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:04.754120 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a36f50-1ffd-4270-9083-d1fcf19b3f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:04.782241 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-31a36f50-1ffd-4270-9083-d1fcf19b3f15 None None] MFA Rules not processed for user `1cc0c14f28ce481093a7d73d6c70b152`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:04.783471 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-31a36f50-1ffd-4270-9083-d1fcf19b3f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:04.846487 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1388/2764] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:04.850955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cba10-d033-4593-bef1-590487b747b1 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:04.913253 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cba10-d033-4593-bef1-590487b747b1 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:04.917897 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68059c-ab30-44d1-a7ac-f8d2bfda7c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:04.918497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68059c-ab30-44d1-a7ac-f8d2bfda7c92 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:04.918775 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68059c-ab30-44d1-a7ac-f8d2bfda7c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:04.919044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68059c-ab30-44d1-a7ac-f8d2bfda7c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:04.919684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68059c-ab30-44d1-a7ac-f8d2bfda7c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:04.921614 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68059c-ab30-44d1-a7ac-f8d2bfda7c92 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:04.995738 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1377/2765] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:07:04 2022] POST /identity/v3/projects => generated 365 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:07:04.999783 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a36f50-1ffd-4270-9083-d1fcf19b3f15 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:05.010793 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a36f50-1ffd-4270-9083-d1fcf19b3f15 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:05.065935 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52c537-3f47-4b03-b9e2-adf9e7592622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:05.066548 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52c537-3f47-4b03-b9e2-adf9e7592622 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:05.066828 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52c537-3f47-4b03-b9e2-adf9e7592622 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:05.067102 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52c537-3f47-4b03-b9e2-adf9e7592622 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:05.067731 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52c537-3f47-4b03-b9e2-adf9e7592622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:05.069685 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52c537-3f47-4b03-b9e2-adf9e7592622 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:05.080266 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:05.215276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1389/2766] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:07:04 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:07:05.219307 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68059c-ab30-44d1-a7ac-f8d2bfda7c92 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:05.229608 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68059c-ab30-44d1-a7ac-f8d2bfda7c92 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:05.234068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1634475-2d33-4086-abf0-2ebe3a42c388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:05.234660 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1634475-2d33-4086-abf0-2ebe3a42c388 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:05.234937 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1634475-2d33-4086-abf0-2ebe3a42c388 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:05.235206 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1634475-2d33-4086-abf0-2ebe3a42c388 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:05.235846 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1634475-2d33-4086-abf0-2ebe3a42c388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:05.237470 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1634475-2d33-4086-abf0-2ebe3a42c388 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:05.248116 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1378/2767] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:07:05.252082 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52c537-3f47-4b03-b9e2-adf9e7592622 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:05.262426 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52c537-3f47-4b03-b9e2-adf9e7592622 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:05.267010 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526f942-9653-4b47-a6d5-cd3c40cb3e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:05.267654 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526f942-9653-4b47-a6d5-cd3c40cb3e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:05.267936 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526f942-9653-4b47-a6d5-cd3c40cb3e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:05.268213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526f942-9653-4b47-a6d5-cd3c40cb3e53 admin admin] PATH_INFO: `/v3/projects/ff294a9cd2304d24ac4f8d3b1b0fba7c/users/0d97a704232141079d66f226b6a7ec5d/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:05.282601 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526f942-9653-4b47-a6d5-cd3c40cb3e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff294a9cd2304d24ac4f8d3b1b0fba7c, user_id=0d97a704232141079d66f226b6a7ec5d, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:05.285299 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526f942-9653-4b47-a6d5-cd3c40cb3e53 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:05.355471 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1390/2768] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:07:05 2022] PUT /identity/v3/projects/ff294a9cd2304d24ac4f8d3b1b0fba7c/users/0d97a704232141079d66f226b6a7ec5d/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:05.359421 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1634475-2d33-4086-abf0-2ebe3a42c388 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:05.369854 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1634475-2d33-4086-abf0-2ebe3a42c388 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:05.423861 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a3a2a-c4cc-46dc-b1c3-47cb567d279f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:05.424478 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a3a2a-c4cc-46dc-b1c3-47cb567d279f admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:05.424761 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a3a2a-c4cc-46dc-b1c3-47cb567d279f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:05.425035 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a3a2a-c4cc-46dc-b1c3-47cb567d279f admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:05.425664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a3a2a-c4cc-46dc-b1c3-47cb567d279f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:05.427265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a3a2a-c4cc-46dc-b1c3-47cb567d279f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:05.437103 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1379/2769] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:07:05.441269 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526f942-9653-4b47-a6d5-cd3c40cb3e53 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:05.452085 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526f942-9653-4b47-a6d5-cd3c40cb3e53 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:05.456692 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94eb5b-de4c-4dc6-a17d-08468eca6eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:05.457332 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94eb5b-de4c-4dc6-a17d-08468eca6eda admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:05.457609 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94eb5b-de4c-4dc6-a17d-08468eca6eda admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:05.457878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94eb5b-de4c-4dc6-a17d-08468eca6eda admin admin] PATH_INFO: `/v3/projects/ff294a9cd2304d24ac4f8d3b1b0fba7c/users/0d97a704232141079d66f226b6a7ec5d/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:05.459807 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94eb5b-de4c-4dc6-a17d-08468eca6eda admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff294a9cd2304d24ac4f8d3b1b0fba7c, user_id=0d97a704232141079d66f226b6a7ec5d, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:05.462486 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94eb5b-de4c-4dc6-a17d-08468eca6eda admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:05.472401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1391/2770] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:07:05 2022] PUT /identity/v3/projects/ff294a9cd2304d24ac4f8d3b1b0fba7c/users/0d97a704232141079d66f226b6a7ec5d/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:05.483878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a86aec-cce4-4be6-9c3c-7c7e4de26a14 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:05.484166 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a86aec-cce4-4be6-9c3c-7c7e4de26a14 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:05.484470 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a86aec-cce4-4be6-9c3c-7c7e4de26a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:05.511559 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-87a86aec-cce4-4be6-9c3c-7c7e4de26a14 None None] MFA Rules not processed for user `0d97a704232141079d66f226b6a7ec5d`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:05.512781 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-87a86aec-cce4-4be6-9c3c-7c7e4de26a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:05.520723 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:05.579127 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1380/2771] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:05.590188 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94eb5b-de4c-4dc6-a17d-08468eca6eda admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:05.592161 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-2a94eb5b-de4c-4dc6-a17d-08468eca6eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:05.648977 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94eb5b-de4c-4dc6-a17d-08468eca6eda admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:05.652573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad604db-7ac1-4abc-a201-ef1db31061d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:05.653166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad604db-7ac1-4abc-a201-ef1db31061d0 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:05.653443 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad604db-7ac1-4abc-a201-ef1db31061d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:05.653713 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad604db-7ac1-4abc-a201-ef1db31061d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:05.662680 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad604db-7ac1-4abc-a201-ef1db31061d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:05.664142 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad604db-7ac1-4abc-a201-ef1db31061d0 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:05.674217 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1392/2772] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:07:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:07:05.926025 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a86aec-cce4-4be6-9c3c-7c7e4de26a14 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:05.936102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a86aec-cce4-4be6-9c3c-7c7e4de26a14 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:05.940108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548d9a9-c0c7-4901-b50d-0449fbf07daf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:05.940247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d9a9-c0c7-4901-b50d-0449fbf07daf service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:05.940498 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d9a9-c0c7-4901-b50d-0449fbf07daf service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:05.940773 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d9a9-c0c7-4901-b50d-0449fbf07daf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:06.009278 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548d9a9-c0c7-4901-b50d-0449fbf07daf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:06.010747 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548d9a9-c0c7-4901-b50d-0449fbf07daf service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:06.019713 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1381/2773] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:07:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:07:09.612993 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad604db-7ac1-4abc-a201-ef1db31061d0 service cinder] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:09.674222 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad604db-7ac1-4abc-a201-ef1db31061d0 service cinder] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:09.678638 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba4e23-2f32-4086-a059-4d900ff46ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:09.679254 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba4e23-2f32-4086-a059-4d900ff46ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:09.679546 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba4e23-2f32-4086-a059-4d900ff46ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:09.679819 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba4e23-2f32-4086-a059-4d900ff46ab3 admin admin] PATH_INFO: `/v3/users/1cc0c14f28ce481093a7d73d6c70b152` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:09.681450 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba4e23-2f32-4086-a059-4d900ff46ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cc0c14f28ce481093a7d73d6c70b152)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:09.683370 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba4e23-2f32-4086-a059-4d900ff46ab3 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:09.863480 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c4ba4e23-2f32-4086-a059-4d900ff46ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cc0c14f28ce481093a7d73d6c70b152'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:09.941355 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c4ba4e23-2f32-4086-a059-4d900ff46ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cc0c14f28ce481093a7d73d6c70b152'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:09.942032 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c4ba4e23-2f32-4086-a059-4d900ff46ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cc0c14f28ce481093a7d73d6c70b152'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:09.949166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:09.956262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c4ba4e23-2f32-4086-a059-4d900ff46ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cc0c14f28ce481093a7d73d6c70b152'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:09.957030 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-c4ba4e23-2f32-4086-a059-4d900ff46ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cc0c14f28ce481093a7d73d6c70b152'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:09.969588 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1393/2774] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:07:09 2022] DELETE /identity/v3/users/1cc0c14f28ce481093a7d73d6c70b152 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:09.974176 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbdf65-9d19-48ee-a468-b9606ac71892 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:09.974668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbdf65-9d19-48ee-a468-b9606ac71892 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:09.974810 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbdf65-9d19-48ee-a468-b9606ac71892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:09.995468 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-3ccbdf65-9d19-48ee-a468-b9606ac71892 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:09.996804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3ccbdf65-9d19-48ee-a468-b9606ac71892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:10.058015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1382/2775] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:10.068289 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba4e23-2f32-4086-a059-4d900ff46ab3 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:10.069741 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c4ba4e23-2f32-4086-a059-4d900ff46ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:10.128959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba4e23-2f32-4086-a059-4d900ff46ab3 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:10.132584 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38221129-d2f2-49e0-ab6d-4952e2f4cdbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:10.133233 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38221129-d2f2-49e0-ab6d-4952e2f4cdbe service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:10.133515 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38221129-d2f2-49e0-ab6d-4952e2f4cdbe service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:10.133787 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38221129-d2f2-49e0-ab6d-4952e2f4cdbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:10.142932 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38221129-d2f2-49e0-ab6d-4952e2f4cdbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:10.144353 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38221129-d2f2-49e0-ab6d-4952e2f4cdbe service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:10.154161 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1394/2776] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:07:10.696125 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbdf65-9d19-48ee-a468-b9606ac71892 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:10.697604 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3ccbdf65-9d19-48ee-a468-b9606ac71892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:10.715868 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbdf65-9d19-48ee-a468-b9606ac71892 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:10.720771 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c71fe9-e5ac-43ed-903d-5079676918a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:10.721417 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c71fe9-e5ac-43ed-903d-5079676918a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:10.721764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c71fe9-e5ac-43ed-903d-5079676918a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:10.721963 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c71fe9-e5ac-43ed-903d-5079676918a2 admin admin] PATH_INFO: `/v3/projects/68ad44ea73be4a17b32955eb35c16624` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:10.723182 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c71fe9-e5ac-43ed-903d-5079676918a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68ad44ea73be4a17b32955eb35c16624)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:10.725186 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c71fe9-e5ac-43ed-903d-5079676918a2 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:10.833964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:10.840839 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-82c71fe9-e5ac-43ed-903d-5079676918a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68ad44ea73be4a17b32955eb35c16624', 'request_id': 'req-82c71fe9-e5ac-43ed-903d-5079676918a2'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:10.848770 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-82c71fe9-e5ac-43ed-903d-5079676918a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68ad44ea73be4a17b32955eb35c16624', 'request_id': 'req-82c71fe9-e5ac-43ed-903d-5079676918a2'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:10.956450 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-82c71fe9-e5ac-43ed-903d-5079676918a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68ad44ea73be4a17b32955eb35c16624', 'request_id': 'req-82c71fe9-e5ac-43ed-903d-5079676918a2'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:10.968724 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-82c71fe9-e5ac-43ed-903d-5079676918a2 admin admin] The token cache is being invalidate because project 68ad44ea73be4a17b32955eb35c16624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:07:10.969032 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-82c71fe9-e5ac-43ed-903d-5079676918a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:10.969684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-82c71fe9-e5ac-43ed-903d-5079676918a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:10.971420 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1383/2777] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:07:10 2022] DELETE /identity/v3/projects/68ad44ea73be4a17b32955eb35c16624 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:10.975334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38221129-d2f2-49e0-ab6d-4952e2f4cdbe service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:10.985772 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38221129-d2f2-49e0-ab6d-4952e2f4cdbe service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:11.050148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd8f96-1de3-4d77-958d-7fa85f0a457a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:11.050850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd8f96-1de3-4d77-958d-7fa85f0a457a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:11.051132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd8f96-1de3-4d77-958d-7fa85f0a457a admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:11.051403 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd8f96-1de3-4d77-958d-7fa85f0a457a admin admin] PATH_INFO: `/v3/users/0d97a704232141079d66f226b6a7ec5d` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:11.052610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd8f96-1de3-4d77-958d-7fa85f0a457a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d97a704232141079d66f226b6a7ec5d)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:11.054542 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd8f96-1de3-4d77-958d-7fa85f0a457a admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:11.258829 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-edbd8f96-1de3-4d77-958d-7fa85f0a457a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d97a704232141079d66f226b6a7ec5d'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:11.335698 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-edbd8f96-1de3-4d77-958d-7fa85f0a457a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d97a704232141079d66f226b6a7ec5d'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:11.340451 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-edbd8f96-1de3-4d77-958d-7fa85f0a457a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d97a704232141079d66f226b6a7ec5d'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:11.349719 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-edbd8f96-1de3-4d77-958d-7fa85f0a457a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d97a704232141079d66f226b6a7ec5d'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:11.350386 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-edbd8f96-1de3-4d77-958d-7fa85f0a457a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d97a704232141079d66f226b6a7ec5d'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:11.359301 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:11.363785 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1395/2778] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:07:10 2022] DELETE /identity/v3/users/0d97a704232141079d66f226b6a7ec5d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:11.861391 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c71fe9-e5ac-43ed-903d-5079676918a2 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:11.862839 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-82c71fe9-e5ac-43ed-903d-5079676918a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:11.878031 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c71fe9-e5ac-43ed-903d-5079676918a2 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:11.943016 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d077f-90b9-439e-aaa0-a696c204e911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:11.943999 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d077f-90b9-439e-aaa0-a696c204e911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:11.944346 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d077f-90b9-439e-aaa0-a696c204e911 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:11.944677 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d077f-90b9-439e-aaa0-a696c204e911 admin admin] PATH_INFO: `/v3/projects/ff294a9cd2304d24ac4f8d3b1b0fba7c` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:11.945850 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d077f-90b9-439e-aaa0-a696c204e911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff294a9cd2304d24ac4f8d3b1b0fba7c)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:11.947786 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d077f-90b9-439e-aaa0-a696c204e911 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:12.064042 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7d4d077f-90b9-439e-aaa0-a696c204e911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff294a9cd2304d24ac4f8d3b1b0fba7c', 'request_id': 'req-7d4d077f-90b9-439e-aaa0-a696c204e911'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:12.072864 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7d4d077f-90b9-439e-aaa0-a696c204e911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff294a9cd2304d24ac4f8d3b1b0fba7c', 'request_id': 'req-7d4d077f-90b9-439e-aaa0-a696c204e911'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:12.163943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7d4d077f-90b9-439e-aaa0-a696c204e911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff294a9cd2304d24ac4f8d3b1b0fba7c', 'request_id': 'req-7d4d077f-90b9-439e-aaa0-a696c204e911'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:12.175814 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7d4d077f-90b9-439e-aaa0-a696c204e911 admin admin] The token cache is being invalidate because project ff294a9cd2304d24ac4f8d3b1b0fba7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:07:12.176102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7d4d077f-90b9-439e-aaa0-a696c204e911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:12.176750 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-7d4d077f-90b9-439e-aaa0-a696c204e911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:12.178238 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1384/2779] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:07:11 2022] DELETE /identity/v3/projects/ff294a9cd2304d24ac4f8d3b1b0fba7c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:12.183052 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f234024-7bba-4cb7-a221-64b388ff6257 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:12.183555 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f234024-7bba-4cb7-a221-64b388ff6257 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:12.183669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f234024-7bba-4cb7-a221-64b388ff6257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:12.203474 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-6f234024-7bba-4cb7-a221-64b388ff6257 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:12.204707 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-6f234024-7bba-4cb7-a221-64b388ff6257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:12.263908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1396/2780] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:12.272702 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d4796-041e-45fc-a08f-59aeae17d339 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:12.276617 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d4796-041e-45fc-a08f-59aeae17d339 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:12.276617 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d4796-041e-45fc-a08f-59aeae17d339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:12.293382 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-8c1d4796-041e-45fc-a08f-59aeae17d339 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:12.294587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-8c1d4796-041e-45fc-a08f-59aeae17d339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:12.302418 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1385/2781] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:12.306584 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f234024-7bba-4cb7-a221-64b388ff6257 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:12.316275 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f234024-7bba-4cb7-a221-64b388ff6257 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:12.321465 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3cb4d-6b0a-4049-b264-691a6077bb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:12.322055 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3cb4d-6b0a-4049-b264-691a6077bb09 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:12.322331 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3cb4d-6b0a-4049-b264-691a6077bb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:12.322605 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3cb4d-6b0a-4049-b264-691a6077bb09 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:12.323250 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3cb4d-6b0a-4049-b264-691a6077bb09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:07:12.323554 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3cb4d-6b0a-4049-b264-691a6077bb09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:12.325182 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3cb4d-6b0a-4049-b264-691a6077bb09 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:12.337681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1397/2782] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 23:07:12.342035 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d4796-041e-45fc-a08f-59aeae17d339 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:12.351326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d4796-041e-45fc-a08f-59aeae17d339 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:12.356242 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293df395-d876-4118-86a7-29f8fbbb9593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:12.356866 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293df395-d876-4118-86a7-29f8fbbb9593 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:12.357144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293df395-d876-4118-86a7-29f8fbbb9593 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:12.357415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293df395-d876-4118-86a7-29f8fbbb9593 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:12.358048 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293df395-d876-4118-86a7-29f8fbbb9593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:12.359993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293df395-d876-4118-86a7-29f8fbbb9593 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:12.444934 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1386/2783] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:07:12 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:07:12.449482 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3cb4d-6b0a-4049-b264-691a6077bb09 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:12.459455 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3cb4d-6b0a-4049-b264-691a6077bb09 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:12.514794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c270b9-ca12-4c00-8a14-d46dd7560397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:12.515398 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c270b9-ca12-4c00-8a14-d46dd7560397 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:12.515676 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c270b9-ca12-4c00-8a14-d46dd7560397 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:12.515948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c270b9-ca12-4c00-8a14-d46dd7560397 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:12.516607 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c270b9-ca12-4c00-8a14-d46dd7560397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:12.518506 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c270b9-ca12-4c00-8a14-d46dd7560397 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:12.595112 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1398/2784] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:07:12 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 23:07:12.599089 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293df395-d876-4118-86a7-29f8fbbb9593 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:12.610019 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293df395-d876-4118-86a7-29f8fbbb9593 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:12.614658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0295b-bd24-467e-ad47-ced7f0770180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:12.615249 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0295b-bd24-467e-ad47-ced7f0770180 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:12.615522 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0295b-bd24-467e-ad47-ced7f0770180 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:12.615788 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0295b-bd24-467e-ad47-ced7f0770180 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:12.616439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0295b-bd24-467e-ad47-ced7f0770180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:12.618538 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0295b-bd24-467e-ad47-ced7f0770180 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:12.628608 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1387/2785] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:07:12.632481 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c270b9-ca12-4c00-8a14-d46dd7560397 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:12.643412 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c270b9-ca12-4c00-8a14-d46dd7560397 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:12.648112 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839dab2-3680-4978-8a28-49585b408b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:12.648872 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839dab2-3680-4978-8a28-49585b408b6b admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:12.649230 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839dab2-3680-4978-8a28-49585b408b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:12.649428 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839dab2-3680-4978-8a28-49585b408b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:12.650132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839dab2-3680-4978-8a28-49585b408b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:12.651757 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839dab2-3680-4978-8a28-49585b408b6b admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:12.663126 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1399/2786] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:07:12.667225 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0295b-bd24-467e-ad47-ced7f0770180 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:12.680791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0295b-bd24-467e-ad47-ced7f0770180 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:12.685513 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2da0f4-ab71-458d-89cc-1523b43b9ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:12.686163 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2da0f4-ab71-458d-89cc-1523b43b9ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:12.686436 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2da0f4-ab71-458d-89cc-1523b43b9ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:12.686706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2da0f4-ab71-458d-89cc-1523b43b9ae4 admin admin] PATH_INFO: `/v3/projects/661ec33525f54a3eb8823d34cbfd11a7/users/4999621b7eac417c88acabfcf2582b1a/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:12.689898 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:12.703162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2da0f4-ab71-458d-89cc-1523b43b9ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=661ec33525f54a3eb8823d34cbfd11a7, user_id=4999621b7eac417c88acabfcf2582b1a, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:12.705831 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2da0f4-ab71-458d-89cc-1523b43b9ae4 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:12.783791 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1388/2787] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:07:12 2022] PUT /identity/v3/projects/661ec33525f54a3eb8823d34cbfd11a7/users/4999621b7eac417c88acabfcf2582b1a/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:12.794197 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856031e7-7a88-4901-808a-5cc048498a3c None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:12.794521 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856031e7-7a88-4901-808a-5cc048498a3c None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:12.794794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856031e7-7a88-4901-808a-5cc048498a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:12.823251 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-856031e7-7a88-4901-808a-5cc048498a3c None None] MFA Rules not processed for user `4999621b7eac417c88acabfcf2582b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:12.824496 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-856031e7-7a88-4901-808a-5cc048498a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:12.878382 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:12.887842 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1400/2788] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:12.892462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2da0f4-ab71-458d-89cc-1523b43b9ae4 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:12.954279 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2da0f4-ab71-458d-89cc-1523b43b9ae4 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:12.958833 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129062ed-d27d-4f53-87ad-2c3b0dba4274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:12.959436 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129062ed-d27d-4f53-87ad-2c3b0dba4274 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:12.959720 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129062ed-d27d-4f53-87ad-2c3b0dba4274 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:12.959995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129062ed-d27d-4f53-87ad-2c3b0dba4274 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:12.960674 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129062ed-d27d-4f53-87ad-2c3b0dba4274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:12.962634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129062ed-d27d-4f53-87ad-2c3b0dba4274 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:13.071566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1389/2789] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:07:12 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:07:13.075661 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856031e7-7a88-4901-808a-5cc048498a3c None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:13.086810 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856031e7-7a88-4901-808a-5cc048498a3c None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:13.142481 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d9c9d-d583-4482-b770-d38963a5ee86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:13.143084 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d9c9d-d583-4482-b770-d38963a5ee86 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:13.143361 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d9c9d-d583-4482-b770-d38963a5ee86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:13.143633 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d9c9d-d583-4482-b770-d38963a5ee86 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:13.144243 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d9c9d-d583-4482-b770-d38963a5ee86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:13.146173 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d9c9d-d583-4482-b770-d38963a5ee86 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:13.226092 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1401/2790] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:07:13 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:07:13.230741 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129062ed-d27d-4f53-87ad-2c3b0dba4274 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:13.241045 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129062ed-d27d-4f53-87ad-2c3b0dba4274 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:13.246337 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027fcd9-2384-46c0-b97b-06c8acb6997b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:13.246997 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027fcd9-2384-46c0-b97b-06c8acb6997b admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:13.247275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027fcd9-2384-46c0-b97b-06c8acb6997b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:13.247546 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027fcd9-2384-46c0-b97b-06c8acb6997b admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:13.248179 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027fcd9-2384-46c0-b97b-06c8acb6997b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:13.249818 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027fcd9-2384-46c0-b97b-06c8acb6997b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:13.260084 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1390/2791] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:07:13.268472 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d9c9d-d583-4482-b770-d38963a5ee86 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:13.278215 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d9c9d-d583-4482-b770-d38963a5ee86 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:13.282800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fbbba-a742-43b4-9d5d-139eae4a7015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:13.283436 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fbbba-a742-43b4-9d5d-139eae4a7015 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:13.283713 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fbbba-a742-43b4-9d5d-139eae4a7015 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:13.283983 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fbbba-a742-43b4-9d5d-139eae4a7015 admin admin] PATH_INFO: `/v3/projects/af0a150fa7424186b9bef4be1923b13f/users/b92e6da463704f5792bc94ecbecc92c7/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:13.298760 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fbbba-a742-43b4-9d5d-139eae4a7015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af0a150fa7424186b9bef4be1923b13f, user_id=b92e6da463704f5792bc94ecbecc92c7, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:13.301475 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fbbba-a742-43b4-9d5d-139eae4a7015 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:13.373933 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1402/2792] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:07:13 2022] PUT /identity/v3/projects/af0a150fa7424186b9bef4be1923b13f/users/b92e6da463704f5792bc94ecbecc92c7/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:13.377855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027fcd9-2384-46c0-b97b-06c8acb6997b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:13.390891 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027fcd9-2384-46c0-b97b-06c8acb6997b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:13.458165 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa5896-00b4-450c-ad45-fe4bd63f4a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:13.458770 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa5896-00b4-450c-ad45-fe4bd63f4a9a admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:13.459049 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa5896-00b4-450c-ad45-fe4bd63f4a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:13.459318 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa5896-00b4-450c-ad45-fe4bd63f4a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:13.459949 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa5896-00b4-450c-ad45-fe4bd63f4a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:13.462102 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa5896-00b4-450c-ad45-fe4bd63f4a9a admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:13.471580 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1391/2793] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:07:13.475688 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fbbba-a742-43b4-9d5d-139eae4a7015 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:13.486654 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fbbba-a742-43b4-9d5d-139eae4a7015 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:13.491081 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1fbe92-d830-4ee8-8097-52910508c997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:13.491726 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fbe92-d830-4ee8-8097-52910508c997 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:13.492002 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fbe92-d830-4ee8-8097-52910508c997 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:13.492276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fbe92-d830-4ee8-8097-52910508c997 admin admin] PATH_INFO: `/v3/projects/af0a150fa7424186b9bef4be1923b13f/users/b92e6da463704f5792bc94ecbecc92c7/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:13.494194 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1fbe92-d830-4ee8-8097-52910508c997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af0a150fa7424186b9bef4be1923b13f, user_id=b92e6da463704f5792bc94ecbecc92c7, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:13.496908 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1fbe92-d830-4ee8-8097-52910508c997 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:13.506750 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1403/2794] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:07:13 2022] PUT /identity/v3/projects/af0a150fa7424186b9bef4be1923b13f/users/b92e6da463704f5792bc94ecbecc92c7/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:13.517512 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb063da-bed8-4bce-a994-5c7b9be313ba None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:13.517873 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb063da-bed8-4bce-a994-5c7b9be313ba None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:13.518154 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb063da-bed8-4bce-a994-5c7b9be313ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:13.546536 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7cb063da-bed8-4bce-a994-5c7b9be313ba None None] MFA Rules not processed for user `b92e6da463704f5792bc94ecbecc92c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:13.547734 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7cb063da-bed8-4bce-a994-5c7b9be313ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:13.589622 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:13.613508 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1392/2795] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:13.625118 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1fbe92-d830-4ee8-8097-52910508c997 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:13.626795 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7b1fbe92-d830-4ee8-8097-52910508c997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:13.684262 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1fbe92-d830-4ee8-8097-52910508c997 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:13.687927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88431c4-8998-431a-99ab-d1b871ad7e80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:13.688631 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88431c4-8998-431a-99ab-d1b871ad7e80 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:13.688914 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88431c4-8998-431a-99ab-d1b871ad7e80 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:13.689185 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88431c4-8998-431a-99ab-d1b871ad7e80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:13.699557 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88431c4-8998-431a-99ab-d1b871ad7e80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:13.701025 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88431c4-8998-431a-99ab-d1b871ad7e80 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:13.710850 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1404/2796] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:07:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:07:13.781376 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb063da-bed8-4bce-a994-5c7b9be313ba None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:13.845809 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb063da-bed8-4bce-a994-5c7b9be313ba None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:13.850479 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02287c-4538-4a94-9c6a-2bd42158913b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:13.851188 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02287c-4538-4a94-9c6a-2bd42158913b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:13.851440 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02287c-4538-4a94-9c6a-2bd42158913b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:13.851762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02287c-4538-4a94-9c6a-2bd42158913b admin admin] PATH_INFO: `/v3/users/4999621b7eac417c88acabfcf2582b1a` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:13.852955 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02287c-4538-4a94-9c6a-2bd42158913b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4999621b7eac417c88acabfcf2582b1a)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:13.855144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02287c-4538-4a94-9c6a-2bd42158913b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:14.107338 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4a02287c-4538-4a94-9c6a-2bd42158913b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4999621b7eac417c88acabfcf2582b1a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:14.195326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4a02287c-4538-4a94-9c6a-2bd42158913b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4999621b7eac417c88acabfcf2582b1a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:14.196148 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4a02287c-4538-4a94-9c6a-2bd42158913b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4999621b7eac417c88acabfcf2582b1a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:14.196860 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4a02287c-4538-4a94-9c6a-2bd42158913b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4999621b7eac417c88acabfcf2582b1a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:14.204595 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-4a02287c-4538-4a94-9c6a-2bd42158913b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4999621b7eac417c88acabfcf2582b1a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:14.222475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1393/2797] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:07:13 2022] DELETE /identity/v3/users/4999621b7eac417c88acabfcf2582b1a => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:14.227485 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7f878-e6f7-4307-bd82-c383849bc594 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:14.228005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7f878-e6f7-4307-bd82-c383849bc594 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:14.228105 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7f878-e6f7-4307-bd82-c383849bc594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:14.247379 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-6ed7f878-e6f7-4307-bd82-c383849bc594 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:14.250487 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-6ed7f878-e6f7-4307-bd82-c383849bc594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:14.295438 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:14.309069 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1405/2798] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:14.318618 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02287c-4538-4a94-9c6a-2bd42158913b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:14.320106 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4a02287c-4538-4a94-9c6a-2bd42158913b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:14.379688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02287c-4538-4a94-9c6a-2bd42158913b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:14.383263 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a2470-434e-4740-aede-caa134a13944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:14.383875 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a2470-434e-4740-aede-caa134a13944 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:14.384153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a2470-434e-4740-aede-caa134a13944 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:14.384433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a2470-434e-4740-aede-caa134a13944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:14.393205 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a2470-434e-4740-aede-caa134a13944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:14.394650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a2470-434e-4740-aede-caa134a13944 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:14.404412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1394/2799] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:07:14.816929 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7f878-e6f7-4307-bd82-c383849bc594 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:14.818413 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-6ed7f878-e6f7-4307-bd82-c383849bc594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:14.834456 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7f878-e6f7-4307-bd82-c383849bc594 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:14.839363 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06a3bc-ee64-4de7-9456-3d7090afb19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:14.840077 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06a3bc-ee64-4de7-9456-3d7090afb19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:14.840528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06a3bc-ee64-4de7-9456-3d7090afb19b admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:14.840864 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06a3bc-ee64-4de7-9456-3d7090afb19b admin admin] PATH_INFO: `/v3/projects/661ec33525f54a3eb8823d34cbfd11a7` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:14.842283 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06a3bc-ee64-4de7-9456-3d7090afb19b admin admin] RBAC: Authorizing `identity:delete_project(project_id=661ec33525f54a3eb8823d34cbfd11a7)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:14.844221 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06a3bc-ee64-4de7-9456-3d7090afb19b admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:14.951608 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-1c06a3bc-ee64-4de7-9456-3d7090afb19b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '661ec33525f54a3eb8823d34cbfd11a7', 'request_id': 'req-1c06a3bc-ee64-4de7-9456-3d7090afb19b'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:14.957806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-1c06a3bc-ee64-4de7-9456-3d7090afb19b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '661ec33525f54a3eb8823d34cbfd11a7', 'request_id': 'req-1c06a3bc-ee64-4de7-9456-3d7090afb19b'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:15.032465 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-1c06a3bc-ee64-4de7-9456-3d7090afb19b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '661ec33525f54a3eb8823d34cbfd11a7', 'request_id': 'req-1c06a3bc-ee64-4de7-9456-3d7090afb19b'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:15.043022 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-1c06a3bc-ee64-4de7-9456-3d7090afb19b admin admin] The token cache is being invalidate because project 661ec33525f54a3eb8823d34cbfd11a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:07:15.043309 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-1c06a3bc-ee64-4de7-9456-3d7090afb19b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:15.043917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-1c06a3bc-ee64-4de7-9456-3d7090afb19b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:15.045433 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1406/2800] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:07:14 2022] DELETE /identity/v3/projects/661ec33525f54a3eb8823d34cbfd11a7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:15.049349 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a2470-434e-4740-aede-caa134a13944 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:15.054109 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:15.060027 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a2470-434e-4740-aede-caa134a13944 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:15.123008 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68af4e-3ff5-4f0c-8bd1-bfb9a2ad9887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:15.123670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68af4e-3ff5-4f0c-8bd1-bfb9a2ad9887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:15.123901 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68af4e-3ff5-4f0c-8bd1-bfb9a2ad9887 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:15.124173 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68af4e-3ff5-4f0c-8bd1-bfb9a2ad9887 admin admin] PATH_INFO: `/v3/users/b92e6da463704f5792bc94ecbecc92c7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:15.125327 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68af4e-3ff5-4f0c-8bd1-bfb9a2ad9887 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92e6da463704f5792bc94ecbecc92c7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:15.127433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68af4e-3ff5-4f0c-8bd1-bfb9a2ad9887 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:15.306184 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5a68af4e-3ff5-4f0c-8bd1-bfb9a2ad9887 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92e6da463704f5792bc94ecbecc92c7'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:15.375184 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5a68af4e-3ff5-4f0c-8bd1-bfb9a2ad9887 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92e6da463704f5792bc94ecbecc92c7'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:15.375803 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5a68af4e-3ff5-4f0c-8bd1-bfb9a2ad9887 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92e6da463704f5792bc94ecbecc92c7'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:15.376403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5a68af4e-3ff5-4f0c-8bd1-bfb9a2ad9887 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92e6da463704f5792bc94ecbecc92c7'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:15.383564 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-5a68af4e-3ff5-4f0c-8bd1-bfb9a2ad9887 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92e6da463704f5792bc94ecbecc92c7'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:15.400574 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1395/2801] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:07:15 2022] DELETE /identity/v3/users/b92e6da463704f5792bc94ecbecc92c7 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:15.824605 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06a3bc-ee64-4de7-9456-3d7090afb19b admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:15.826138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1c06a3bc-ee64-4de7-9456-3d7090afb19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:15.839840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06a3bc-ee64-4de7-9456-3d7090afb19b admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:15.908256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a1aca-d8de-4878-8d5d-f43dcbb77d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:15.908940 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1aca-d8de-4878-8d5d-f43dcbb77d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:15.909216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1aca-d8de-4878-8d5d-f43dcbb77d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:15.909487 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1aca-d8de-4878-8d5d-f43dcbb77d83 admin admin] PATH_INFO: `/v3/projects/af0a150fa7424186b9bef4be1923b13f` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:15.910642 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a1aca-d8de-4878-8d5d-f43dcbb77d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af0a150fa7424186b9bef4be1923b13f)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:15.912674 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a1aca-d8de-4878-8d5d-f43dcbb77d83 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:16.045516 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-2e1a1aca-d8de-4878-8d5d-f43dcbb77d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af0a150fa7424186b9bef4be1923b13f', 'request_id': 'req-2e1a1aca-d8de-4878-8d5d-f43dcbb77d83'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:16.051856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-2e1a1aca-d8de-4878-8d5d-f43dcbb77d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af0a150fa7424186b9bef4be1923b13f', 'request_id': 'req-2e1a1aca-d8de-4878-8d5d-f43dcbb77d83'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:16.138654 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-2e1a1aca-d8de-4878-8d5d-f43dcbb77d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af0a150fa7424186b9bef4be1923b13f', 'request_id': 'req-2e1a1aca-d8de-4878-8d5d-f43dcbb77d83'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:16.150708 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-2e1a1aca-d8de-4878-8d5d-f43dcbb77d83 admin admin] The token cache is being invalidate because project af0a150fa7424186b9bef4be1923b13f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:07:16.150995 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-2e1a1aca-d8de-4878-8d5d-f43dcbb77d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:16.151665 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-2e1a1aca-d8de-4878-8d5d-f43dcbb77d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:16.153198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1407/2802] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:07:15 2022] DELETE /identity/v3/projects/af0a150fa7424186b9bef4be1923b13f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:16.158111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3062812-ec00-4f34-b873-e5208898d11f None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:16.158588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3062812-ec00-4f34-b873-e5208898d11f None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:16.158687 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3062812-ec00-4f34-b873-e5208898d11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:16.178384 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d3062812-ec00-4f34-b873-e5208898d11f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:16.179580 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d3062812-ec00-4f34-b873-e5208898d11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:16.239149 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1396/2803] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:16.247737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb40b06-acf8-4795-afaa-e8f18829766d None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:16.248042 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb40b06-acf8-4795-afaa-e8f18829766d None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:16.248307 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb40b06-acf8-4795-afaa-e8f18829766d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:16.256983 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:16.268063 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-bbb40b06-acf8-4795-afaa-e8f18829766d None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:16.269317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-bbb40b06-acf8-4795-afaa-e8f18829766d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:16.278212 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1408/2804] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:16.283811 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3062812-ec00-4f34-b873-e5208898d11f None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:16.294822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3062812-ec00-4f34-b873-e5208898d11f None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:16.299837 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccb78c-c50f-4acf-8617-d68f0bffa71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:16.300454 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccb78c-c50f-4acf-8617-d68f0bffa71f admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:16.300822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccb78c-c50f-4acf-8617-d68f0bffa71f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:16.301151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccb78c-c50f-4acf-8617-d68f0bffa71f admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:16.301891 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccb78c-c50f-4acf-8617-d68f0bffa71f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:07:16.302197 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccb78c-c50f-4acf-8617-d68f0bffa71f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:16.303835 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccb78c-c50f-4acf-8617-d68f0bffa71f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:16.316688 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1397/2805] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 23:07:16.321431 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb40b06-acf8-4795-afaa-e8f18829766d None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:16.334211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb40b06-acf8-4795-afaa-e8f18829766d None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:16.339806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5b537-9e71-4e25-8532-18fc8837743b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:16.340356 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5b537-9e71-4e25-8532-18fc8837743b admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:16.340669 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5b537-9e71-4e25-8532-18fc8837743b admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:16.340944 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5b537-9e71-4e25-8532-18fc8837743b admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:16.341582 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5b537-9e71-4e25-8532-18fc8837743b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:16.343536 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5b537-9e71-4e25-8532-18fc8837743b admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:16.425810 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1409/2806] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:07:16 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:07:16.430024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccb78c-c50f-4acf-8617-d68f0bffa71f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:16.440009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccb78c-c50f-4acf-8617-d68f0bffa71f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:16.444810 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:16.495537 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f92f8-f13d-4db9-98d1-070259a77730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:16.496139 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f92f8-f13d-4db9-98d1-070259a77730 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:16.496439 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f92f8-f13d-4db9-98d1-070259a77730 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:16.496718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f92f8-f13d-4db9-98d1-070259a77730 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:16.497370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f92f8-f13d-4db9-98d1-070259a77730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:16.499336 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f92f8-f13d-4db9-98d1-070259a77730 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:16.606235 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1398/2807] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:07:16 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:07:16.610493 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5b537-9e71-4e25-8532-18fc8837743b admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:16.621113 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5b537-9e71-4e25-8532-18fc8837743b admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:16.626450 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe58b4-df25-4d36-b011-32e8014d8d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:16.627086 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe58b4-df25-4d36-b011-32e8014d8d61 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:16.627368 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe58b4-df25-4d36-b011-32e8014d8d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:16.627640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe58b4-df25-4d36-b011-32e8014d8d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:16.628285 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe58b4-df25-4d36-b011-32e8014d8d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:16.629938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe58b4-df25-4d36-b011-32e8014d8d61 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:16.640614 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1410/2808] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 23:07:16.644768 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f92f8-f13d-4db9-98d1-070259a77730 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:16.656491 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f92f8-f13d-4db9-98d1-070259a77730 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:16.661186 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d48137-c714-4fef-8a8c-c79648da284b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:16.661781 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d48137-c714-4fef-8a8c-c79648da284b admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:16.667585 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d48137-c714-4fef-8a8c-c79648da284b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:16.667585 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d48137-c714-4fef-8a8c-c79648da284b admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:16.667585 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d48137-c714-4fef-8a8c-c79648da284b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:16.667585 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d48137-c714-4fef-8a8c-c79648da284b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:16.676044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1399/2809] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 23:07:16.680175 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe58b4-df25-4d36-b011-32e8014d8d61 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:16.690182 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe58b4-df25-4d36-b011-32e8014d8d61 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:16.694710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e5ab2-ed22-4bcf-a33e-20157a4c2db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:16.699509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e5ab2-ed22-4bcf-a33e-20157a4c2db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:16.699509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e5ab2-ed22-4bcf-a33e-20157a4c2db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:16.699509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e5ab2-ed22-4bcf-a33e-20157a4c2db6 admin admin] PATH_INFO: `/v3/projects/5ebef76bfb814822a3c94e6e57b4525d/users/144e6e9f9ed948b9a8fe8b7d28dd4d2a/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:16.710677 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e5ab2-ed22-4bcf-a33e-20157a4c2db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ebef76bfb814822a3c94e6e57b4525d, user_id=144e6e9f9ed948b9a8fe8b7d28dd4d2a, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:16.714005 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e5ab2-ed22-4bcf-a33e-20157a4c2db6 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:16.821738 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1411/2810] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:07:16 2022] PUT /identity/v3/projects/5ebef76bfb814822a3c94e6e57b4525d/users/144e6e9f9ed948b9a8fe8b7d28dd4d2a/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:16.826736 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c37c1-5531-4ea0-97b0-a08164ef4daf None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:16.827040 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c37c1-5531-4ea0-97b0-a08164ef4daf None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:16.827295 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c37c1-5531-4ea0-97b0-a08164ef4daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:16.846453 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-de6c37c1-5531-4ea0-97b0-a08164ef4daf None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:16.847647 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-de6c37c1-5531-4ea0-97b0-a08164ef4daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:16.905318 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1400/2811] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:16.914701 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e5ab2-ed22-4bcf-a33e-20157a4c2db6 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:16.916543 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b37e5ab2-ed22-4bcf-a33e-20157a4c2db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:16.973907 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e5ab2-ed22-4bcf-a33e-20157a4c2db6 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:16.977604 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a052c-b7aa-4f13-9a01-1be5c694a5ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:16.978213 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a052c-b7aa-4f13-9a01-1be5c694a5ea service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:16.978497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a052c-b7aa-4f13-9a01-1be5c694a5ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:16.978774 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a052c-b7aa-4f13-9a01-1be5c694a5ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:16.988010 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a052c-b7aa-4f13-9a01-1be5c694a5ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:16.989456 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a052c-b7aa-4f13-9a01-1be5c694a5ea service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:16.998795 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1412/2812] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:07:17.292480 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c37c1-5531-4ea0-97b0-a08164ef4daf None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:17.294019 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-de6c37c1-5531-4ea0-97b0-a08164ef4daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:17.306638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c37c1-5531-4ea0-97b0-a08164ef4daf None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:17.310037 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b8cd1-be2c-42bc-95a7-d4777ce42f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:17.310710 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b8cd1-be2c-42bc-95a7-d4777ce42f39 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:17.311061 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b8cd1-be2c-42bc-95a7-d4777ce42f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:17.311396 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b8cd1-be2c-42bc-95a7-d4777ce42f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:17.313219 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-288b8cd1-be2c-42bc-95a7-d4777ce42f39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:17.325663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b8cd1-be2c-42bc-95a7-d4777ce42f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:17.327188 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b8cd1-be2c-42bc-95a7-d4777ce42f39 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:17.337585 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1401/2813] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:07:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:07:18.272785 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38663c-91f6-43c0-b230-830a9abed88b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:18.272785 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38663c-91f6-43c0-b230-830a9abed88b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:18.272785 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38663c-91f6-43c0-b230-830a9abed88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:18.306277 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-4e38663c-91f6-43c0-b230-830a9abed88b None None] MFA Rules not processed for user `144e6e9f9ed948b9a8fe8b7d28dd4d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:18.307766 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4e38663c-91f6-43c0-b230-830a9abed88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:18.387462 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1413/2814] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:18.391963 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b8cd1-be2c-42bc-95a7-d4777ce42f39 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:18.403620 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b8cd1-be2c-42bc-95a7-d4777ce42f39 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:18.409615 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9aaaff-4a6e-4fd5-9151-143d9cf4bccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:18.410228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aaaff-4a6e-4fd5-9151-143d9cf4bccb admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:18.410515 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aaaff-4a6e-4fd5-9151-143d9cf4bccb admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:18.410787 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aaaff-4a6e-4fd5-9151-143d9cf4bccb admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:18.411423 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9aaaff-4a6e-4fd5-9151-143d9cf4bccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:18.413433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9aaaff-4a6e-4fd5-9151-143d9cf4bccb admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:18.501071 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1402/2815] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:07:18 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 23:07:18.505327 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38663c-91f6-43c0-b230-830a9abed88b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:18.516207 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38663c-91f6-43c0-b230-830a9abed88b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:18.549366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:18.575838 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f1095-a811-4cfa-bb6f-fff5bc7f2817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:18.576535 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f1095-a811-4cfa-bb6f-fff5bc7f2817 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:18.576820 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f1095-a811-4cfa-bb6f-fff5bc7f2817 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:18.577096 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f1095-a811-4cfa-bb6f-fff5bc7f2817 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:18.577793 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f1095-a811-4cfa-bb6f-fff5bc7f2817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:18.579767 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f1095-a811-4cfa-bb6f-fff5bc7f2817 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:18.699205 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1414/2816] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:07:18 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 23:07:18.703357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9aaaff-4a6e-4fd5-9151-143d9cf4bccb admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:18.714770 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9aaaff-4a6e-4fd5-9151-143d9cf4bccb admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:18.720589 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007b3ee-97bb-47d9-a64a-73c15903861e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:18.721253 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007b3ee-97bb-47d9-a64a-73c15903861e admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:18.721530 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007b3ee-97bb-47d9-a64a-73c15903861e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:18.721802 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007b3ee-97bb-47d9-a64a-73c15903861e admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:18.722451 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007b3ee-97bb-47d9-a64a-73c15903861e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:18.724109 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007b3ee-97bb-47d9-a64a-73c15903861e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:18.737668 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1403/2817] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:07:18.741773 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f1095-a811-4cfa-bb6f-fff5bc7f2817 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:18.752336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f1095-a811-4cfa-bb6f-fff5bc7f2817 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:18.757047 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65f703-31ed-4d5f-8fb7-ab0be4260a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:18.757721 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65f703-31ed-4d5f-8fb7-ab0be4260a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:18.757997 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65f703-31ed-4d5f-8fb7-ab0be4260a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:18.758269 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65f703-31ed-4d5f-8fb7-ab0be4260a87 admin admin] PATH_INFO: `/v3/projects/f274dbf468264ef3b65dfe73133398f0/users/3e8e08ea71f54142acac5525d384a7a0/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:18.774910 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65f703-31ed-4d5f-8fb7-ab0be4260a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f274dbf468264ef3b65dfe73133398f0, user_id=3e8e08ea71f54142acac5525d384a7a0, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:18.777653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65f703-31ed-4d5f-8fb7-ab0be4260a87 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:18.842811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1415/2818] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:07:18 2022] PUT /identity/v3/projects/f274dbf468264ef3b65dfe73133398f0/users/3e8e08ea71f54142acac5525d384a7a0/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:18.847024 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007b3ee-97bb-47d9-a64a-73c15903861e admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:18.858781 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007b3ee-97bb-47d9-a64a-73c15903861e admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:18.900333 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:18.916987 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93224d5-2031-40e2-9bb1-566cbd2c1c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:18.917511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93224d5-2031-40e2-9bb1-566cbd2c1c4e admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:18.917790 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93224d5-2031-40e2-9bb1-566cbd2c1c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:18.918065 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93224d5-2031-40e2-9bb1-566cbd2c1c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:18.918712 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93224d5-2031-40e2-9bb1-566cbd2c1c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:18.920384 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93224d5-2031-40e2-9bb1-566cbd2c1c4e admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:18.931248 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1404/2819] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:07:18.935366 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65f703-31ed-4d5f-8fb7-ab0be4260a87 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:18.945883 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65f703-31ed-4d5f-8fb7-ab0be4260a87 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:18.951250 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79058d-e705-4a9c-81a6-8c7fe4768da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:18.951911 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79058d-e705-4a9c-81a6-8c7fe4768da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:18.952194 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79058d-e705-4a9c-81a6-8c7fe4768da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:18.952494 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79058d-e705-4a9c-81a6-8c7fe4768da7 admin admin] PATH_INFO: `/v3/projects/f274dbf468264ef3b65dfe73133398f0/users/3e8e08ea71f54142acac5525d384a7a0/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:18.954432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79058d-e705-4a9c-81a6-8c7fe4768da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f274dbf468264ef3b65dfe73133398f0, user_id=3e8e08ea71f54142acac5525d384a7a0, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:18.957151 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79058d-e705-4a9c-81a6-8c7fe4768da7 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:18.968272 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1416/2820] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:07:18 2022] PUT /identity/v3/projects/f274dbf468264ef3b65dfe73133398f0/users/3e8e08ea71f54142acac5525d384a7a0/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 23:07:20.328296 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5033cc-c6e3-47f6-8b9f-fabf76fd3120 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:20.329565 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5033cc-c6e3-47f6-8b9f-fabf76fd3120 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:20.330036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5033cc-c6e3-47f6-8b9f-fabf76fd3120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:20.366144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-dc5033cc-c6e3-47f6-8b9f-fabf76fd3120 None None] MFA Rules not processed for user `3e8e08ea71f54142acac5525d384a7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:20.368356 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-dc5033cc-c6e3-47f6-8b9f-fabf76fd3120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:20.475144 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1405/2821] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:20.487603 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e88ba-e407-4adb-88c5-e886a3ede726 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:20.488126 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e88ba-e407-4adb-88c5-e886a3ede726 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:20.488226 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e88ba-e407-4adb-88c5-e886a3ede726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:20.511377 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-9d1e88ba-e407-4adb-88c5-e886a3ede726 None None] MFA Rules not processed for user `144e6e9f9ed948b9a8fe8b7d28dd4d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:20.512648 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9d1e88ba-e407-4adb-88c5-e886a3ede726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:20.578449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1417/2822] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:20.589919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5033cc-c6e3-47f6-8b9f-fabf76fd3120 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:20.591359 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-dc5033cc-c6e3-47f6-8b9f-fabf76fd3120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:20.691015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5033cc-c6e3-47f6-8b9f-fabf76fd3120 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:20.696842 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051a03e-ad02-42d3-9351-a6c5dd141b5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:20.697549 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051a03e-ad02-42d3-9351-a6c5dd141b5c service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:20.697897 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051a03e-ad02-42d3-9351-a6c5dd141b5c service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:20.698243 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051a03e-ad02-42d3-9351-a6c5dd141b5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:20.708098 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051a03e-ad02-42d3-9351-a6c5dd141b5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:20.709857 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051a03e-ad02-42d3-9351-a6c5dd141b5c service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:20.720756 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1406/2823] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:07:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:07:21.558158 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e88ba-e407-4adb-88c5-e886a3ede726 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:21.559660 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9d1e88ba-e407-4adb-88c5-e886a3ede726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:21.628602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e88ba-e407-4adb-88c5-e886a3ede726 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:21.633109 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f97a5e-f712-42e7-ba29-e016f19a6203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:21.634392 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f97a5e-f712-42e7-ba29-e016f19a6203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:21.634671 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f97a5e-f712-42e7-ba29-e016f19a6203 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:21.634940 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f97a5e-f712-42e7-ba29-e016f19a6203 admin admin] PATH_INFO: `/v3/users/07a7969f07564904bc69fe0d026c6fb3` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:21.648657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f97a5e-f712-42e7-ba29-e016f19a6203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07a7969f07564904bc69fe0d026c6fb3)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:21.650612 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f97a5e-f712-42e7-ba29-e016f19a6203 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:21.671903 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:21.901309 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-83f97a5e-f712-42e7-ba29-e016f19a6203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07a7969f07564904bc69fe0d026c6fb3'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:21.963940 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-83f97a5e-f712-42e7-ba29-e016f19a6203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07a7969f07564904bc69fe0d026c6fb3'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:21.964601 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-83f97a5e-f712-42e7-ba29-e016f19a6203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07a7969f07564904bc69fe0d026c6fb3'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:21.976949 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-83f97a5e-f712-42e7-ba29-e016f19a6203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07a7969f07564904bc69fe0d026c6fb3'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:21.978133 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-83f97a5e-f712-42e7-ba29-e016f19a6203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07a7969f07564904bc69fe0d026c6fb3'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:21.992344 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1418/2824] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:07:21 2022] DELETE /identity/v3/users/07a7969f07564904bc69fe0d026c6fb3 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:22.234897 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051a03e-ad02-42d3-9351-a6c5dd141b5c service nova] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:22.246461 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051a03e-ad02-42d3-9351-a6c5dd141b5c service nova] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:22.292822 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=100 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:22.306650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc63f6-f0fc-4ede-a866-3d58e6ffa236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:22.307461 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc63f6-f0fc-4ede-a866-3d58e6ffa236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:22.307741 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc63f6-f0fc-4ede-a866-3d58e6ffa236 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:22.308015 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc63f6-f0fc-4ede-a866-3d58e6ffa236 admin admin] PATH_INFO: `/v3/projects/01180a7896ce42c9a0b42167d6c49512` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:22.319545 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc63f6-f0fc-4ede-a866-3d58e6ffa236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01180a7896ce42c9a0b42167d6c49512)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:22.322974 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc63f6-f0fc-4ede-a866-3d58e6ffa236 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:22.431059 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c9dc63f6-f0fc-4ede-a866-3d58e6ffa236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01180a7896ce42c9a0b42167d6c49512', 'request_id': 'req-c9dc63f6-f0fc-4ede-a866-3d58e6ffa236'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:22.437533 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c9dc63f6-f0fc-4ede-a866-3d58e6ffa236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01180a7896ce42c9a0b42167d6c49512', 'request_id': 'req-c9dc63f6-f0fc-4ede-a866-3d58e6ffa236'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:22.517866 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c9dc63f6-f0fc-4ede-a866-3d58e6ffa236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01180a7896ce42c9a0b42167d6c49512', 'request_id': 'req-c9dc63f6-f0fc-4ede-a866-3d58e6ffa236'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:22.529120 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c9dc63f6-f0fc-4ede-a866-3d58e6ffa236 admin admin] The token cache is being invalidate because project 01180a7896ce42c9a0b42167d6c49512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:07:22.529422 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c9dc63f6-f0fc-4ede-a866-3d58e6ffa236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:22.530033 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c9dc63f6-f0fc-4ede-a866-3d58e6ffa236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:07:22.531493 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1407/2825] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:07:22 2022] DELETE /identity/v3/projects/01180a7896ce42c9a0b42167d6c49512 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:22.536376 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02d130-b256-4d83-9197-2b1590b29720 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:22.536697 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02d130-b256-4d83-9197-2b1590b29720 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:22.536974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02d130-b256-4d83-9197-2b1590b29720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:22.556542 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-5d02d130-b256-4d83-9197-2b1590b29720 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:22.557743 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-5d02d130-b256-4d83-9197-2b1590b29720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:22.614841 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1419/2826] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:22.623151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13f8ae-62d1-4810-a258-f7e261ed4d1c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:22.623433 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13f8ae-62d1-4810-a258-f7e261ed4d1c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:22.623706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13f8ae-62d1-4810-a258-f7e261ed4d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:22.650785 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7a13f8ae-62d1-4810-a258-f7e261ed4d1c None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:22.652105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7a13f8ae-62d1-4810-a258-f7e261ed4d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:22.660134 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1408/2827] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:22.664502 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02d130-b256-4d83-9197-2b1590b29720 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:22.674775 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02d130-b256-4d83-9197-2b1590b29720 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:22.679500 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de93ef7-ba5b-4f5b-8be8-0e7fd2d872bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:22.680100 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de93ef7-ba5b-4f5b-8be8-0e7fd2d872bf admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:22.680383 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de93ef7-ba5b-4f5b-8be8-0e7fd2d872bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:22.680691 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de93ef7-ba5b-4f5b-8be8-0e7fd2d872bf admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:22.681408 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de93ef7-ba5b-4f5b-8be8-0e7fd2d872bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:07:22.681640 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de93ef7-ba5b-4f5b-8be8-0e7fd2d872bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:22.683311 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de93ef7-ba5b-4f5b-8be8-0e7fd2d872bf admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:22.695228 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1420/2828] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 23:07:22.700009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13f8ae-62d1-4810-a258-f7e261ed4d1c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:22.709512 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13f8ae-62d1-4810-a258-f7e261ed4d1c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:22.714808 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55ba04-0945-4534-8bbd-a07b37ef2359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:22.715389 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55ba04-0945-4534-8bbd-a07b37ef2359 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:22.715664 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55ba04-0945-4534-8bbd-a07b37ef2359 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:22.715932 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55ba04-0945-4534-8bbd-a07b37ef2359 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:22.716592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55ba04-0945-4534-8bbd-a07b37ef2359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:22.718483 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55ba04-0945-4534-8bbd-a07b37ef2359 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:22.802063 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1409/2829] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:07:22 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:07:22.806570 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de93ef7-ba5b-4f5b-8be8-0e7fd2d872bf admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:22.816506 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de93ef7-ba5b-4f5b-8be8-0e7fd2d872bf admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:22.875972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd11b3-434f-41a4-8f5c-dcd30302f094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:22.876620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd11b3-434f-41a4-8f5c-dcd30302f094 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:22.876900 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd11b3-434f-41a4-8f5c-dcd30302f094 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:22.877168 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd11b3-434f-41a4-8f5c-dcd30302f094 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:22.877798 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd11b3-434f-41a4-8f5c-dcd30302f094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:22.879764 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd11b3-434f-41a4-8f5c-dcd30302f094 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:22.968388 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1421/2830] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:07:22 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:07:22.973715 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55ba04-0945-4534-8bbd-a07b37ef2359 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:22.992481 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55ba04-0945-4534-8bbd-a07b37ef2359 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:22.992481 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39034a1b-3258-42c1-9065-6a92f7b97528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:22.992481 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39034a1b-3258-42c1-9065-6a92f7b97528 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:22.992481 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39034a1b-3258-42c1-9065-6a92f7b97528 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:22.992928 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39034a1b-3258-42c1-9065-6a92f7b97528 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:22.992928 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39034a1b-3258-42c1-9065-6a92f7b97528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:22.993599 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39034a1b-3258-42c1-9065-6a92f7b97528 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:23.003915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1410/2831] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:07:23.009137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd11b3-434f-41a4-8f5c-dcd30302f094 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:23.019663 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd11b3-434f-41a4-8f5c-dcd30302f094 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:23.024410 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc46d51-2b78-4186-a8fe-136802f2c497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:23.025720 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc46d51-2b78-4186-a8fe-136802f2c497 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:23.026002 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc46d51-2b78-4186-a8fe-136802f2c497 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:23.026275 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc46d51-2b78-4186-a8fe-136802f2c497 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:23.026919 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc46d51-2b78-4186-a8fe-136802f2c497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:23.028582 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc46d51-2b78-4186-a8fe-136802f2c497 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:23.039180 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1422/2832] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:07:23.043137 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39034a1b-3258-42c1-9065-6a92f7b97528 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:23.052944 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39034a1b-3258-42c1-9065-6a92f7b97528 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:23.058220 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c21b85-3af5-485b-b948-9b622dad5edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:23.058860 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c21b85-3af5-485b-b948-9b622dad5edf admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:23.059142 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c21b85-3af5-485b-b948-9b622dad5edf admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:23.059417 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c21b85-3af5-485b-b948-9b622dad5edf admin admin] PATH_INFO: `/v3/projects/5aac3768a15d434982e1ca3592d3d6ca/users/d457eb4758414478bd130efe911cbcc0/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:23.074776 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c21b85-3af5-485b-b948-9b622dad5edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aac3768a15d434982e1ca3592d3d6ca, user_id=d457eb4758414478bd130efe911cbcc0, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:23.077519 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c21b85-3af5-485b-b948-9b622dad5edf admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:23.146682 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1411/2833] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:07:23 2022] PUT /identity/v3/projects/5aac3768a15d434982e1ca3592d3d6ca/users/d457eb4758414478bd130efe911cbcc0/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:07:23.151871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b45d12-5993-45c6-9f4f-fbf882df0a65 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:23.152157 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b45d12-5993-45c6-9f4f-fbf882df0a65 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:23.152454 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b45d12-5993-45c6-9f4f-fbf882df0a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:23.160775 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:23.171641 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-32b45d12-5993-45c6-9f4f-fbf882df0a65 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:23.172878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-32b45d12-5993-45c6-9f4f-fbf882df0a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:23.231279 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1423/2834] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:23.240795 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c21b85-3af5-485b-b948-9b622dad5edf admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:23.242570 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f6c21b85-3af5-485b-b948-9b622dad5edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:23.301965 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c21b85-3af5-485b-b948-9b622dad5edf admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:23.305592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2ba2f-1d7f-4c7e-ac2b-74f6f0acc8f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:23.306701 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2ba2f-1d7f-4c7e-ac2b-74f6f0acc8f3 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:23.306978 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2ba2f-1d7f-4c7e-ac2b-74f6f0acc8f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:23.307247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2ba2f-1d7f-4c7e-ac2b-74f6f0acc8f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:23.315941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2ba2f-1d7f-4c7e-ac2b-74f6f0acc8f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:23.317402 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2ba2f-1d7f-4c7e-ac2b-74f6f0acc8f3 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:23.327297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1412/2835] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:07:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 23:07:26.301652 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b45d12-5993-45c6-9f4f-fbf882df0a65 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:26.319687 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b45d12-5993-45c6-9f4f-fbf882df0a65 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:26.323596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be9f9c-311e-44df-9906-b601bd152010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:26.324478 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be9f9c-311e-44df-9906-b601bd152010 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:26.325618 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be9f9c-311e-44df-9906-b601bd152010 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:26.325800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be9f9c-311e-44df-9906-b601bd152010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:26.327890 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-40be9f9c-311e-44df-9906-b601bd152010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:26.406075 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be9f9c-311e-44df-9906-b601bd152010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:26.408728 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be9f9c-311e-44df-9906-b601bd152010 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:26.423738 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1424/2836] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:07:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:07:28.581488 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09df514-0303-4950-9618-56981f27b220 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:28.582007 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09df514-0303-4950-9618-56981f27b220 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:28.582135 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09df514-0303-4950-9618-56981f27b220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:28.606517 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:28.615924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c09df514-0303-4950-9618-56981f27b220 None None] MFA Rules not processed for user `d457eb4758414478bd130efe911cbcc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:28.617278 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c09df514-0303-4950-9618-56981f27b220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:28.690899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1413/2837] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:28.708606 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be9f9c-311e-44df-9906-b601bd152010 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:28.710060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-40be9f9c-311e-44df-9906-b601bd152010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:28.727184 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be9f9c-311e-44df-9906-b601bd152010 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:28.738019 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7afcda-7fca-4c29-9e8e-9f0b9875f208 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:28.738760 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7afcda-7fca-4c29-9e8e-9f0b9875f208 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:28.739132 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7afcda-7fca-4c29-9e8e-9f0b9875f208 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:28.739502 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7afcda-7fca-4c29-9e8e-9f0b9875f208 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:28.751662 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7afcda-7fca-4c29-9e8e-9f0b9875f208 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:28.753451 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7afcda-7fca-4c29-9e8e-9f0b9875f208 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:28.768518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1425/2838] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:07:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:07:31.491645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1f4d5-7e4e-4481-a762-7d8af6da3326 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:31.492115 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1f4d5-7e4e-4481-a762-7d8af6da3326 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:31.492211 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1f4d5-7e4e-4481-a762-7d8af6da3326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:31.521491 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f7e1f4d5-7e4e-4481-a762-7d8af6da3326 None None] MFA Rules not processed for user `d457eb4758414478bd130efe911cbcc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:07:31.522839 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f7e1f4d5-7e4e-4481-a762-7d8af6da3326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:31.541064 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1414/2839] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:07:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:07:31.584653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7afcda-7fca-4c29-9e8e-9f0b9875f208 service nova] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:31.586330 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-8f7afcda-7fca-4c29-9e8e-9f0b9875f208 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:31.671846 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7afcda-7fca-4c29-9e8e-9f0b9875f208 service nova] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:31.675921 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55e525-d257-4995-abe9-9e9a65ce298d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a2c1f1668814a5e9e654c6308fa0628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:31.676589 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55e525-d257-4995-abe9-9e9a65ce298d service glance] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:31.676858 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55e525-d257-4995-abe9-9e9a65ce298d service glance] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:31.677134 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55e525-d257-4995-abe9-9e9a65ce298d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:31.678899 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1d55e525-d257-4995-abe9-9e9a65ce298d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:31.693912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55e525-d257-4995-abe9-9e9a65ce298d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:31.695383 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55e525-d257-4995-abe9-9e9a65ce298d service glance] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:31.702399 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=100 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:31.712587 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1426/2840] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:07:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:07:40.864631 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1f4d5-7e4e-4481-a762-7d8af6da3326 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:40.866520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f7e1f4d5-7e4e-4481-a762-7d8af6da3326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:40.921765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1f4d5-7e4e-4481-a762-7d8af6da3326 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:40.925375 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffed21f-58ab-494b-bbcc-84ae43baebaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:40.925985 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffed21f-58ab-494b-bbcc-84ae43baebaf service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:40.926264 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffed21f-58ab-494b-bbcc-84ae43baebaf service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:40.926538 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffed21f-58ab-494b-bbcc-84ae43baebaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:40.928231 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1ffed21f-58ab-494b-bbcc-84ae43baebaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:40.989475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffed21f-58ab-494b-bbcc-84ae43baebaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:40.990902 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffed21f-58ab-494b-bbcc-84ae43baebaf service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:41.000665 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1415/2841] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:07:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:07:44.636334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55e525-d257-4995-abe9-9e9a65ce298d service glance] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:07:44.637909 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-1d55e525-d257-4995-abe9-9e9a65ce298d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:44.649980 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55e525-d257-4995-abe9-9e9a65ce298d service glance] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:07:44.653603 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6454f-05bd-4589-9284-eb1603951c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:07:44.654202 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6454f-05bd-4589-9284-eb1603951c86 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:07:44.654481 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6454f-05bd-4589-9284-eb1603951c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:07:44.654752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6454f-05bd-4589-9284-eb1603951c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:07:44.657100 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f3d6454f-05bd-4589-9284-eb1603951c86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:07:44.666373 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6454f-05bd-4589-9284-eb1603951c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:07:44.667797 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6454f-05bd-4589-9284-eb1603951c86 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:07:44.675678 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1427/2842] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:07:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:07:50.996009 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=81 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:07:54.672067 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=6 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:08:05.129128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffed21f-58ab-494b-bbcc-84ae43baebaf service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:05.130592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-1ffed21f-58ab-494b-bbcc-84ae43baebaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:08:05.145388 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffed21f-58ab-494b-bbcc-84ae43baebaf service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:05.150012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4f244-9f2c-4dde-adf4-0c354881342f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:05.150635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4f244-9f2c-4dde-adf4-0c354881342f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:05.150910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4f244-9f2c-4dde-adf4-0c354881342f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:05.151178 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4f244-9f2c-4dde-adf4-0c354881342f admin admin] PATH_INFO: `/v3/users/144e6e9f9ed948b9a8fe8b7d28dd4d2a` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:05.152270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e4f244-9f2c-4dde-adf4-0c354881342f admin admin] RBAC: Authorizing `identity:delete_user(user_id=144e6e9f9ed948b9a8fe8b7d28dd4d2a)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:05.154222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e4f244-9f2c-4dde-adf4-0c354881342f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:05.337247 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c9e4f244-9f2c-4dde-adf4-0c354881342f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144e6e9f9ed948b9a8fe8b7d28dd4d2a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:05.415434 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c9e4f244-9f2c-4dde-adf4-0c354881342f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144e6e9f9ed948b9a8fe8b7d28dd4d2a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:05.416044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c9e4f244-9f2c-4dde-adf4-0c354881342f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144e6e9f9ed948b9a8fe8b7d28dd4d2a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:05.416681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c9e4f244-9f2c-4dde-adf4-0c354881342f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144e6e9f9ed948b9a8fe8b7d28dd4d2a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:05.423775 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c9e4f244-9f2c-4dde-adf4-0c354881342f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144e6e9f9ed948b9a8fe8b7d28dd4d2a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:05.441752 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1416/2843] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:08:05 2022] DELETE /identity/v3/users/144e6e9f9ed948b9a8fe8b7d28dd4d2a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:08:05.672019 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6454f-05bd-4589-9284-eb1603951c86 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:05.685138 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6454f-05bd-4589-9284-eb1603951c86 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:05.742211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac7610-5693-48bc-ad9b-de9d36255789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:05.742848 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac7610-5693-48bc-ad9b-de9d36255789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:05.743131 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac7610-5693-48bc-ad9b-de9d36255789 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:05.743405 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac7610-5693-48bc-ad9b-de9d36255789 admin admin] PATH_INFO: `/v3/projects/5ebef76bfb814822a3c94e6e57b4525d` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:05.744563 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac7610-5693-48bc-ad9b-de9d36255789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ebef76bfb814822a3c94e6e57b4525d)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:05.746571 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac7610-5693-48bc-ad9b-de9d36255789 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:05.878950 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-7fac7610-5693-48bc-ad9b-de9d36255789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ebef76bfb814822a3c94e6e57b4525d', 'request_id': 'req-7fac7610-5693-48bc-ad9b-de9d36255789'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:05.885029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-7fac7610-5693-48bc-ad9b-de9d36255789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ebef76bfb814822a3c94e6e57b4525d', 'request_id': 'req-7fac7610-5693-48bc-ad9b-de9d36255789'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:05.944258 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-7fac7610-5693-48bc-ad9b-de9d36255789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ebef76bfb814822a3c94e6e57b4525d', 'request_id': 'req-7fac7610-5693-48bc-ad9b-de9d36255789'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:05.955122 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-7fac7610-5693-48bc-ad9b-de9d36255789 admin admin] The token cache is being invalidate because project 5ebef76bfb814822a3c94e6e57b4525d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:08:05.955926 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-7fac7610-5693-48bc-ad9b-de9d36255789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:05.956578 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-7fac7610-5693-48bc-ad9b-de9d36255789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:05.958091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1428/2844] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:08:05 2022] DELETE /identity/v3/projects/5ebef76bfb814822a3c94e6e57b4525d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 23:08:05.962222 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4f244-9f2c-4dde-adf4-0c354881342f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:05.963622 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c9e4f244-9f2c-4dde-adf4-0c354881342f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:08:05.977547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4f244-9f2c-4dde-adf4-0c354881342f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:06.032868 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149cfbf-b09a-4c41-8484-fb9277f14e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:06.033578 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149cfbf-b09a-4c41-8484-fb9277f14e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:06.034383 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149cfbf-b09a-4c41-8484-fb9277f14e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:06.034658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149cfbf-b09a-4c41-8484-fb9277f14e40 admin admin] PATH_INFO: `/v3/users/3e8e08ea71f54142acac5525d384a7a0` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:06.035804 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149cfbf-b09a-4c41-8484-fb9277f14e40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e8e08ea71f54142acac5525d384a7a0)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:06.037847 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149cfbf-b09a-4c41-8484-fb9277f14e40 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:06.199277 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2149cfbf-b09a-4c41-8484-fb9277f14e40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e8e08ea71f54142acac5525d384a7a0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:06.269891 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2149cfbf-b09a-4c41-8484-fb9277f14e40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e8e08ea71f54142acac5525d384a7a0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:06.270495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2149cfbf-b09a-4c41-8484-fb9277f14e40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e8e08ea71f54142acac5525d384a7a0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:06.271086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2149cfbf-b09a-4c41-8484-fb9277f14e40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e8e08ea71f54142acac5525d384a7a0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:06.278149 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2149cfbf-b09a-4c41-8484-fb9277f14e40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e8e08ea71f54142acac5525d384a7a0'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:06.286696 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:08:06.296270 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1417/2845] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:08:05 2022] DELETE /identity/v3/users/3e8e08ea71f54142acac5525d384a7a0 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:08:06.546984 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac7610-5693-48bc-ad9b-de9d36255789 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:06.548566 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7fac7610-5693-48bc-ad9b-de9d36255789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:08:06.564152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac7610-5693-48bc-ad9b-de9d36255789 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:06.623197 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1485b7-d5ca-43ea-bb6f-9da61e0f8d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:06.623836 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1485b7-d5ca-43ea-bb6f-9da61e0f8d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:06.624112 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1485b7-d5ca-43ea-bb6f-9da61e0f8d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:06.624385 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1485b7-d5ca-43ea-bb6f-9da61e0f8d65 admin admin] PATH_INFO: `/v3/projects/f274dbf468264ef3b65dfe73133398f0` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:06.625525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1485b7-d5ca-43ea-bb6f-9da61e0f8d65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f274dbf468264ef3b65dfe73133398f0)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:06.627938 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1485b7-d5ca-43ea-bb6f-9da61e0f8d65 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:06.704411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:08:06.716191 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-cb1485b7-d5ca-43ea-bb6f-9da61e0f8d65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f274dbf468264ef3b65dfe73133398f0', 'request_id': 'req-cb1485b7-d5ca-43ea-bb6f-9da61e0f8d65'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:06.722256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-cb1485b7-d5ca-43ea-bb6f-9da61e0f8d65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f274dbf468264ef3b65dfe73133398f0', 'request_id': 'req-cb1485b7-d5ca-43ea-bb6f-9da61e0f8d65'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:06.815843 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-cb1485b7-d5ca-43ea-bb6f-9da61e0f8d65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f274dbf468264ef3b65dfe73133398f0', 'request_id': 'req-cb1485b7-d5ca-43ea-bb6f-9da61e0f8d65'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:06.827234 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-cb1485b7-d5ca-43ea-bb6f-9da61e0f8d65 admin admin] The token cache is being invalidate because project f274dbf468264ef3b65dfe73133398f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:08:06.827522 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-cb1485b7-d5ca-43ea-bb6f-9da61e0f8d65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:06.828145 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-cb1485b7-d5ca-43ea-bb6f-9da61e0f8d65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:06.829655 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1429/2846] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:08:06 2022] DELETE /identity/v3/projects/f274dbf468264ef3b65dfe73133398f0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:08:06.835424 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfb393-2a97-4407-b427-006cce6f6bc3 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:06.835738 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfb393-2a97-4407-b427-006cce6f6bc3 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:06.836010 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfb393-2a97-4407-b427-006cce6f6bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:06.855108 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-5bcfb393-2a97-4407-b427-006cce6f6bc3 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:08:06.856586 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5bcfb393-2a97-4407-b427-006cce6f6bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:08:06.915462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1418/2847] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:08:06.923211 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd434f8-60a4-486a-add1-47f4627fe21f None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:06.923500 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd434f8-60a4-486a-add1-47f4627fe21f None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:06.923800 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd434f8-60a4-486a-add1-47f4627fe21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:06.944496 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-7dd434f8-60a4-486a-add1-47f4627fe21f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:08:06.945710 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-7dd434f8-60a4-486a-add1-47f4627fe21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:08:06.953539 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1430/2848] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:08:06.957667 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfb393-2a97-4407-b427-006cce6f6bc3 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:06.967220 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfb393-2a97-4407-b427-006cce6f6bc3 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:06.971769 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e84ef-cd3d-4cc4-ae8d-dfc24e591e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:06.972378 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e84ef-cd3d-4cc4-ae8d-dfc24e591e7f admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:06.972690 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e84ef-cd3d-4cc4-ae8d-dfc24e591e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:06.972960 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e84ef-cd3d-4cc4-ae8d-dfc24e591e7f admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:06.973605 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e84ef-cd3d-4cc4-ae8d-dfc24e591e7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:08:06.973907 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e84ef-cd3d-4cc4-ae8d-dfc24e591e7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:06.975504 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e84ef-cd3d-4cc4-ae8d-dfc24e591e7f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:06.987518 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1419/2849] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 23:08:06.991565 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd434f8-60a4-486a-add1-47f4627fe21f None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:07.000781 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd434f8-60a4-486a-add1-47f4627fe21f None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:07.006044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3101e6-f5f4-4925-a951-7900e97b00f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:07.006638 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3101e6-f5f4-4925-a951-7900e97b00f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:07.006920 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3101e6-f5f4-4925-a951-7900e97b00f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:07.007194 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3101e6-f5f4-4925-a951-7900e97b00f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:07.007827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3101e6-f5f4-4925-a951-7900e97b00f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:07.009769 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3101e6-f5f4-4925-a951-7900e97b00f2 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:07.106541 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1431/2850] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:08:06 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:08:07.110910 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e84ef-cd3d-4cc4-ae8d-dfc24e591e7f admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:07.121511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e84ef-cd3d-4cc4-ae8d-dfc24e591e7f admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:07.176795 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1638070-5875-4fdc-94e4-4cd94dd2325d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:07.177397 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1638070-5875-4fdc-94e4-4cd94dd2325d admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:07.177681 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1638070-5875-4fdc-94e4-4cd94dd2325d admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:07.177957 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1638070-5875-4fdc-94e4-4cd94dd2325d admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:07.178576 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1638070-5875-4fdc-94e4-4cd94dd2325d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:07.180535 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1638070-5875-4fdc-94e4-4cd94dd2325d admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:07.258286 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1420/2851] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:08:07 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:08:07.262472 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3101e6-f5f4-4925-a951-7900e97b00f2 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:07.272778 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3101e6-f5f4-4925-a951-7900e97b00f2 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:07.277440 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5bfea-099b-4c84-973f-0337932ffe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:07.278029 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5bfea-099b-4c84-973f-0337932ffe04 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:07.278308 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5bfea-099b-4c84-973f-0337932ffe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:07.278581 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5bfea-099b-4c84-973f-0337932ffe04 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:07.279216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5bfea-099b-4c84-973f-0337932ffe04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:07.280883 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5bfea-099b-4c84-973f-0337932ffe04 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:07.291112 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1432/2852] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:08:07.294964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1638070-5875-4fdc-94e4-4cd94dd2325d admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:07.305509 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1638070-5875-4fdc-94e4-4cd94dd2325d admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:07.310022 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e56ee-a406-4740-9b0a-0200e20c12d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:07.310627 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e56ee-a406-4740-9b0a-0200e20c12d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:07.310886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e56ee-a406-4740-9b0a-0200e20c12d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:07.311158 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e56ee-a406-4740-9b0a-0200e20c12d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:07.311794 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e56ee-a406-4740-9b0a-0200e20c12d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:07.313422 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e56ee-a406-4740-9b0a-0200e20c12d3 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:07.323665 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1421/2853] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:08:07.327463 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5bfea-099b-4c84-973f-0337932ffe04 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:07.337377 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5bfea-099b-4c84-973f-0337932ffe04 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:07.342204 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c58826-aa5f-4a85-9ea9-266d13f3f590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:07.342806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c58826-aa5f-4a85-9ea9-266d13f3f590 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:07.343078 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c58826-aa5f-4a85-9ea9-266d13f3f590 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:07.343365 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c58826-aa5f-4a85-9ea9-266d13f3f590 admin admin] PATH_INFO: `/v3/projects/8259c1941b2042c49db2dd1dbe815c08/users/b737cd8721f744b283d494185e081fd4/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:07.359069 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c58826-aa5f-4a85-9ea9-266d13f3f590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8259c1941b2042c49db2dd1dbe815c08, user_id=b737cd8721f744b283d494185e081fd4, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:07.362430 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c58826-aa5f-4a85-9ea9-266d13f3f590 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:07.441146 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1433/2854] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:08:07 2022] PUT /identity/v3/projects/8259c1941b2042c49db2dd1dbe815c08/users/b737cd8721f744b283d494185e081fd4/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:08:07.451353 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d125db1-93e6-4003-a7d2-11d62caca521 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:07.451638 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d125db1-93e6-4003-a7d2-11d62caca521 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:07.451915 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d125db1-93e6-4003-a7d2-11d62caca521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:07.480162 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-9d125db1-93e6-4003-a7d2-11d62caca521 None None] MFA Rules not processed for user `b737cd8721f744b283d494185e081fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:08:07.481680 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-9d125db1-93e6-4003-a7d2-11d62caca521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:08:07.525048 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:08:07.544879 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1422/2855] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:08:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:08:07.556010 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c58826-aa5f-4a85-9ea9-266d13f3f590 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:07.557704 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-48c58826-aa5f-4a85-9ea9-266d13f3f590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:08:07.615373 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c58826-aa5f-4a85-9ea9-266d13f3f590 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:07.618971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c632b61-fac4-49c8-bd36-dd5e53f6591e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a2c1f1668814a5e9e654c6308fa0628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:07.619581 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c632b61-fac4-49c8-bd36-dd5e53f6591e service glance] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:07.619889 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c632b61-fac4-49c8-bd36-dd5e53f6591e service glance] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:07.620165 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c632b61-fac4-49c8-bd36-dd5e53f6591e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:07.628511 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c632b61-fac4-49c8-bd36-dd5e53f6591e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:07.629971 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c632b61-fac4-49c8-bd36-dd5e53f6591e service glance] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:07.638646 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1434/2856] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:08:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:08:17.612670 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=6 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:08:17.634695 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:08:26.892091 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d125db1-93e6-4003-a7d2-11d62caca521 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:26.954520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d125db1-93e6-4003-a7d2-11d62caca521 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:26.959883 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b76e2-21b7-49d1-89c7-2e2f81df1511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:26.960547 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b76e2-21b7-49d1-89c7-2e2f81df1511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:26.960828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b76e2-21b7-49d1-89c7-2e2f81df1511 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:26.961103 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b76e2-21b7-49d1-89c7-2e2f81df1511 admin admin] PATH_INFO: `/v3/users/b737cd8721f744b283d494185e081fd4` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:26.962232 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b76e2-21b7-49d1-89c7-2e2f81df1511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b737cd8721f744b283d494185e081fd4)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:26.964208 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b76e2-21b7-49d1-89c7-2e2f81df1511 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:27.154045 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b64b76e2-21b7-49d1-89c7-2e2f81df1511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b737cd8721f744b283d494185e081fd4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:27.218340 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b64b76e2-21b7-49d1-89c7-2e2f81df1511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b737cd8721f744b283d494185e081fd4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:27.218964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b64b76e2-21b7-49d1-89c7-2e2f81df1511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b737cd8721f744b283d494185e081fd4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:27.219575 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b64b76e2-21b7-49d1-89c7-2e2f81df1511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b737cd8721f744b283d494185e081fd4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:27.226691 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-b64b76e2-21b7-49d1-89c7-2e2f81df1511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b737cd8721f744b283d494185e081fd4'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:27.244287 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1423/2857] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:08:26 2022] DELETE /identity/v3/users/b737cd8721f744b283d494185e081fd4 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:08:27.248743 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ff157-8374-45b7-893f-37147a2d5450 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:27.249253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ff157-8374-45b7-893f-37147a2d5450 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:27.249361 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ff157-8374-45b7-893f-37147a2d5450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:27.269338 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-f51ff157-8374-45b7-893f-37147a2d5450 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:08:27.270538 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f51ff157-8374-45b7-893f-37147a2d5450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:08:27.327722 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1435/2858] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:08:27.337430 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b76e2-21b7-49d1-89c7-2e2f81df1511 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:27.338828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b64b76e2-21b7-49d1-89c7-2e2f81df1511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:08:27.395567 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b76e2-21b7-49d1-89c7-2e2f81df1511 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:27.399128 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0ae5f-cc36-471c-a229-593e446afa7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:27.399722 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0ae5f-cc36-471c-a229-593e446afa7c service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:27.399997 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0ae5f-cc36-471c-a229-593e446afa7c service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:27.400264 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0ae5f-cc36-471c-a229-593e446afa7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:27.409030 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0ae5f-cc36-471c-a229-593e446afa7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:27.410366 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0ae5f-cc36-471c-a229-593e446afa7c service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:27.419999 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1424/2859] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:08:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:08:27.811606 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ff157-8374-45b7-893f-37147a2d5450 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:27.813080 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f51ff157-8374-45b7-893f-37147a2d5450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:08:27.826088 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ff157-8374-45b7-893f-37147a2d5450 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:27.830737 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81067f00-5b27-48de-b5a0-b13ff1c45192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:27.831371 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81067f00-5b27-48de-b5a0-b13ff1c45192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:27.831651 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81067f00-5b27-48de-b5a0-b13ff1c45192 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:27.831935 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81067f00-5b27-48de-b5a0-b13ff1c45192 admin admin] PATH_INFO: `/v3/projects/8259c1941b2042c49db2dd1dbe815c08` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:27.833616 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81067f00-5b27-48de-b5a0-b13ff1c45192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8259c1941b2042c49db2dd1dbe815c08)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:27.836898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81067f00-5b27-48de-b5a0-b13ff1c45192 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:27.953237 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-81067f00-5b27-48de-b5a0-b13ff1c45192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8259c1941b2042c49db2dd1dbe815c08', 'request_id': 'req-81067f00-5b27-48de-b5a0-b13ff1c45192'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:27.959895 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-81067f00-5b27-48de-b5a0-b13ff1c45192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8259c1941b2042c49db2dd1dbe815c08', 'request_id': 'req-81067f00-5b27-48de-b5a0-b13ff1c45192'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:28.052849 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-81067f00-5b27-48de-b5a0-b13ff1c45192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8259c1941b2042c49db2dd1dbe815c08', 'request_id': 'req-81067f00-5b27-48de-b5a0-b13ff1c45192'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:28.063499 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-81067f00-5b27-48de-b5a0-b13ff1c45192 admin admin] The token cache is being invalidate because project 8259c1941b2042c49db2dd1dbe815c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:08:28.063794 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-81067f00-5b27-48de-b5a0-b13ff1c45192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:28.067555 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-81067f00-5b27-48de-b5a0-b13ff1c45192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:08:28.067555 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1436/2860] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:08:27 2022] DELETE /identity/v3/projects/8259c1941b2042c49db2dd1dbe815c08 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:08:28.071487 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a8634-860f-4880-bc13-da692d88cc9e None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:28.071941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a8634-860f-4880-bc13-da692d88cc9e None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:28.072029 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a8634-860f-4880-bc13-da692d88cc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:28.092297 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-c65a8634-860f-4880-bc13-da692d88cc9e None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:08:28.093536 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c65a8634-860f-4880-bc13-da692d88cc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:08:28.110722 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:08:28.153010 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1425/2861] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:08:28.166187 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b3d49-78f5-4789-bee9-0459f7a28a38 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:28.166433 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b3d49-78f5-4789-bee9-0459f7a28a38 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:28.166727 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b3d49-78f5-4789-bee9-0459f7a28a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:28.186675 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-290b3d49-78f5-4789-bee9-0459f7a28a38 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:08:28.187951 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-290b3d49-78f5-4789-bee9-0459f7a28a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:08:28.196625 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1437/2862] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:08:28.207314 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a8634-860f-4880-bc13-da692d88cc9e None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:28.217522 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a8634-860f-4880-bc13-da692d88cc9e None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:28.222175 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f171ae2-01ec-4b82-9b25-ac2e8b43a59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:28.222769 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f171ae2-01ec-4b82-9b25-ac2e8b43a59b admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:28.223048 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f171ae2-01ec-4b82-9b25-ac2e8b43a59b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:28.223319 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f171ae2-01ec-4b82-9b25-ac2e8b43a59b admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:28.223962 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f171ae2-01ec-4b82-9b25-ac2e8b43a59b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:08:28.224263 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f171ae2-01ec-4b82-9b25-ac2e8b43a59b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:28.225886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f171ae2-01ec-4b82-9b25-ac2e8b43a59b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:28.237661 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1426/2863] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 23:08:28.241840 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b3d49-78f5-4789-bee9-0459f7a28a38 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:28.250884 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b3d49-78f5-4789-bee9-0459f7a28a38 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:28.255974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc710b0e-33b7-4098-b1dd-8a7f555d8909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:28.256616 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc710b0e-33b7-4098-b1dd-8a7f555d8909 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:28.256897 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc710b0e-33b7-4098-b1dd-8a7f555d8909 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:28.257171 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc710b0e-33b7-4098-b1dd-8a7f555d8909 admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:28.257799 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc710b0e-33b7-4098-b1dd-8a7f555d8909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:28.259694 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc710b0e-33b7-4098-b1dd-8a7f555d8909 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:28.353839 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1438/2864] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:08:28 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:08:28.358428 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f171ae2-01ec-4b82-9b25-ac2e8b43a59b admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:28.368381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f171ae2-01ec-4b82-9b25-ac2e8b43a59b admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:28.422922 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d1854-2061-41e7-ada7-721f726665a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:28.423511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d1854-2061-41e7-ada7-721f726665a8 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:28.423787 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d1854-2061-41e7-ada7-721f726665a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:28.424055 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d1854-2061-41e7-ada7-721f726665a8 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:28.424762 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d1854-2061-41e7-ada7-721f726665a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:28.427234 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d1854-2061-41e7-ada7-721f726665a8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:28.546784 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1427/2865] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:08:28 2022] POST /identity/v3/users => generated 283 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:08:28.551164 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc710b0e-33b7-4098-b1dd-8a7f555d8909 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:28.562012 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc710b0e-33b7-4098-b1dd-8a7f555d8909 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:28.566602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1e9ac-553d-4dc5-b942-78e4185d93e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:28.567870 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1e9ac-553d-4dc5-b942-78e4185d93e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:28.568156 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1e9ac-553d-4dc5-b942-78e4185d93e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:28.568528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1e9ac-553d-4dc5-b942-78e4185d93e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:28.569175 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1e9ac-553d-4dc5-b942-78e4185d93e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:28.570768 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1e9ac-553d-4dc5-b942-78e4185d93e4 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:28.580780 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1439/2866] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:08:28.584656 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d1854-2061-41e7-ada7-721f726665a8 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:28.594710 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d1854-2061-41e7-ada7-721f726665a8 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:28.599518 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db30475-faf2-4506-bc85-259e33169a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:28.600134 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db30475-faf2-4506-bc85-259e33169a45 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:28.600411 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db30475-faf2-4506-bc85-259e33169a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:28.600740 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db30475-faf2-4506-bc85-259e33169a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:28.601375 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db30475-faf2-4506-bc85-259e33169a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:28.603041 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db30475-faf2-4506-bc85-259e33169a45 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:28.614880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1428/2867] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:08:28.619010 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1e9ac-553d-4dc5-b942-78e4185d93e4 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:28.631319 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1e9ac-553d-4dc5-b942-78e4185d93e4 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:28.635824 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350a3d8-4f06-4931-812b-7b1873dd3b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:28.636559 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350a3d8-4f06-4931-812b-7b1873dd3b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:28.636827 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350a3d8-4f06-4931-812b-7b1873dd3b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:28.637098 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350a3d8-4f06-4931-812b-7b1873dd3b42 admin admin] PATH_INFO: `/v3/projects/291aff34b3cf42eea1a1daa6b5a4b318/users/5c1e27a3927f4fcd8ccbea97c5b91d85/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:28.651166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350a3d8-4f06-4931-812b-7b1873dd3b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=291aff34b3cf42eea1a1daa6b5a4b318, user_id=5c1e27a3927f4fcd8ccbea97c5b91d85, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:28.653851 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350a3d8-4f06-4931-812b-7b1873dd3b42 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:28.723745 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1440/2868] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:08:28 2022] PUT /identity/v3/projects/291aff34b3cf42eea1a1daa6b5a4b318/users/5c1e27a3927f4fcd8ccbea97c5b91d85/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:08:28.734634 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a39685-5930-4163-8896-7e97c9e73712 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:28.734914 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a39685-5930-4163-8896-7e97c9e73712 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:28.735189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a39685-5930-4163-8896-7e97c9e73712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:28.762895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-f0a39685-5930-4163-8896-7e97c9e73712 None None] MFA Rules not processed for user `5c1e27a3927f4fcd8ccbea97c5b91d85`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:08:28.764084 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f0a39685-5930-4163-8896-7e97c9e73712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:08:28.827614 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1429/2869] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:08:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:08:28.842007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350a3d8-4f06-4931-812b-7b1873dd3b42 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:08:28.842007 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-9350a3d8-4f06-4931-812b-7b1873dd3b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:08:28.862878 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:08:28.897216 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350a3d8-4f06-4931-812b-7b1873dd3b42 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:08:28.901401 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682f197-130b-4771-aa26-0bdcc60d4faf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:08:28.902025 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682f197-130b-4771-aa26-0bdcc60d4faf service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:08:28.902300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682f197-130b-4771-aa26-0bdcc60d4faf service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:08:28.902568 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682f197-130b-4771-aa26-0bdcc60d4faf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:08:28.911538 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682f197-130b-4771-aa26-0bdcc60d4faf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:08:28.913077 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682f197-130b-4771-aa26-0bdcc60d4faf service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:08:28.921700 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1441/2870] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:08:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:08:38.824793 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:08:39.026843 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=17 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:09:07.646979 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a39685-5930-4163-8896-7e97c9e73712 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:09:07.706493 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a39685-5930-4163-8896-7e97c9e73712 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:09:07.710970 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0564731-663f-408d-acbc-1bf0ed54c2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:09:07.711580 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0564731-663f-408d-acbc-1bf0ed54c2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:09:07.711853 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0564731-663f-408d-acbc-1bf0ed54c2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:09:07.712121 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0564731-663f-408d-acbc-1bf0ed54c2e0 admin admin] PATH_INFO: `/v3/users/5c1e27a3927f4fcd8ccbea97c5b91d85` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:09:07.713245 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0564731-663f-408d-acbc-1bf0ed54c2e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c1e27a3927f4fcd8ccbea97c5b91d85)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:09:07.715195 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0564731-663f-408d-acbc-1bf0ed54c2e0 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:09:07.874901 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c0564731-663f-408d-acbc-1bf0ed54c2e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c1e27a3927f4fcd8ccbea97c5b91d85'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:09:07.938704 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c0564731-663f-408d-acbc-1bf0ed54c2e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c1e27a3927f4fcd8ccbea97c5b91d85'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:09:07.939300 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c0564731-663f-408d-acbc-1bf0ed54c2e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c1e27a3927f4fcd8ccbea97c5b91d85'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:09:07.939895 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c0564731-663f-408d-acbc-1bf0ed54c2e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c1e27a3927f4fcd8ccbea97c5b91d85'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:09:07.946937 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-c0564731-663f-408d-acbc-1bf0ed54c2e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c1e27a3927f4fcd8ccbea97c5b91d85'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:09:07.964467 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1430/2871] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:09:07 2022] DELETE /identity/v3/users/5c1e27a3927f4fcd8ccbea97c5b91d85 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:09:07.969004 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3bc66-bfc6-4f86-863a-f2b9c31bf165 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:09:07.969502 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3bc66-bfc6-4f86-863a-f2b9c31bf165 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:09:07.969611 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3bc66-bfc6-4f86-863a-f2b9c31bf165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:09:07.989667 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-f8f3bc66-bfc6-4f86-863a-f2b9c31bf165 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:09:07.991517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f8f3bc66-bfc6-4f86-863a-f2b9c31bf165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:09:08.048205 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1442/2872] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:09:08.058518 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0564731-663f-408d-acbc-1bf0ed54c2e0 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:09:08.059930 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c0564731-663f-408d-acbc-1bf0ed54c2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:09:08.118059 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0564731-663f-408d-acbc-1bf0ed54c2e0 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:09:08.122031 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417b135-f106-42b4-80aa-878380e50f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:09:08.122648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417b135-f106-42b4-80aa-878380e50f2b service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:09:08.122926 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417b135-f106-42b4-80aa-878380e50f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:09:08.123195 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417b135-f106-42b4-80aa-878380e50f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:09:08.132265 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417b135-f106-42b4-80aa-878380e50f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:09:08.133773 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417b135-f106-42b4-80aa-878380e50f2b service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:09:08.143373 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1431/2873] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:09:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:09:08.540137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3bc66-bfc6-4f86-863a-f2b9c31bf165 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:09:08.541613 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f8f3bc66-bfc6-4f86-863a-f2b9c31bf165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:09:08.557339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3bc66-bfc6-4f86-863a-f2b9c31bf165 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:09:08.562346 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870121cb-74b6-4d62-954b-34dece0b51d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:09:08.565723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870121cb-74b6-4d62-954b-34dece0b51d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:09:08.565723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870121cb-74b6-4d62-954b-34dece0b51d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:09:08.565723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870121cb-74b6-4d62-954b-34dece0b51d9 admin admin] PATH_INFO: `/v3/projects/291aff34b3cf42eea1a1daa6b5a4b318` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:09:08.565723 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870121cb-74b6-4d62-954b-34dece0b51d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=291aff34b3cf42eea1a1daa6b5a4b318)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:09:08.566830 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870121cb-74b6-4d62-954b-34dece0b51d9 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:09:08.664411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-870121cb-74b6-4d62-954b-34dece0b51d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '291aff34b3cf42eea1a1daa6b5a4b318', 'request_id': 'req-870121cb-74b6-4d62-954b-34dece0b51d9'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:09:08.670456 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-870121cb-74b6-4d62-954b-34dece0b51d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '291aff34b3cf42eea1a1daa6b5a4b318', 'request_id': 'req-870121cb-74b6-4d62-954b-34dece0b51d9'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:09:08.733215 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-870121cb-74b6-4d62-954b-34dece0b51d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '291aff34b3cf42eea1a1daa6b5a4b318', 'request_id': 'req-870121cb-74b6-4d62-954b-34dece0b51d9'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:09:08.745295 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-870121cb-74b6-4d62-954b-34dece0b51d9 admin admin] The token cache is being invalidate because project 291aff34b3cf42eea1a1daa6b5a4b318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:09:08.746615 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-870121cb-74b6-4d62-954b-34dece0b51d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:09:08.746615 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-870121cb-74b6-4d62-954b-34dece0b51d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:09:08.747686 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1443/2874] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:09:08 2022] DELETE /identity/v3/projects/291aff34b3cf42eea1a1daa6b5a4b318 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:09:18.139193 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:09:18.742144 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:09:23.176886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d48f2-a43d-40f2-a10d-03243680e67b None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:09:23.177402 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d48f2-a43d-40f2-a10d-03243680e67b None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:09:23.177402 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d48f2-a43d-40f2-a10d-03243680e67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:09:23.196965 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-346d48f2-a43d-40f2-a10d-03243680e67b None None] MFA Rules not processed for user `d457eb4758414478bd130efe911cbcc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:09:23.198172 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-346d48f2-a43d-40f2-a10d-03243680e67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:09:23.251941 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1432/2875] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:09:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:09:23.558270 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870121cb-74b6-4d62-954b-34dece0b51d9 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:09:23.559681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-870121cb-74b6-4d62-954b-34dece0b51d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:09:23.623731 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870121cb-74b6-4d62-954b-34dece0b51d9 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:09:23.627296 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c5b97-da94-47ba-a01e-fc69a5601691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:09:23.627923 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c5b97-da94-47ba-a01e-fc69a5601691 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:09:23.628236 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c5b97-da94-47ba-a01e-fc69a5601691 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:09:23.628554 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c5b97-da94-47ba-a01e-fc69a5601691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:09:23.630259 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e47c5b97-da94-47ba-a01e-fc69a5601691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:09:23.639684 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c5b97-da94-47ba-a01e-fc69a5601691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:09:23.641253 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c5b97-da94-47ba-a01e-fc69a5601691 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:09:23.649083 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1444/2876] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:09:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:09:24.056953 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d48f2-a43d-40f2-a10d-03243680e67b None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:09:24.058718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-346d48f2-a43d-40f2-a10d-03243680e67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:09:24.138946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d48f2-a43d-40f2-a10d-03243680e67b None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:09:24.144110 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510185c-cfac-4a1f-8e5c-248eefda0502 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bd5bbbf65461990c9bb2747dbe5e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:09:24.144742 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510185c-cfac-4a1f-8e5c-248eefda0502 service placement] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:09:24.145019 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510185c-cfac-4a1f-8e5c-248eefda0502 service placement] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:09:24.145294 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510185c-cfac-4a1f-8e5c-248eefda0502 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:09:24.146981 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a510185c-cfac-4a1f-8e5c-248eefda0502 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:09:24.158825 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510185c-cfac-4a1f-8e5c-248eefda0502 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:09:24.160455 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510185c-cfac-4a1f-8e5c-248eefda0502 service placement] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:09:24.170177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1433/2877] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:09:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:09:28.008229 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c5b97-da94-47ba-a01e-fc69a5601691 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:09:28.010434 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e47c5b97-da94-47ba-a01e-fc69a5601691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:09:28.084091 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c5b97-da94-47ba-a01e-fc69a5601691 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:09:28.089790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9340f7d-1b37-4683-95f3-39b1ca18f4f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:09:28.090400 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340f7d-1b37-4683-95f3-39b1ca18f4f3 service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:09:28.090679 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340f7d-1b37-4683-95f3-39b1ca18f4f3 service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:09:28.090950 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340f7d-1b37-4683-95f3-39b1ca18f4f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:09:28.092720 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c9340f7d-1b37-4683-95f3-39b1ca18f4f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:09:28.106206 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9340f7d-1b37-4683-95f3-39b1ca18f4f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:09:28.108060 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9340f7d-1b37-4683-95f3-39b1ca18f4f3 service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:09:28.119762 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1445/2878] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:09:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:09:34.165995 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=57 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:09:34.752975 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510185c-cfac-4a1f-8e5c-248eefda0502 service placement] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:09:34.754508 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a510185c-cfac-4a1f-8e5c-248eefda0502 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:09:34.771974 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510185c-cfac-4a1f-8e5c-248eefda0502 service placement] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:09:34.777560 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58454661-001f-4e7b-8996-f37efeed8c77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:09:34.778153 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58454661-001f-4e7b-8996-f37efeed8c77 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:09:34.778427 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58454661-001f-4e7b-8996-f37efeed8c77 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:09:34.778692 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58454661-001f-4e7b-8996-f37efeed8c77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:09:34.780540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-58454661-001f-4e7b-8996-f37efeed8c77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:09:34.792498 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58454661-001f-4e7b-8996-f37efeed8c77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:09:34.794134 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58454661-001f-4e7b-8996-f37efeed8c77 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:09:34.804703 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1434/2879] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:09:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:09:38.114322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=60 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:09:44.800219 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=6 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:10:57.989763 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9340f7d-1b37-4683-95f3-39b1ca18f4f3 service nova] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:10:57.991379 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-c9340f7d-1b37-4683-95f3-39b1ca18f4f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:10:58.007267 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9340f7d-1b37-4683-95f3-39b1ca18f4f3 service nova] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:10:58.012962 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a0de1-9049-46c8-9e91-60161656ac9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bd5bbbf65461990c9bb2747dbe5e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:10:58.013573 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a0de1-9049-46c8-9e91-60161656ac9f service placement] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:10:58.013851 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a0de1-9049-46c8-9e91-60161656ac9f service placement] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:10:58.014120 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a0de1-9049-46c8-9e91-60161656ac9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:10:58.015832 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-873a0de1-9049-46c8-9e91-60161656ac9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:10:58.027575 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a0de1-9049-46c8-9e91-60161656ac9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:10:58.029203 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a0de1-9049-46c8-9e91-60161656ac9f service placement] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:10:58.039814 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1446/2880] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:10:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:11:08.035588 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=6 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:11:09.950329 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c49589-b5bf-45de-8ba7-39d5810ddeaf None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:11:09.952543 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c49589-b5bf-45de-8ba7-39d5810ddeaf None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:11:09.952543 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c49589-b5bf-45de-8ba7-39d5810ddeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:11:09.970051 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-19c49589-b5bf-45de-8ba7-39d5810ddeaf None None] MFA Rules not processed for user `d457eb4758414478bd130efe911cbcc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:11:09.971235 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-19c49589-b5bf-45de-8ba7-39d5810ddeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:11:09.977943 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1435/2881] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:11:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:11:19.964136 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:11:25.784272 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a0de1-9049-46c8-9e91-60161656ac9f service placement] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:11:25.796966 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a0de1-9049-46c8-9e91-60161656ac9f service placement] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:11:25.802335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011d9c2-f2f2-4118-ae25-00c06bcedb1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:11:25.802964 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011d9c2-f2f2-4118-ae25-00c06bcedb1b service nova] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:11:25.803240 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011d9c2-f2f2-4118-ae25-00c06bcedb1b service nova] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:11:25.803509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011d9c2-f2f2-4118-ae25-00c06bcedb1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:11:25.805282 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e011d9c2-f2f2-4118-ae25-00c06bcedb1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:11:25.817893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011d9c2-f2f2-4118-ae25-00c06bcedb1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:11:25.819451 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011d9c2-f2f2-4118-ae25-00c06bcedb1b service nova] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:11:25.830330 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1447/2882] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:11:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:11:35.825452 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=6 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:12:38.549511 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c49589-b5bf-45de-8ba7-39d5810ddeaf None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:12:38.562206 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c49589-b5bf-45de-8ba7-39d5810ddeaf None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:12:38.567598 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babf474-e37b-41ea-baf4-57def6f47748 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:12:38.568220 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babf474-e37b-41ea-baf4-57def6f47748 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:12:38.568537 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babf474-e37b-41ea-baf4-57def6f47748 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:12:38.568811 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babf474-e37b-41ea-baf4-57def6f47748 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:12:38.570554 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3babf474-e37b-41ea-baf4-57def6f47748 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:12:38.581170 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babf474-e37b-41ea-baf4-57def6f47748 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:12:38.582742 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babf474-e37b-41ea-baf4-57def6f47748 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:12:38.591495 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1436/2883] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:12:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:12:40.402774 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011d9c2-f2f2-4118-ae25-00c06bcedb1b service nova] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:12:40.404237 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e011d9c2-f2f2-4118-ae25-00c06bcedb1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:12:40.471494 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011d9c2-f2f2-4118-ae25-00c06bcedb1b service nova] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:12:40.475085 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287eed3f-b06b-43e6-bcea-158f9ac091e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:12:40.475696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287eed3f-b06b-43e6-bcea-158f9ac091e8 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:12:40.475972 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287eed3f-b06b-43e6-bcea-158f9ac091e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:12:40.476243 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287eed3f-b06b-43e6-bcea-158f9ac091e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:12:40.477975 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-287eed3f-b06b-43e6-bcea-158f9ac091e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:12:40.491302 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287eed3f-b06b-43e6-bcea-158f9ac091e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:12:40.492736 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287eed3f-b06b-43e6-bcea-158f9ac091e8 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:12:40.503806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1448/2884] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:12:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:12:43.433562 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babf474-e37b-41ea-baf4-57def6f47748 service nova] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:12:43.434969 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-3babf474-e37b-41ea-baf4-57def6f47748 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:12:43.447061 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babf474-e37b-41ea-baf4-57def6f47748 service nova] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:12:43.451883 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bd30d-d652-476e-be92-b3ebcdfacc79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:12:43.451883 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bd30d-d652-476e-be92-b3ebcdfacc79 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:12:43.451883 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bd30d-d652-476e-be92-b3ebcdfacc79 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:12:43.451883 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bd30d-d652-476e-be92-b3ebcdfacc79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:12:43.454068 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-c33bd30d-d652-476e-be92-b3ebcdfacc79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:12:43.470017 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bd30d-d652-476e-be92-b3ebcdfacc79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:12:43.471463 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bd30d-d652-476e-be92-b3ebcdfacc79 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:12:43.482470 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1437/2885] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:12:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:12:50.498596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=26 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:12:53.059596 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74924d0-1028-4d26-baf0-e07bb7c8cf44 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:12:53.060192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74924d0-1028-4d26-baf0-e07bb7c8cf44 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:12:53.060192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74924d0-1028-4d26-baf0-e07bb7c8cf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:12:53.082334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-f74924d0-1028-4d26-baf0-e07bb7c8cf44 None None] MFA Rules not processed for user `d457eb4758414478bd130efe911cbcc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:12:53.083714 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f74924d0-1028-4d26-baf0-e07bb7c8cf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:12:53.090846 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1449/2886] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:12:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:12:53.402817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bd30d-d652-476e-be92-b3ebcdfacc79 service cinder] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:12:53.412195 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bd30d-d652-476e-be92-b3ebcdfacc79 service cinder] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:12:53.415772 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d72186-7fac-47e8-89e0-e830b760a47c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:12:53.416357 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d72186-7fac-47e8-89e0-e830b760a47c service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:12:53.416663 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d72186-7fac-47e8-89e0-e830b760a47c service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:12:53.416933 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d72186-7fac-47e8-89e0-e830b760a47c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:12:53.418625 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-84d72186-7fac-47e8-89e0-e830b760a47c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:12:53.429182 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d72186-7fac-47e8-89e0-e830b760a47c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:12:53.430650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d72186-7fac-47e8-89e0-e830b760a47c service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:12:53.439148 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1438/2887] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:12:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:12:56.647842 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74924d0-1028-4d26-baf0-e07bb7c8cf44 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:12:56.649290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f74924d0-1028-4d26-baf0-e07bb7c8cf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:12:56.662335 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74924d0-1028-4d26-baf0-e07bb7c8cf44 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:12:56.665928 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4968706-3316-4c8e-9627-af58b24afa6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:12:56.666553 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4968706-3316-4c8e-9627-af58b24afa6f service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:12:56.666835 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4968706-3316-4c8e-9627-af58b24afa6f service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:12:56.667110 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4968706-3316-4c8e-9627-af58b24afa6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:12:56.668811 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-b4968706-3316-4c8e-9627-af58b24afa6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:12:56.678639 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4968706-3316-4c8e-9627-af58b24afa6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:12:56.680062 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4968706-3316-4c8e-9627-af58b24afa6f service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:12:56.688887 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1450/2888] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:12:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:13:03.435100 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=18 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:13:06.684477 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=9 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:14:31.522729 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d72186-7fac-47e8-89e0-e830b760a47c service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:31.537718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d72186-7fac-47e8-89e0-e830b760a47c service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:31.543330 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e045c8-8ab7-4ff7-aa04-a47bfddb16ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:31.543933 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e045c8-8ab7-4ff7-aa04-a47bfddb16ec service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:31.544209 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e045c8-8ab7-4ff7-aa04-a47bfddb16ec service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:31.544508 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e045c8-8ab7-4ff7-aa04-a47bfddb16ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:31.554100 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e045c8-8ab7-4ff7-aa04-a47bfddb16ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:31.555754 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e045c8-8ab7-4ff7-aa04-a47bfddb16ec service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:31.571891 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1439/2889] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:14:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 23:14:38.122653 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4968706-3316-4c8e-9627-af58b24afa6f service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:38.131278 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4968706-3316-4c8e-9627-af58b24afa6f service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:38.134991 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee80db-7dd9-45ee-8214-db5167b3f4a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:38.142436 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee80db-7dd9-45ee-8214-db5167b3f4a6 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:38.142436 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee80db-7dd9-45ee-8214-db5167b3f4a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:38.142436 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee80db-7dd9-45ee-8214-db5167b3f4a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:38.142436 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-12ee80db-7dd9-45ee-8214-db5167b3f4a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:14:38.201101 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee80db-7dd9-45ee-8214-db5167b3f4a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:38.202518 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee80db-7dd9-45ee-8214-db5167b3f4a6 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:38.212302 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1451/2890] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:14:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:14:41.561948 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=6 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:14:41.625856 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e045c8-8ab7-4ff7-aa04-a47bfddb16ec service nova] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:41.638403 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e045c8-8ab7-4ff7-aa04-a47bfddb16ec service nova] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:41.643372 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85f658-af59-40e3-8c89-9adc9ac1a6c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bd5bbbf65461990c9bb2747dbe5e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:41.643965 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85f658-af59-40e3-8c89-9adc9ac1a6c9 service placement] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:41.644262 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85f658-af59-40e3-8c89-9adc9ac1a6c9 service placement] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:41.644652 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85f658-af59-40e3-8c89-9adc9ac1a6c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:41.646869 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-5a85f658-af59-40e3-8c89-9adc9ac1a6c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:14:41.658458 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85f658-af59-40e3-8c89-9adc9ac1a6c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:41.660060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85f658-af59-40e3-8c89-9adc9ac1a6c9 service placement] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:41.670464 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1440/2891] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:14:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:14:41.718641 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee80db-7dd9-45ee-8214-db5167b3f4a6 service neutron] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:41.720251 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-12ee80db-7dd9-45ee-8214-db5167b3f4a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:14:41.732654 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee80db-7dd9-45ee-8214-db5167b3f4a6 service neutron] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:41.737528 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d8a11-5588-4b87-9069-c3b900c94c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:41.738162 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d8a11-5588-4b87-9069-c3b900c94c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:41.738441 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d8a11-5588-4b87-9069-c3b900c94c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:41.738715 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d8a11-5588-4b87-9069-c3b900c94c63 admin admin] PATH_INFO: `/v3/users/d457eb4758414478bd130efe911cbcc0` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:41.739828 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d8a11-5588-4b87-9069-c3b900c94c63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d457eb4758414478bd130efe911cbcc0)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:41.741787 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d8a11-5588-4b87-9069-c3b900c94c63 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:42.011536 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-fb0d8a11-5588-4b87-9069-c3b900c94c63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd457eb4758414478bd130efe911cbcc0'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:14:42.088696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-fb0d8a11-5588-4b87-9069-c3b900c94c63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd457eb4758414478bd130efe911cbcc0'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:14:42.089349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-fb0d8a11-5588-4b87-9069-c3b900c94c63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd457eb4758414478bd130efe911cbcc0'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:14:42.101860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-fb0d8a11-5588-4b87-9069-c3b900c94c63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd457eb4758414478bd130efe911cbcc0'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:14:42.102492 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-fb0d8a11-5588-4b87-9069-c3b900c94c63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd457eb4758414478bd130efe911cbcc0'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:14:42.115732 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1452/2892] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:14:41 2022] DELETE /identity/v3/users/d457eb4758414478bd130efe911cbcc0 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 23:14:42.427911 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85f658-af59-40e3-8c89-9adc9ac1a6c9 service placement] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:42.443011 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85f658-af59-40e3-8c89-9adc9ac1a6c9 service placement] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:42.500630 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cab07-2f0c-4f98-854a-b8b2ff0f4a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:42.501282 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cab07-2f0c-4f98-854a-b8b2ff0f4a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:42.501557 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cab07-2f0c-4f98-854a-b8b2ff0f4a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:42.501824 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cab07-2f0c-4f98-854a-b8b2ff0f4a1f admin admin] PATH_INFO: `/v3/projects/5aac3768a15d434982e1ca3592d3d6ca` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:42.502923 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cab07-2f0c-4f98-854a-b8b2ff0f4a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aac3768a15d434982e1ca3592d3d6ca)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:42.504931 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cab07-2f0c-4f98-854a-b8b2ff0f4a1f admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:42.626886 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1b0cab07-2f0c-4f98-854a-b8b2ff0f4a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aac3768a15d434982e1ca3592d3d6ca', 'request_id': 'req-1b0cab07-2f0c-4f98-854a-b8b2ff0f4a1f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:14:42.632840 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1b0cab07-2f0c-4f98-854a-b8b2ff0f4a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aac3768a15d434982e1ca3592d3d6ca', 'request_id': 'req-1b0cab07-2f0c-4f98-854a-b8b2ff0f4a1f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:14:42.711867 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1b0cab07-2f0c-4f98-854a-b8b2ff0f4a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aac3768a15d434982e1ca3592d3d6ca', 'request_id': 'req-1b0cab07-2f0c-4f98-854a-b8b2ff0f4a1f'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:14:42.724736 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1b0cab07-2f0c-4f98-854a-b8b2ff0f4a1f admin admin] The token cache is being invalidate because project 5aac3768a15d434982e1ca3592d3d6ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:14:42.725693 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1b0cab07-2f0c-4f98-854a-b8b2ff0f4a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:14:42.726717 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-1b0cab07-2f0c-4f98-854a-b8b2ff0f4a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:14:42.728215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1441/2893] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:14:42 2022] DELETE /identity/v3/projects/5aac3768a15d434982e1ca3592d3d6ca => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:14:42.733174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d7f99-fbda-4c66-9a02-53e181d5607f None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:42.733633 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d7f99-fbda-4c66-9a02-53e181d5607f None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:42.734583 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d7f99-fbda-4c66-9a02-53e181d5607f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:42.754349 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-db2d7f99-fbda-4c66-9a02-53e181d5607f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:14:42.755581 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-db2d7f99-fbda-4c66-9a02-53e181d5607f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:14:42.817202 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1453/2894] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:14:42.825666 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef7017-8262-45c1-811b-709cd53617b1 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:42.826038 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef7017-8262-45c1-811b-709cd53617b1 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:42.826383 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef7017-8262-45c1-811b-709cd53617b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:42.847474 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-4aef7017-8262-45c1-811b-709cd53617b1 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:14:42.849374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-4aef7017-8262-45c1-811b-709cd53617b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:14:42.857554 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1442/2895] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:14:42.862195 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d7f99-fbda-4c66-9a02-53e181d5607f None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:42.872766 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d7f99-fbda-4c66-9a02-53e181d5607f None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:42.877470 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75778a05-30fe-463b-a45c-60db686df9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:42.878044 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778a05-30fe-463b-a45c-60db686df9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:42.878326 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778a05-30fe-463b-a45c-60db686df9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:42.878602 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778a05-30fe-463b-a45c-60db686df9e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:42.879312 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75778a05-30fe-463b-a45c-60db686df9e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:14:42.879633 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75778a05-30fe-463b-a45c-60db686df9e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:42.881276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75778a05-30fe-463b-a45c-60db686df9e2 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:42.882888 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:14:42.893495 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1454/2896] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 23:14:42.898462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef7017-8262-45c1-811b-709cd53617b1 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:42.908189 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef7017-8262-45c1-811b-709cd53617b1 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:42.913837 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc24ec3-a7cd-4575-bcb2-8500d4a2a7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:42.914442 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc24ec3-a7cd-4575-bcb2-8500d4a2a7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:42.914717 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc24ec3-a7cd-4575-bcb2-8500d4a2a7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:42.914988 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc24ec3-a7cd-4575-bcb2-8500d4a2a7e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:42.915631 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc24ec3-a7cd-4575-bcb2-8500d4a2a7e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:42.917595 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc24ec3-a7cd-4575-bcb2-8500d4a2a7e8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:43.010820 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1443/2897] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:14:42 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 23:14:43.014979 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75778a05-30fe-463b-a45c-60db686df9e2 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:43.025610 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75778a05-30fe-463b-a45c-60db686df9e2 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:43.080853 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dad4f-aa83-4bcb-bad9-163cd78890bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:43.081642 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dad4f-aa83-4bcb-bad9-163cd78890bc admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:43.081918 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dad4f-aa83-4bcb-bad9-163cd78890bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:43.082900 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dad4f-aa83-4bcb-bad9-163cd78890bc admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:43.083314 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403dad4f-aa83-4bcb-bad9-163cd78890bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:43.085242 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403dad4f-aa83-4bcb-bad9-163cd78890bc admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:43.170339 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1455/2898] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:14:43 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:14:43.174410 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc24ec3-a7cd-4575-bcb2-8500d4a2a7e8 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:43.184875 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc24ec3-a7cd-4575-bcb2-8500d4a2a7e8 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:43.189503 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b4708-686c-4afb-955f-704f45fe4056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:43.190098 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b4708-686c-4afb-955f-704f45fe4056 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:43.190376 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b4708-686c-4afb-955f-704f45fe4056 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:43.190650 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b4708-686c-4afb-955f-704f45fe4056 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:43.191287 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b4708-686c-4afb-955f-704f45fe4056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:43.193489 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b4708-686c-4afb-955f-704f45fe4056 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:43.203266 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1444/2899] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:14:43.207837 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dad4f-aa83-4bcb-bad9-163cd78890bc admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:43.217927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dad4f-aa83-4bcb-bad9-163cd78890bc admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:43.222739 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9eb508-bd23-49a5-86b8-e33a539cef68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:43.223336 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eb508-bd23-49a5-86b8-e33a539cef68 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:43.223643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eb508-bd23-49a5-86b8-e33a539cef68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:43.223917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eb508-bd23-49a5-86b8-e33a539cef68 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:43.224593 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9eb508-bd23-49a5-86b8-e33a539cef68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:43.226305 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9eb508-bd23-49a5-86b8-e33a539cef68 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:43.237223 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1456/2900] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:14:43.241054 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b4708-686c-4afb-955f-704f45fe4056 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:43.250620 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b4708-686c-4afb-955f-704f45fe4056 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:43.255710 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b83a5-a6c8-4c2f-a3e4-d9c555fc14da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:43.256413 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b83a5-a6c8-4c2f-a3e4-d9c555fc14da admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:43.256719 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b83a5-a6c8-4c2f-a3e4-d9c555fc14da admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:43.256993 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b83a5-a6c8-4c2f-a3e4-d9c555fc14da admin admin] PATH_INFO: `/v3/projects/c059ca2aef3446bd8223e1a3f6ca4c73/users/c8114ff498f845b783000dcad1c2c7f0/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:43.271682 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b83a5-a6c8-4c2f-a3e4-d9c555fc14da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c059ca2aef3446bd8223e1a3f6ca4c73, user_id=c8114ff498f845b783000dcad1c2c7f0, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:43.274374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b83a5-a6c8-4c2f-a3e4-d9c555fc14da admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:43.379512 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1445/2901] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:14:43 2022] PUT /identity/v3/projects/c059ca2aef3446bd8223e1a3f6ca4c73/users/c8114ff498f845b783000dcad1c2c7f0/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 23:14:43.390506 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42ee34-0c21-4dcd-96ee-042e3f6ede0b None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:43.390806 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42ee34-0c21-4dcd-96ee-042e3f6ede0b None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:43.391087 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42ee34-0c21-4dcd-96ee-042e3f6ede0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:43.419096 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-4d42ee34-0c21-4dcd-96ee-042e3f6ede0b None None] MFA Rules not processed for user `c8114ff498f845b783000dcad1c2c7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:14:43.420306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4d42ee34-0c21-4dcd-96ee-042e3f6ede0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:14:43.483315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1457/2902] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:14:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:14:43.495100 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b83a5-a6c8-4c2f-a3e4-d9c555fc14da admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:43.496849 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-030b83a5-a6c8-4c2f-a3e4-d9c555fc14da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:14:43.511767 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:14:43.569446 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b83a5-a6c8-4c2f-a3e4-d9c555fc14da admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:43.574914 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d530b73-e00f-4d9f-a412-e2e9ad7d4203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b18fd296138349408613004929144e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:43.575512 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d530b73-e00f-4d9f-a412-e2e9ad7d4203 service nova] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:43.575789 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d530b73-e00f-4d9f-a412-e2e9ad7d4203 service nova] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:43.576062 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d530b73-e00f-4d9f-a412-e2e9ad7d4203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:43.584097 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d530b73-e00f-4d9f-a412-e2e9ad7d4203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:43.585902 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d530b73-e00f-4d9f-a412-e2e9ad7d4203 service nova] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:43.595228 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1446/2903] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:14:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:14:49.630377 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42ee34-0c21-4dcd-96ee-042e3f6ede0b None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:49.687789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42ee34-0c21-4dcd-96ee-042e3f6ede0b None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:49.692860 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b105c01-365f-4aea-9c16-291834564818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:49.693482 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b105c01-365f-4aea-9c16-291834564818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:49.693759 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b105c01-365f-4aea-9c16-291834564818 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:49.694038 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b105c01-365f-4aea-9c16-291834564818 admin admin] PATH_INFO: `/v3/users/c8114ff498f845b783000dcad1c2c7f0` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:49.695141 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b105c01-365f-4aea-9c16-291834564818 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8114ff498f845b783000dcad1c2c7f0)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:49.697093 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b105c01-365f-4aea-9c16-291834564818 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:49.699312 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:14:49.874440 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-8b105c01-365f-4aea-9c16-291834564818 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8114ff498f845b783000dcad1c2c7f0'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:14:49.939517 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-8b105c01-365f-4aea-9c16-291834564818 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8114ff498f845b783000dcad1c2c7f0'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:14:49.940134 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-8b105c01-365f-4aea-9c16-291834564818 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8114ff498f845b783000dcad1c2c7f0'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:14:49.952354 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-8b105c01-365f-4aea-9c16-291834564818 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8114ff498f845b783000dcad1c2c7f0'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:14:49.953136 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-8b105c01-365f-4aea-9c16-291834564818 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8114ff498f845b783000dcad1c2c7f0'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:14:49.965150 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1458/2904] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:14:49 2022] DELETE /identity/v3/users/c8114ff498f845b783000dcad1c2c7f0 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:14:49.969594 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021da7f-5e9d-45ec-af20-394567d7d27c None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:49.970082 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021da7f-5e9d-45ec-af20-394567d7d27c None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:49.970221 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021da7f-5e9d-45ec-af20-394567d7d27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:49.990138 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-e021da7f-5e9d-45ec-af20-394567d7d27c None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:14:49.991328 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e021da7f-5e9d-45ec-af20-394567d7d27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:14:50.048381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1447/2905] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:14:50.058639 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b105c01-365f-4aea-9c16-291834564818 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:50.060112 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-8b105c01-365f-4aea-9c16-291834564818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:14:50.119545 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b105c01-365f-4aea-9c16-291834564818 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:50.123148 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e6f91-0b2c-4298-842e-6506f019e0da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:50.123747 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e6f91-0b2c-4298-842e-6506f019e0da service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:50.124022 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e6f91-0b2c-4298-842e-6506f019e0da service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:50.124290 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e6f91-0b2c-4298-842e-6506f019e0da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:50.133103 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e6f91-0b2c-4298-842e-6506f019e0da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:50.134449 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e6f91-0b2c-4298-842e-6506f019e0da service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:50.143834 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1459/2906] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:14:50.563665 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021da7f-5e9d-45ec-af20-394567d7d27c None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:50.565143 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-e021da7f-5e9d-45ec-af20-394567d7d27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:14:50.578010 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021da7f-5e9d-45ec-af20-394567d7d27c None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:50.583479 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9c6e8-c110-47ae-9901-2b2e6140877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:50.584044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9c6e8-c110-47ae-9901-2b2e6140877b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:50.584324 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9c6e8-c110-47ae-9901-2b2e6140877b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:50.584712 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9c6e8-c110-47ae-9901-2b2e6140877b admin admin] PATH_INFO: `/v3/projects/c059ca2aef3446bd8223e1a3f6ca4c73` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:50.585880 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9c6e8-c110-47ae-9901-2b2e6140877b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c059ca2aef3446bd8223e1a3f6ca4c73)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:50.587824 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9c6e8-c110-47ae-9901-2b2e6140877b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:50.717878 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a3e9c6e8-c110-47ae-9901-2b2e6140877b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c059ca2aef3446bd8223e1a3f6ca4c73', 'request_id': 'req-a3e9c6e8-c110-47ae-9901-2b2e6140877b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:14:50.723929 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a3e9c6e8-c110-47ae-9901-2b2e6140877b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c059ca2aef3446bd8223e1a3f6ca4c73', 'request_id': 'req-a3e9c6e8-c110-47ae-9901-2b2e6140877b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:14:50.779885 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a3e9c6e8-c110-47ae-9901-2b2e6140877b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c059ca2aef3446bd8223e1a3f6ca4c73', 'request_id': 'req-a3e9c6e8-c110-47ae-9901-2b2e6140877b'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:14:50.790271 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a3e9c6e8-c110-47ae-9901-2b2e6140877b admin admin] The token cache is being invalidate because project c059ca2aef3446bd8223e1a3f6ca4c73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:14:50.790550 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a3e9c6e8-c110-47ae-9901-2b2e6140877b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:14:50.792848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-a3e9c6e8-c110-47ae-9901-2b2e6140877b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:14:50.792848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1448/2907] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:14:50 2022] DELETE /identity/v3/projects/c059ca2aef3446bd8223e1a3f6ca4c73 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:14:50.797694 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688eefa-084a-4f02-97f0-ce352cc22613 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:50.798155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688eefa-084a-4f02-97f0-ce352cc22613 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:50.798276 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688eefa-084a-4f02-97f0-ce352cc22613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:50.818012 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-f688eefa-084a-4f02-97f0-ce352cc22613 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:14:50.819252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-f688eefa-084a-4f02-97f0-ce352cc22613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:14:50.876389 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1460/2908] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:14:50.884540 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6362966-e883-4e24-b92c-278a143cb638 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:50.884829 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6362966-e883-4e24-b92c-278a143cb638 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:50.885104 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6362966-e883-4e24-b92c-278a143cb638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:50.904848 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d6362966-e883-4e24-b92c-278a143cb638 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:14:50.906029 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d6362966-e883-4e24-b92c-278a143cb638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:14:50.913751 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1449/2909] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:14:50.917862 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688eefa-084a-4f02-97f0-ce352cc22613 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:50.927578 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688eefa-084a-4f02-97f0-ce352cc22613 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:50.932714 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4d335-fa66-45c1-89f5-9057bf3f232c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:50.933352 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4d335-fa66-45c1-89f5-9057bf3f232c admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:50.933635 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4d335-fa66-45c1-89f5-9057bf3f232c admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:50.933911 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4d335-fa66-45c1-89f5-9057bf3f232c admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:50.934564 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4d335-fa66-45c1-89f5-9057bf3f232c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:14:50.934868 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4d335-fa66-45c1-89f5-9057bf3f232c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:50.936597 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4d335-fa66-45c1-89f5-9057bf3f232c admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:50.948948 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1461/2910] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 23:14:50.953275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6362966-e883-4e24-b92c-278a143cb638 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:50.963330 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6362966-e883-4e24-b92c-278a143cb638 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:50.968044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3becd0-4c74-475c-9e10-036c3ba2cda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:50.968620 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3becd0-4c74-475c-9e10-036c3ba2cda7 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:50.968904 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3becd0-4c74-475c-9e10-036c3ba2cda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:50.969181 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3becd0-4c74-475c-9e10-036c3ba2cda7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:50.969803 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3becd0-4c74-475c-9e10-036c3ba2cda7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:50.971726 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3becd0-4c74-475c-9e10-036c3ba2cda7 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:50.987857 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:14:51.078039 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1450/2911] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:14:50 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:14:51.082152 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4d335-fa66-45c1-89f5-9057bf3f232c admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:51.092264 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4d335-fa66-45c1-89f5-9057bf3f232c admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:51.100174 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:14:51.147978 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a5f87-2486-4d22-8fa9-c8b66de943fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:51.148643 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a5f87-2486-4d22-8fa9-c8b66de943fb admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:51.148922 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a5f87-2486-4d22-8fa9-c8b66de943fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:51.149191 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a5f87-2486-4d22-8fa9-c8b66de943fb admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:51.149816 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a5f87-2486-4d22-8fa9-c8b66de943fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:51.151712 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a5f87-2486-4d22-8fa9-c8b66de943fb admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:51.225636 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1462/2912] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:14:51 2022] POST /identity/v3/users => generated 283 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:14:51.229592 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3becd0-4c74-475c-9e10-036c3ba2cda7 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:51.240609 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3becd0-4c74-475c-9e10-036c3ba2cda7 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:51.245262 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d383b2-3b50-4e7f-80a0-f029321c1c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:51.245855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d383b2-3b50-4e7f-80a0-f029321c1c56 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:51.246133 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d383b2-3b50-4e7f-80a0-f029321c1c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:51.246410 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d383b2-3b50-4e7f-80a0-f029321c1c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:51.247080 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d383b2-3b50-4e7f-80a0-f029321c1c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:51.248732 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d383b2-3b50-4e7f-80a0-f029321c1c56 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:51.259165 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1451/2913] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:14:51.265672 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a5f87-2486-4d22-8fa9-c8b66de943fb admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:51.272939 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a5f87-2486-4d22-8fa9-c8b66de943fb admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:51.278220 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920ebe4-c2ae-4768-96ea-8d1a3a683e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:51.278825 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920ebe4-c2ae-4768-96ea-8d1a3a683e83 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:51.279107 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920ebe4-c2ae-4768-96ea-8d1a3a683e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:51.279385 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920ebe4-c2ae-4768-96ea-8d1a3a683e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:51.280027 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920ebe4-c2ae-4768-96ea-8d1a3a683e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:51.281675 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920ebe4-c2ae-4768-96ea-8d1a3a683e83 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:51.292441 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1463/2914] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 23:14:51.296497 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d383b2-3b50-4e7f-80a0-f029321c1c56 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:51.306724 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d383b2-3b50-4e7f-80a0-f029321c1c56 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:51.311225 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e478889-cd85-478e-9980-5f55d97fce41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:51.311855 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e478889-cd85-478e-9980-5f55d97fce41 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:51.312129 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e478889-cd85-478e-9980-5f55d97fce41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:51.312398 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e478889-cd85-478e-9980-5f55d97fce41 admin admin] PATH_INFO: `/v3/projects/7c6ce66191cf493fbabc5f88ea87047b/users/e73cf2a0b65142e6a784d0af7f8fa104/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:51.327059 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e478889-cd85-478e-9980-5f55d97fce41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6ce66191cf493fbabc5f88ea87047b, user_id=e73cf2a0b65142e6a784d0af7f8fa104, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:51.329745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e478889-cd85-478e-9980-5f55d97fce41 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:51.402749 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1452/2915] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:14:51 2022] PUT /identity/v3/projects/7c6ce66191cf493fbabc5f88ea87047b/users/e73cf2a0b65142e6a784d0af7f8fa104/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:14:51.413503 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef31acf-67bf-4618-bde2-d5f4aadaf6af None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:51.413790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef31acf-67bf-4618-bde2-d5f4aadaf6af None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:51.414065 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef31acf-67bf-4618-bde2-d5f4aadaf6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:51.441913 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-3ef31acf-67bf-4618-bde2-d5f4aadaf6af None None] MFA Rules not processed for user `e73cf2a0b65142e6a784d0af7f8fa104`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:14:51.443141 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-3ef31acf-67bf-4618-bde2-d5f4aadaf6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:14:51.506181 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1464/2916] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:14:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:14:51.516928 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e478889-cd85-478e-9980-5f55d97fce41 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:14:51.519522 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-2e478889-cd85-478e-9980-5f55d97fce41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:14:51.574258 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e478889-cd85-478e-9980-5f55d97fce41 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:14:51.577873 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc412e-7fa2-44c2-a778-b30ff682b410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:14:51.578480 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc412e-7fa2-44c2-a778-b30ff682b410 service cinder] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:14:51.578755 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc412e-7fa2-44c2-a778-b30ff682b410 service cinder] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:14:51.579635 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc412e-7fa2-44c2-a778-b30ff682b410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:14:51.587448 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc412e-7fa2-44c2-a778-b30ff682b410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:14:51.588903 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc412e-7fa2-44c2-a778-b30ff682b410 service cinder] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:14:51.598143 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1453/2917] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:14:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:15:01.327477 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef31acf-67bf-4618-bde2-d5f4aadaf6af None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:01.388260 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef31acf-67bf-4618-bde2-d5f4aadaf6af None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:01.392684 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0082c-c9bf-4e49-ad37-0a6ba6b77ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:01.393306 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0082c-c9bf-4e49-ad37-0a6ba6b77ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:01.393585 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0082c-c9bf-4e49-ad37-0a6ba6b77ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:01.393857 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0082c-c9bf-4e49-ad37-0a6ba6b77ffc admin admin] PATH_INFO: `/v3/users/e73cf2a0b65142e6a784d0af7f8fa104` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:01.394959 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0082c-c9bf-4e49-ad37-0a6ba6b77ffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e73cf2a0b65142e6a784d0af7f8fa104)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:01.396914 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0082c-c9bf-4e49-ad37-0a6ba6b77ffc admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:01.418766 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:15:01.558087 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-87f0082c-c9bf-4e49-ad37-0a6ba6b77ffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e73cf2a0b65142e6a784d0af7f8fa104'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:01.593509 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:INSERT=2,keystone:SELECT=43 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:15:01.613902 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-87f0082c-c9bf-4e49-ad37-0a6ba6b77ffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e73cf2a0b65142e6a784d0af7f8fa104'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:01.614520 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-87f0082c-c9bf-4e49-ad37-0a6ba6b77ffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e73cf2a0b65142e6a784d0af7f8fa104'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:01.627555 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-87f0082c-c9bf-4e49-ad37-0a6ba6b77ffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e73cf2a0b65142e6a784d0af7f8fa104'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:01.628209 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-87f0082c-c9bf-4e49-ad37-0a6ba6b77ffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e73cf2a0b65142e6a784d0af7f8fa104'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:01.640801 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1465/2918] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:15:01 2022] DELETE /identity/v3/users/e73cf2a0b65142e6a784d0af7f8fa104 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:15:01.644966 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcd589-6851-47bd-8ffa-a462b925facf None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:01.645759 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcd589-6851-47bd-8ffa-a462b925facf None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:01.646028 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcd589-6851-47bd-8ffa-a462b925facf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:01.665147 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-b0fcd589-6851-47bd-8ffa-a462b925facf None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:15:01.666336 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b0fcd589-6851-47bd-8ffa-a462b925facf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:15:01.723919 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1454/2919] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:15:01.733514 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0082c-c9bf-4e49-ad37-0a6ba6b77ffc admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:01.735187 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-87f0082c-c9bf-4e49-ad37-0a6ba6b77ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:15:01.796192 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0082c-c9bf-4e49-ad37-0a6ba6b77ffc admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:01.799842 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32758c-f47f-4247-a8f6-53e75eca0b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:01.800484 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32758c-f47f-4247-a8f6-53e75eca0b81 service neutron] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:01.800768 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32758c-f47f-4247-a8f6-53e75eca0b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:01.801043 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32758c-f47f-4247-a8f6-53e75eca0b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:01.809969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32758c-f47f-4247-a8f6-53e75eca0b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:01.811757 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32758c-f47f-4247-a8f6-53e75eca0b81 service neutron] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:01.821270 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1466/2920] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:15:02.243588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcd589-6851-47bd-8ffa-a462b925facf None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:02.245105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b0fcd589-6851-47bd-8ffa-a462b925facf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:15:02.257074 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcd589-6851-47bd-8ffa-a462b925facf None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:02.262149 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719424b-5325-4232-b505-93aa41e7bc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:02.262843 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719424b-5325-4232-b505-93aa41e7bc6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:02.263177 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719424b-5325-4232-b505-93aa41e7bc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:02.263498 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719424b-5325-4232-b505-93aa41e7bc6c admin admin] PATH_INFO: `/v3/projects/7c6ce66191cf493fbabc5f88ea87047b` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:02.264702 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719424b-5325-4232-b505-93aa41e7bc6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c6ce66191cf493fbabc5f88ea87047b)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:02.266645 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719424b-5325-4232-b505-93aa41e7bc6c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:02.362381 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2719424b-5325-4232-b505-93aa41e7bc6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c6ce66191cf493fbabc5f88ea87047b', 'request_id': 'req-2719424b-5325-4232-b505-93aa41e7bc6c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:02.368375 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2719424b-5325-4232-b505-93aa41e7bc6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c6ce66191cf493fbabc5f88ea87047b', 'request_id': 'req-2719424b-5325-4232-b505-93aa41e7bc6c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:02.425543 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2719424b-5325-4232-b505-93aa41e7bc6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c6ce66191cf493fbabc5f88ea87047b', 'request_id': 'req-2719424b-5325-4232-b505-93aa41e7bc6c'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:02.436654 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2719424b-5325-4232-b505-93aa41e7bc6c admin admin] The token cache is being invalidate because project 7c6ce66191cf493fbabc5f88ea87047b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:15:02.436939 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2719424b-5325-4232-b505-93aa41e7bc6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:02.437860 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2719424b-5325-4232-b505-93aa41e7bc6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:02.439056 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1455/2921] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:15:02 2022] DELETE /identity/v3/projects/7c6ce66191cf493fbabc5f88ea87047b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:15:02.443989 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f659f-6435-4717-8d92-2655442b50c4 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:02.444592 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f659f-6435-4717-8d92-2655442b50c4 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:02.444592 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f659f-6435-4717-8d92-2655442b50c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:02.464497 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-e83f659f-6435-4717-8d92-2655442b50c4 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:15:02.465709 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e83f659f-6435-4717-8d92-2655442b50c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:15:02.524694 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1467/2922] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:15:02.533648 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde2cef-ea13-4fd1-b22d-42d7f49eacfe None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:02.535657 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde2cef-ea13-4fd1-b22d-42d7f49eacfe None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:02.535657 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde2cef-ea13-4fd1-b22d-42d7f49eacfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:02.555154 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-7dde2cef-ea13-4fd1-b22d-42d7f49eacfe None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:15:02.556402 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7dde2cef-ea13-4fd1-b22d-42d7f49eacfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:15:02.564444 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1456/2923] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:15:02.569117 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f659f-6435-4717-8d92-2655442b50c4 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:02.578731 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f659f-6435-4717-8d92-2655442b50c4 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:02.583821 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01526389-2bdb-445a-802a-b60f22dd2b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:02.584408 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01526389-2bdb-445a-802a-b60f22dd2b89 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:02.584713 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01526389-2bdb-445a-802a-b60f22dd2b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:02.584985 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01526389-2bdb-445a-802a-b60f22dd2b89 admin admin] PATH_INFO: `/v3/domains` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:02.585638 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01526389-2bdb-445a-802a-b60f22dd2b89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:15:02.585921 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01526389-2bdb-445a-802a-b60f22dd2b89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:02.587500 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01526389-2bdb-445a-802a-b60f22dd2b89 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:02.599042 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1468/2924] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 23:15:02.603158 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde2cef-ea13-4fd1-b22d-42d7f49eacfe None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:02.612559 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde2cef-ea13-4fd1-b22d-42d7f49eacfe None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:02.617193 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a43c8b-8b65-4dcd-a72f-c590032cc1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:02.617781 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43c8b-8b65-4dcd-a72f-c590032cc1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:02.618051 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43c8b-8b65-4dcd-a72f-c590032cc1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:02.618316 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43c8b-8b65-4dcd-a72f-c590032cc1b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:02.618935 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a43c8b-8b65-4dcd-a72f-c590032cc1b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:02.620906 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a43c8b-8b65-4dcd-a72f-c590032cc1b8 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:02.723415 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1457/2925] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:15:02 2022] POST /identity/v3/projects => generated 405 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:15:02.727609 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01526389-2bdb-445a-802a-b60f22dd2b89 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:02.737856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01526389-2bdb-445a-802a-b60f22dd2b89 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:02.765450 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:15:02.801010 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b27ad-79d4-4056-8cdf-b3c492e192c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:02.801530 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b27ad-79d4-4056-8cdf-b3c492e192c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:02.801810 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b27ad-79d4-4056-8cdf-b3c492e192c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:02.802088 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b27ad-79d4-4056-8cdf-b3c492e192c6 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:02.802730 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b27ad-79d4-4056-8cdf-b3c492e192c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:02.804681 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b27ad-79d4-4056-8cdf-b3c492e192c6 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:02.888252 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1469/2926] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:15:02 2022] POST /identity/v3/users => generated 303 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 23:15:02.892548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a43c8b-8b65-4dcd-a72f-c590032cc1b8 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:02.903454 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a43c8b-8b65-4dcd-a72f-c590032cc1b8 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:02.907946 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9e925-0ea7-430e-aaf6-a89347722378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:02.908569 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9e925-0ea7-430e-aaf6-a89347722378 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:02.908845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9e925-0ea7-430e-aaf6-a89347722378 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:02.909114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9e925-0ea7-430e-aaf6-a89347722378 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:02.909834 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9e925-0ea7-430e-aaf6-a89347722378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:02.911429 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9e925-0ea7-430e-aaf6-a89347722378 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:02.921366 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1458/2927] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:15:02.925198 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b27ad-79d4-4056-8cdf-b3c492e192c6 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:02.935459 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b27ad-79d4-4056-8cdf-b3c492e192c6 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:02.940214 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd457f-0064-4d90-a60e-7c540df42088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:02.940841 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd457f-0064-4d90-a60e-7c540df42088 admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:02.941121 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd457f-0064-4d90-a60e-7c540df42088 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:02.941391 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd457f-0064-4d90-a60e-7c540df42088 admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:02.942683 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd457f-0064-4d90-a60e-7c540df42088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:02.944249 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd457f-0064-4d90-a60e-7c540df42088 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:02.954927 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1470/2928] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:15:02.959012 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9e925-0ea7-430e-aaf6-a89347722378 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:02.968877 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9e925-0ea7-430e-aaf6-a89347722378 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:02.973422 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafad6f4-01a8-4cac-9514-3f82bc581e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:02.974054 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafad6f4-01a8-4cac-9514-3f82bc581e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:02.974328 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafad6f4-01a8-4cac-9514-3f82bc581e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:02.974598 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafad6f4-01a8-4cac-9514-3f82bc581e66 admin admin] PATH_INFO: `/v3/projects/4ffb463e9c4445979a158eb45401ed2f/users/396e0694a85e41f084aba5d3167d6f57/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:02.989369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafad6f4-01a8-4cac-9514-3f82bc581e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ffb463e9c4445979a158eb45401ed2f, user_id=396e0694a85e41f084aba5d3167d6f57, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:02.992053 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafad6f4-01a8-4cac-9514-3f82bc581e66 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:03.072617 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1459/2929] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:15:02 2022] PUT /identity/v3/projects/4ffb463e9c4445979a158eb45401ed2f/users/396e0694a85e41f084aba5d3167d6f57/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 23:15:03.085604 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a4770-e5d2-417f-bcca-2759bd4efa79 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:03.085974 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a4770-e5d2-417f-bcca-2759bd4efa79 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:03.086260 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a4770-e5d2-417f-bcca-2759bd4efa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:03.114871 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-5c0a4770-e5d2-417f-bcca-2759bd4efa79 None None] MFA Rules not processed for user `396e0694a85e41f084aba5d3167d6f57`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:15:03.116097 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-5c0a4770-e5d2-417f-bcca-2759bd4efa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:15:03.178442 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1471/2930] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:15:03 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:15:03.183021 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafad6f4-01a8-4cac-9514-3f82bc581e66 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:03.203770 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:15:03.243566 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafad6f4-01a8-4cac-9514-3f82bc581e66 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:03.248332 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc446b86-3ef1-4808-83d9-a6441cd8d0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:03.248961 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc446b86-3ef1-4808-83d9-a6441cd8d0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:03.249239 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc446b86-3ef1-4808-83d9-a6441cd8d0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:03.249512 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc446b86-3ef1-4808-83d9-a6441cd8d0e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:03.250165 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc446b86-3ef1-4808-83d9-a6441cd8d0e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:03.252126 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc446b86-3ef1-4808-83d9-a6441cd8d0e9 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:03.346005 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1460/2931] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:15:03 2022] POST /identity/v3/projects => generated 405 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:15:03.350598 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a4770-e5d2-417f-bcca-2759bd4efa79 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:03.361698 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a4770-e5d2-417f-bcca-2759bd4efa79 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:03.435094 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae771a-587b-4d95-831f-77ff289499f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:03.436011 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae771a-587b-4d95-831f-77ff289499f6 admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:03.436453 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae771a-587b-4d95-831f-77ff289499f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:03.436893 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae771a-587b-4d95-831f-77ff289499f6 admin admin] PATH_INFO: `/v3/users` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:03.437760 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae771a-587b-4d95-831f-77ff289499f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:03.440662 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae771a-587b-4d95-831f-77ff289499f6 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:03.534021 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1472/2932] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:15:03 2022] POST /identity/v3/users => generated 309 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:15:03.538475 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc446b86-3ef1-4808-83d9-a6441cd8d0e9 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:03.548778 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc446b86-3ef1-4808-83d9-a6441cd8d0e9 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:03.554114 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958d3ee-2e76-45a9-ac31-b98497dff9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:03.554718 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958d3ee-2e76-45a9-ac31-b98497dff9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:03.554998 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958d3ee-2e76-45a9-ac31-b98497dff9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:03.555275 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958d3ee-2e76-45a9-ac31-b98497dff9e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:03.555960 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958d3ee-2e76-45a9-ac31-b98497dff9e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:03.557604 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958d3ee-2e76-45a9-ac31-b98497dff9e2 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:03.567975 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1461/2933] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:15:03.571987 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae771a-587b-4d95-831f-77ff289499f6 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:03.582303 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae771a-587b-4d95-831f-77ff289499f6 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:03.586873 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b3264-79f9-4ca6-9fef-6ef7e3c10863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:03.587516 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b3264-79f9-4ca6-9fef-6ef7e3c10863 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:03.587790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b3264-79f9-4ca6-9fef-6ef7e3c10863 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:03.588059 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b3264-79f9-4ca6-9fef-6ef7e3c10863 admin admin] PATH_INFO: `/v3/projects/23471a7ff8e2401586f388a0e20f20f5/users/35c98f33c7184d7ba675320f78771db7/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:03.602950 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b3264-79f9-4ca6-9fef-6ef7e3c10863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23471a7ff8e2401586f388a0e20f20f5, user_id=35c98f33c7184d7ba675320f78771db7, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:03.605624 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b3264-79f9-4ca6-9fef-6ef7e3c10863 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:03.653608 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1473/2934] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:15:03 2022] PUT /identity/v3/projects/23471a7ff8e2401586f388a0e20f20f5/users/35c98f33c7184d7ba675320f78771db7/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 23:15:03.657590 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958d3ee-2e76-45a9-ac31-b98497dff9e2 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:03.668412 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958d3ee-2e76-45a9-ac31-b98497dff9e2 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:03.725250 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513ac08-2892-4a20-9d00-f5abb8bb2cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:03.725897 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513ac08-2892-4a20-9d00-f5abb8bb2cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:03.726182 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513ac08-2892-4a20-9d00-f5abb8bb2cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:03.726457 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513ac08-2892-4a20-9d00-f5abb8bb2cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:03.727105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513ac08-2892-4a20-9d00-f5abb8bb2cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:03.728760 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513ac08-2892-4a20-9d00-f5abb8bb2cb1 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:03.739393 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1462/2935] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:15:03.744900 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b3264-79f9-4ca6-9fef-6ef7e3c10863 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:03.750334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:15:03.755682 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b3264-79f9-4ca6-9fef-6ef7e3c10863 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:03.760240 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f722e8-403c-4a8c-8821-a0c5da2fa5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:03.760916 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f722e8-403c-4a8c-8821-a0c5da2fa5f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:03.761194 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f722e8-403c-4a8c-8821-a0c5da2fa5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:03.761509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f722e8-403c-4a8c-8821-a0c5da2fa5f8 admin admin] PATH_INFO: `/v3/projects/23471a7ff8e2401586f388a0e20f20f5/users/35c98f33c7184d7ba675320f78771db7/roles/aa2332d1bdb74e48a88ed7c2a7ed2990` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:03.763432 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f722e8-403c-4a8c-8821-a0c5da2fa5f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23471a7ff8e2401586f388a0e20f20f5, user_id=35c98f33c7184d7ba675320f78771db7, role_id=aa2332d1bdb74e48a88ed7c2a7ed2990)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:03.766155 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f722e8-403c-4a8c-8821-a0c5da2fa5f8 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:03.776696 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1474/2936] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:15:03 2022] PUT /identity/v3/projects/23471a7ff8e2401586f388a0e20f20f5/users/35c98f33c7184d7ba675320f78771db7/roles/aa2332d1bdb74e48a88ed7c2a7ed2990 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:15:03.788711 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18111b-8ee5-4d64-8c69-efee8c4e75e7 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:03.789003 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18111b-8ee5-4d64-8c69-efee8c4e75e7 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:03.789281 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18111b-8ee5-4d64-8c69-efee8c4e75e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:03.817082 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-cc18111b-8ee5-4d64-8c69-efee8c4e75e7 None None] MFA Rules not processed for user `35c98f33c7184d7ba675320f78771db7`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:15:03.818278 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-cc18111b-8ee5-4d64-8c69-efee8c4e75e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:15:03.895636 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1463/2937] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:15:03 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:15:03.900560 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f722e8-403c-4a8c-8821-a0c5da2fa5f8 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:03.902225 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-96f722e8-403c-4a8c-8821-a0c5da2fa5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:15:03.959567 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f722e8-403c-4a8c-8821-a0c5da2fa5f8 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:03.963256 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6a869-464b-4c10-9dbe-4221514a7e16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:03.963855 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6a869-464b-4c10-9dbe-4221514a7e16 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:03.964137 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6a869-464b-4c10-9dbe-4221514a7e16 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:03.964411 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6a869-464b-4c10-9dbe-4221514a7e16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:03.973968 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6a869-464b-4c10-9dbe-4221514a7e16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:03.975391 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6a869-464b-4c10-9dbe-4221514a7e16 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:03.984984 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1475/2938] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:15:03 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:15:04.140011 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18111b-8ee5-4d64-8c69-efee8c4e75e7 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:04.157642 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:15:04.200765 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18111b-8ee5-4d64-8c69-efee8c4e75e7 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:04.205436 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4b62b-924e-4391-abaf-4af79e9798a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:04.206069 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4b62b-924e-4391-abaf-4af79e9798a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:04.206374 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4b62b-924e-4391-abaf-4af79e9798a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:04.206673 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4b62b-924e-4391-abaf-4af79e9798a7 admin admin] PATH_INFO: `/v3/users/396e0694a85e41f084aba5d3167d6f57` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:04.208472 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4b62b-924e-4391-abaf-4af79e9798a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=396e0694a85e41f084aba5d3167d6f57)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:04.210423 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4b62b-924e-4391-abaf-4af79e9798a7 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:04.390215 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f5a4b62b-924e-4391-abaf-4af79e9798a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '396e0694a85e41f084aba5d3167d6f57'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:04.465170 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f5a4b62b-924e-4391-abaf-4af79e9798a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '396e0694a85e41f084aba5d3167d6f57'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:04.465745 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f5a4b62b-924e-4391-abaf-4af79e9798a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '396e0694a85e41f084aba5d3167d6f57'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:04.466352 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f5a4b62b-924e-4391-abaf-4af79e9798a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '396e0694a85e41f084aba5d3167d6f57'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:04.473710 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-f5a4b62b-924e-4391-abaf-4af79e9798a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '396e0694a85e41f084aba5d3167d6f57'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:04.492953 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1464/2939] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:15:04 2022] DELETE /identity/v3/users/396e0694a85e41f084aba5d3167d6f57 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:15:04.498251 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139e528-2bf6-4814-b55c-10af534f4c1f None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:04.498251 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139e528-2bf6-4814-b55c-10af534f4c1f None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:04.498251 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139e528-2bf6-4814-b55c-10af534f4c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:04.517160 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-e139e528-2bf6-4814-b55c-10af534f4c1f None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:15:04.521187 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e139e528-2bf6-4814-b55c-10af534f4c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:15:04.577300 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1476/2940] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:15:04.587223 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4b62b-924e-4391-abaf-4af79e9798a7 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:04.588658 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-f5a4b62b-924e-4391-abaf-4af79e9798a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:15:04.645462 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4b62b-924e-4391-abaf-4af79e9798a7 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:04.649105 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843242a-4a4a-4944-bb10-43a7654c181b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:04.649706 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843242a-4a4a-4944-bb10-43a7654c181b service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:04.649985 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843242a-4a4a-4944-bb10-43a7654c181b service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:04.650255 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843242a-4a4a-4944-bb10-43a7654c181b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:04.659184 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843242a-4a4a-4944-bb10-43a7654c181b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:04.660684 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843242a-4a4a-4944-bb10-43a7654c181b service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:04.671123 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1465/2941] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:15:05.066509 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139e528-2bf6-4814-b55c-10af534f4c1f None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:05.068056 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e139e528-2bf6-4814-b55c-10af534f4c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:15:05.080034 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139e528-2bf6-4814-b55c-10af534f4c1f None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:05.085334 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccd207-b37b-4d68-893b-4b7b372d4715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:05.086101 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccd207-b37b-4d68-893b-4b7b372d4715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:05.086565 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccd207-b37b-4d68-893b-4b7b372d4715 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:05.086856 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccd207-b37b-4d68-893b-4b7b372d4715 admin admin] PATH_INFO: `/v3/projects/4ffb463e9c4445979a158eb45401ed2f` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:05.088280 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccd207-b37b-4d68-893b-4b7b372d4715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ffb463e9c4445979a158eb45401ed2f)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:05.090657 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccd207-b37b-4d68-893b-4b7b372d4715 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:05.202271 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4cccd207-b37b-4d68-893b-4b7b372d4715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ffb463e9c4445979a158eb45401ed2f', 'request_id': 'req-4cccd207-b37b-4d68-893b-4b7b372d4715'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:05.208899 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4cccd207-b37b-4d68-893b-4b7b372d4715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ffb463e9c4445979a158eb45401ed2f', 'request_id': 'req-4cccd207-b37b-4d68-893b-4b7b372d4715'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:05.265122 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4cccd207-b37b-4d68-893b-4b7b372d4715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ffb463e9c4445979a158eb45401ed2f', 'request_id': 'req-4cccd207-b37b-4d68-893b-4b7b372d4715'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:05.275917 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4cccd207-b37b-4d68-893b-4b7b372d4715 admin admin] The token cache is being invalidate because project 4ffb463e9c4445979a158eb45401ed2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:15:05.276204 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4cccd207-b37b-4d68-893b-4b7b372d4715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:05.276845 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-4cccd207-b37b-4d68-893b-4b7b372d4715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:05.278322 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1477/2942] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:15:05 2022] DELETE /identity/v3/projects/4ffb463e9c4445979a158eb45401ed2f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:15:05.282311 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843242a-4a4a-4944-bb10-43a7654c181b service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:05.292764 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843242a-4a4a-4944-bb10-43a7654c181b service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:05.325369 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:15:05.347782 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f801692-de2a-437c-88b5-b68bc032b793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:05.349090 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f801692-de2a-437c-88b5-b68bc032b793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:05.349555 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f801692-de2a-437c-88b5-b68bc032b793 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:05.350036 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f801692-de2a-437c-88b5-b68bc032b793 admin admin] PATH_INFO: `/v3/users/35c98f33c7184d7ba675320f78771db7` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:05.351520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f801692-de2a-437c-88b5-b68bc032b793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35c98f33c7184d7ba675320f78771db7)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:05.353521 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f801692-de2a-437c-88b5-b68bc032b793 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:05.511615 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2f801692-de2a-437c-88b5-b68bc032b793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35c98f33c7184d7ba675320f78771db7'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:05.584498 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2f801692-de2a-437c-88b5-b68bc032b793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35c98f33c7184d7ba675320f78771db7'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:05.585044 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2f801692-de2a-437c-88b5-b68bc032b793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35c98f33c7184d7ba675320f78771db7'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:05.585644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2f801692-de2a-437c-88b5-b68bc032b793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35c98f33c7184d7ba675320f78771db7'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:05.592858 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-2f801692-de2a-437c-88b5-b68bc032b793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35c98f33c7184d7ba675320f78771db7'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:05.610520 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1466/2943] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:15:05 2022] DELETE /identity/v3/users/35c98f33c7184d7ba675320f78771db7 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:15:06.026107 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccd207-b37b-4d68-893b-4b7b372d4715 admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:06.027668 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-4cccd207-b37b-4d68-893b-4b7b372d4715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:15:06.041131 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccd207-b37b-4d68-893b-4b7b372d4715 admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:06.055649 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:15:06.100582 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a522594-f438-4d79-a4b6-b740da5e3ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:06.101224 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a522594-f438-4d79-a4b6-b740da5e3ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:06.101507 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a522594-f438-4d79-a4b6-b740da5e3ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:06.101786 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a522594-f438-4d79-a4b6-b740da5e3ac7 admin admin] PATH_INFO: `/v3/projects/23471a7ff8e2401586f388a0e20f20f5` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:06.102899 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a522594-f438-4d79-a4b6-b740da5e3ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23471a7ff8e2401586f388a0e20f20f5)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:06.105064 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a522594-f438-4d79-a4b6-b740da5e3ac7 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:06.243494 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-6a522594-f438-4d79-a4b6-b740da5e3ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23471a7ff8e2401586f388a0e20f20f5', 'request_id': 'req-6a522594-f438-4d79-a4b6-b740da5e3ac7'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:06.249525 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-6a522594-f438-4d79-a4b6-b740da5e3ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23471a7ff8e2401586f388a0e20f20f5', 'request_id': 'req-6a522594-f438-4d79-a4b6-b740da5e3ac7'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:06.311049 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-6a522594-f438-4d79-a4b6-b740da5e3ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23471a7ff8e2401586f388a0e20f20f5', 'request_id': 'req-6a522594-f438-4d79-a4b6-b740da5e3ac7'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:06.322202 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-6a522594-f438-4d79-a4b6-b740da5e3ac7 admin admin] The token cache is being invalidate because project 23471a7ff8e2401586f388a0e20f20f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:15:06.322496 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-6a522594-f438-4d79-a4b6-b740da5e3ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:06.323107 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-6a522594-f438-4d79-a4b6-b740da5e3ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:06.324634 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1478/2944] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:15:06 2022] DELETE /identity/v3/projects/23471a7ff8e2401586f388a0e20f20f5 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:15:06.330473 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f84e7-2640-406d-a888-e560a51dbf6a None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:06.330972 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f84e7-2640-406d-a888-e560a51dbf6a None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:06.331086 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f84e7-2640-406d-a888-e560a51dbf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:06.350607 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-d23f84e7-2640-406d-a888-e560a51dbf6a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:15:06.351787 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d23f84e7-2640-406d-a888-e560a51dbf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:15:06.408767 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1467/2945] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:15:06.468073 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e00983-a76e-4678-8ac6-3b811109b302 None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:06.468388 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e00983-a76e-4678-8ac6-3b811109b302 None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:06.468692 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e00983-a76e-4678-8ac6-3b811109b302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:06.490115 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-a6e00983-a76e-4678-8ac6-3b811109b302 None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:15:06.491315 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-a6e00983-a76e-4678-8ac6-3b811109b302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:15:06.501317 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1479/2946] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:15:06.503469 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f84e7-2640-406d-a888-e560a51dbf6a None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:06.513442 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f84e7-2640-406d-a888-e560a51dbf6a None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:06.518095 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48909868-56bc-4ecd-b49b-f52b01f872d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:06.518690 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48909868-56bc-4ecd-b49b-f52b01f872d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:06.518970 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48909868-56bc-4ecd-b49b-f52b01f872d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:06.519260 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48909868-56bc-4ecd-b49b-f52b01f872d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:06.519917 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48909868-56bc-4ecd-b49b-f52b01f872d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 23:15:06.520220 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48909868-56bc-4ecd-b49b-f52b01f872d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:06.521891 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48909868-56bc-4ecd-b49b-f52b01f872d5 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:06.533845 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1468/2947] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Sep 6 23:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 23:15:06.548752 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e00983-a76e-4678-8ac6-3b811109b302 None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:06.558645 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e00983-a76e-4678-8ac6-3b811109b302 None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:06.563281 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019efc3-36e5-4b6b-b070-612c60e2471c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:06.563868 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019efc3-36e5-4b6b-b070-612c60e2471c admin admin] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:06.564142 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019efc3-36e5-4b6b-b070-612c60e2471c admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:06.564409 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019efc3-36e5-4b6b-b070-612c60e2471c admin admin] PATH_INFO: `/v3/projects` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:06.565068 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019efc3-36e5-4b6b-b070-612c60e2471c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:06.566994 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019efc3-36e5-4b6b-b070-612c60e2471c admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:06.626361 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1480/2948] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Sep 6 23:15:06 2022] POST /identity/v3/projects => generated 389 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:15:06.630472 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48909868-56bc-4ecd-b49b-f52b01f872d5 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:06.640331 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48909868-56bc-4ecd-b49b-f52b01f872d5 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:06.681326 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:15:06.696856 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67c858-2010-4b87-8d7c-f7929fcd36f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:06.697460 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67c858-2010-4b87-8d7c-f7929fcd36f6 admin admin] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:06.697736 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67c858-2010-4b87-8d7c-f7929fcd36f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:06.698008 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67c858-2010-4b87-8d7c-f7929fcd36f6 admin admin] PATH_INFO: `/v3/users` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:06.698627 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67c858-2010-4b87-8d7c-f7929fcd36f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:06.700584 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67c858-2010-4b87-8d7c-f7929fcd36f6 admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:06.774310 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1469/2949] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Sep 6 23:15:06 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 23:15:06.778340 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019efc3-36e5-4b6b-b070-612c60e2471c admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:06.789251 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019efc3-36e5-4b6b-b070-612c60e2471c admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:06.793763 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042136d-7f75-48b4-a37b-c0942111557f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:06.794355 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042136d-7f75-48b4-a37b-c0942111557f admin admin] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:06.794632 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042136d-7f75-48b4-a37b-c0942111557f admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:06.794907 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042136d-7f75-48b4-a37b-c0942111557f admin admin] PATH_INFO: `/v3/roles` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:06.795567 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042136d-7f75-48b4-a37b-c0942111557f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:06.797218 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042136d-7f75-48b4-a37b-c0942111557f admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:06.806969 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1481/2950] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:15:06.810679 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67c858-2010-4b87-8d7c-f7929fcd36f6 admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:06.820830 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67c858-2010-4b87-8d7c-f7929fcd36f6 admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:06.825370 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b99aa4-4be0-4f14-8218-775e7847896b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:06.825975 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b99aa4-4be0-4f14-8218-775e7847896b admin admin] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:06.826251 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b99aa4-4be0-4f14-8218-775e7847896b admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:06.826522 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b99aa4-4be0-4f14-8218-775e7847896b admin admin] PATH_INFO: `/v3/roles` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:06.827152 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b99aa4-4be0-4f14-8218-775e7847896b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:06.828782 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b99aa4-4be0-4f14-8218-775e7847896b admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:06.839817 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1470/2951] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Sep 6 23:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 23:15:06.843617 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042136d-7f75-48b4-a37b-c0942111557f admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:06.853822 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042136d-7f75-48b4-a37b-c0942111557f admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:06.858266 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d2aea-c75a-4677-bc83-ddeae604281d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:06.858898 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d2aea-c75a-4677-bc83-ddeae604281d admin admin] REQUEST_METHOD: `PUT` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:06.859172 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d2aea-c75a-4677-bc83-ddeae604281d admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:06.859460 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d2aea-c75a-4677-bc83-ddeae604281d admin admin] PATH_INFO: `/v3/projects/0abac0a78e384c1e84b7a675a49dd78f/users/c74e875748804f739cda1312862c724a/roles/093c83b316db4d0f9dc55ec6e3583ba8` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:06.874620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d2aea-c75a-4677-bc83-ddeae604281d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0abac0a78e384c1e84b7a675a49dd78f, user_id=c74e875748804f739cda1312862c724a, role_id=093c83b316db4d0f9dc55ec6e3583ba8)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:06.877348 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d2aea-c75a-4677-bc83-ddeae604281d admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:06.950439 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1482/2952] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Sep 6 23:15:06 2022] PUT /identity/v3/projects/0abac0a78e384c1e84b7a675a49dd78f/users/c74e875748804f739cda1312862c724a/roles/093c83b316db4d0f9dc55ec6e3583ba8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:15:06.960828 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195cb59-7092-4e3f-aeb7-1744d339f4a0 None None] REQUEST_METHOD: `POST` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:06.961111 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195cb59-7092-4e3f-aeb7-1744d339f4a0 None None] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:06.961383 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195cb59-7092-4e3f-aeb7-1744d339f4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:06.989168 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.auth.core [None req-a195cb59-7092-4e3f-aeb7-1744d339f4a0 None None] MFA Rules not processed for user `c74e875748804f739cda1312862c724a`. Rule list: `[]` (Enabled: `True`). {{(pid=88077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:15:06.990401 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-a195cb59-7092-4e3f-aeb7-1744d339f4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:15:07.053740 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1471/2953] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:15:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:15:07.064206 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d2aea-c75a-4677-bc83-ddeae604281d admin admin] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:07.065931 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-0a0d2aea-c75a-4677-bc83-ddeae604281d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:15:07.112006 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:15:07.123255 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d2aea-c75a-4677-bc83-ddeae604281d admin admin] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:07.126933 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7662f5f-350e-430a-b599-8b98f3dd1b98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ef596f83ce54fab8779e4e0f3899abc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:07.127536 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7662f5f-350e-430a-b599-8b98f3dd1b98 service cinder] REQUEST_METHOD: `GET` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:07.127816 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7662f5f-350e-430a-b599-8b98f3dd1b98 service cinder] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:07.128087 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7662f5f-350e-430a-b599-8b98f3dd1b98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:07.136824 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7662f5f-350e-430a-b599-8b98f3dd1b98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:07.138251 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7662f5f-350e-430a-b599-8b98f3dd1b98 service cinder] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:07.147790 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1483/2954] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:15:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:15:17.050899 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=46,keystone:INSERT=3 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:15:17.179327 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=7 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:15:18.473587 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195cb59-7092-4e3f-aeb7-1744d339f4a0 None None] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:18.577657 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195cb59-7092-4e3f-aeb7-1744d339f4a0 None None] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:18.582294 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22172cb-5dc5-4e00-b95e-abfa17a6285c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:18.582925 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22172cb-5dc5-4e00-b95e-abfa17a6285c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:18.583207 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22172cb-5dc5-4e00-b95e-abfa17a6285c admin admin] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:18.583481 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22172cb-5dc5-4e00-b95e-abfa17a6285c admin admin] PATH_INFO: `/v3/users/c74e875748804f739cda1312862c724a` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:18.584714 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22172cb-5dc5-4e00-b95e-abfa17a6285c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c74e875748804f739cda1312862c724a)` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:18.587210 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22172cb-5dc5-4e00-b95e-abfa17a6285c admin admin] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:18.785994 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d22172cb-5dc5-4e00-b95e-abfa17a6285c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c74e875748804f739cda1312862c724a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:18.881859 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d22172cb-5dc5-4e00-b95e-abfa17a6285c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c74e875748804f739cda1312862c724a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:18.882930 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d22172cb-5dc5-4e00-b95e-abfa17a6285c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c74e875748804f739cda1312862c724a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:18.883536 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d22172cb-5dc5-4e00-b95e-abfa17a6285c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c74e875748804f739cda1312862c724a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:18.890644 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.notifications [None req-d22172cb-5dc5-4e00-b95e-abfa17a6285c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c74e875748804f739cda1312862c724a'} {{(pid=88077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:18.907964 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1472/2955] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Sep 6 23:15:18 2022] DELETE /identity/v3/users/c74e875748804f739cda1312862c724a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:15:18.912383 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ad4e7-9deb-4432-90e4-6485b1ec092a None None] REQUEST_METHOD: `POST` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:18.912886 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ad4e7-9deb-4432-90e4-6485b1ec092a None None] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:18.913001 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ad4e7-9deb-4432-90e4-6485b1ec092a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:18.952391 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.auth.core [None req-e80ad4e7-9deb-4432-90e4-6485b1ec092a None None] MFA Rules not processed for user `8c7dd247a668409cb8ef9f1bcc9cb927`. Rule list: `[]` (Enabled: `True`). {{(pid=88078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 23:15:18.953620 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e80ad4e7-9deb-4432-90e4-6485b1ec092a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:15:19.011166 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1484/2956] 10.222.0.30 () {58 vars in 958 bytes} [Tue Sep 6 23:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 23:15:19.020657 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22172cb-5dc5-4e00-b95e-abfa17a6285c admin admin] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:19.022084 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-d22172cb-5dc5-4e00-b95e-abfa17a6285c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:15:19.062353 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:15:19.096641 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22172cb-5dc5-4e00-b95e-abfa17a6285c admin admin] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:19.100794 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e42a1-7f27-4574-8524-78f8a72d5717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314bb14d5fa1414a832efb6d37c0446d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:19.101438 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e42a1-7f27-4574-8524-78f8a72d5717 service neutron] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:19.101717 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e42a1-7f27-4574-8524-78f8a72d5717 service neutron] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:19.101991 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e42a1-7f27-4574-8524-78f8a72d5717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:19.111161 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e42a1-7f27-4574-8524-78f8a72d5717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:19.115491 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e42a1-7f27-4574-8524-78f8a72d5717 service neutron] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:19.122548 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1473/2957] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:15:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:15:19.484319 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ad4e7-9deb-4432-90e4-6485b1ec092a None None] Authenticating user token {{(pid=88078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:15:19.486083 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.fernet_utils [None req-e80ad4e7-9deb-4432-90e4-6485b1ec092a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:15:19.499053 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ad4e7-9deb-4432-90e4-6485b1ec092a None None] Validating token access rules against request {{(pid=88078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:15:19.504089 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb6c14-43e5-41a6-8f89-1ed830c29f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7dd247a668409cb8ef9f1bcc9cb927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff1d6ddadcad498caaf30606299b1515', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:15:19.504789 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb6c14-43e5-41a6-8f89-1ed830c29f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:15:19.505072 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb6c14-43e5-41a6-8f89-1ed830c29f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:15:19.505347 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb6c14-43e5-41a6-8f89-1ed830c29f27 admin admin] PATH_INFO: `/v3/projects/0abac0a78e384c1e84b7a675a49dd78f` {{(pid=88078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:15:19.506505 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb6c14-43e5-41a6-8f89-1ed830c29f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0abac0a78e384c1e84b7a675a49dd78f)` {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:15:19.508512 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb6c14-43e5-41a6-8f89-1ed830c29f27 admin admin] RBAC: Authorization granted {{(pid=88078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:15:19.608458 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-7bbb6c14-43e5-41a6-8f89-1ed830c29f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0abac0a78e384c1e84b7a675a49dd78f', 'request_id': 'req-7bbb6c14-43e5-41a6-8f89-1ed830c29f27'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:19.614912 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-7bbb6c14-43e5-41a6-8f89-1ed830c29f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0abac0a78e384c1e84b7a675a49dd78f', 'request_id': 'req-7bbb6c14-43e5-41a6-8f89-1ed830c29f27'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:19.709868 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-7bbb6c14-43e5-41a6-8f89-1ed830c29f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0abac0a78e384c1e84b7a675a49dd78f', 'request_id': 'req-7bbb6c14-43e5-41a6-8f89-1ed830c29f27'} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:19.721588 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-7bbb6c14-43e5-41a6-8f89-1ed830c29f27 admin admin] The token cache is being invalidate because project 0abac0a78e384c1e84b7a675a49dd78f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 23:15:19.725236 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-7bbb6c14-43e5-41a6-8f89-1ed830c29f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:19.725236 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG keystone.notifications [None req-7bbb6c14-43e5-41a6-8f89-1ed830c29f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 23:15:19.725236 dv-cinder-852208-20-smb devstack@keystone.service[88078]: [pid: 88078|app: 0|req: 1485/2958] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Sep 6 23:15:19 2022] DELETE /identity/v3/projects/0abac0a78e384c1e84b7a675a49dd78f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 23:15:29.156151 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=16 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:15:29.718233 dv-cinder-852208-20-smb devstack@keystone.service[88078]: DEBUG dbcounter [-] [88078] Writing DB stats keystone:SELECT=63,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 23:16:26.628305 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e42a1-7f27-4574-8524-78f8a72d5717 service neutron] Authenticating user token {{(pid=88077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 23:16:26.629780 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-b42e42a1-7f27-4574-8524-78f8a72d5717 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:16:26.718060 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e42a1-7f27-4574-8524-78f8a72d5717 service neutron] Validating token access rules against request {{(pid=88077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 23:16:26.780588 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3c718-3247-4f23-a0fc-4eeb72c47ba3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6bd5bbbf65461990c9bb2747dbe5e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e78b142d654280b161a34cec0186cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 23:16:26.781199 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c718-3247-4f23-a0fc-4eeb72c47ba3 service placement] REQUEST_METHOD: `GET` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 23:16:26.781479 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c718-3247-4f23-a0fc-4eeb72c47ba3 service placement] SCRIPT_NAME: `/identity` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 23:16:26.781754 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c718-3247-4f23-a0fc-4eeb72c47ba3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 23:16:26.783502 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.fernet_utils [None req-7ab3c718-3247-4f23-a0fc-4eeb72c47ba3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 23:16:26.794546 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3c718-3247-4f23-a0fc-4eeb72c47ba3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 23:16:26.796130 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3c718-3247-4f23-a0fc-4eeb72c47ba3 service placement] RBAC: Authorization granted {{(pid=88077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 23:16:26.805924 dv-cinder-852208-20-smb devstack@keystone.service[88077]: [pid: 88077|app: 0|req: 1474/2959] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Sep 6 23:16:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 23:16:36.801749 dv-cinder-852208-20-smb devstack@keystone.service[88077]: DEBUG dbcounter [-] [88077] Writing DB stats keystone:SELECT=67 {{(pid=88077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}